00000001:02000400:2.0F:1782221848.866765:0:3309:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg327-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1782221868.275703:0:3529:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1782221870.429050:0:3591:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 539 MB/s 00000001:01000000:0.0F:1782221870.678962:0:3591:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1175 MB/s 00000001:01000000:2.0:1782221870.928386:0:3591:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4551 MB/s 00000020:02000000:0.0:1782221871.794767:0:3622:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_83_g330a3f4 00000400:02000000:0.0:1782221872.993660:0:3637:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.203.127@tcp [8/256/0/180] 00008000:02000000:0.0:1782221876.730023:0:3787:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1782221936.995980:0:5753:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1782221951.406960:0:6503:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1782221951.406970:0:6503:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1782221951.406971:0:6503:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1782221951.407128:0:6503:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000f720c4e1 00000080:02000400:2.0:1782221951.407142:0:6503:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1782221951.418854:0:6503:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1782221951.419040:0:6503:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1782221951.419076:0:6503:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000106ccf8e) 00000020:00000080:2.0:1782221951.419100:0:6503:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1782221951.481569:0:6503:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1782221951.481682:0:6503:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:2.0:1782221951.521190:0:6503:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1782221951.522404:0:6503:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1782221951.522415:0:6503:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1782221951.522430:0:6503:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe2b7cc26e6810d31 00000020:01000004:2.0:1782221951.522439:0:6503:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1782221951.522445:0:6503:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1782221951.522451:0:6503:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f720c4e1 from MGS 00000020:01000004:2.0:1782221951.522457:0:6503:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1782221951.522470:0:6503:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000565a9215) 00000020:00000080:2.0:1782221951.522503:0:6503:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1782221951.522591:0:6503:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f720c4e1 from MGS, refs=2 00080000:01000000:2.0:1782221951.522596:0:6503:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1782221951.522601:0:6503:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe2b7cc26e6810d3f 00000100:00100000:2.0:1782221951.522719:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1782221951.523003:0:6503:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1782221951.523011:0:6503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1782221951.523708:0:6503:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1782221951.523716:0:6503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1782221951.525207:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782221951.526682:0:6503:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1782221951.526691:0:6503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1782221951.527642:0:6503:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1782221951.527651:0:6503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1782221951.528192:0:6503:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1782221951.528199:0:6503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1782221951.529540:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782221951.529545:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782221951.529553:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782221951.529855:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782221951.529858:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782221951.529860:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782221951.530854:0:6503:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1782221951.532850:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1782221951.780948:0:6503:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2795 MB/s 00000001:01000000:0.0:1782221952.031290:0:6503:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3059 MB/s 00000001:01000000:3.0:1782221952.287897:0:6503:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 458 MB/s 00000001:01000000:2.0:1782221952.539892:0:6503:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 551 MB/s 00080000:10000000:3.0:1782221952.552598:0:6503:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:2.0:1782221952.554928:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0F:1782221952.577190:0:6503:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1782221952.582874:0:6518:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1782221952.582969:0:6503:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1782221952.583040:0:6503:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1782221952.583321:0:6503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1782221952.583345:0:6503:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1782221952.583738:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782221952.583927:0:6503:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1782221952.583934:0:6503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1782221952.584841:0:6503:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1782221952.584852:0:6503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1782221952.598871:0:6503:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1782221952.598902:0:6503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1782221952.601778:0:6503:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1782221952.601810:0:6503:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.203.127@tcp' 00000020:01000004:0.0:1782221952.601813:0:6503:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1782221952.601876:0:6503:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.203.127@tcp (typ=mgc) 00000020:00000080:0.0:1782221952.601907:0:6503:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.127@tcp (0000000013d72cc0) 00000020:00000080:0.0:1782221952.601929:0:6503:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1782221952.602086:0:6503:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000000602bae@MGC192.168.203.127@tcp: add connection 192.168.203.127@tcp at head 00010000:00010000:0.0:1782221952.602319:0:6503:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.127@tcp-0 is initialized 00000040:01000000:0.0:1782221952.602328:0:6503:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.127@tcp ctxt 1 is initialized 10000000:01000000:1.0:1782221952.605436:0:6523:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1782221952.605499:0:6503:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.127@tcp (uuid 12746f60-61b2-4e8e-97c6-1ec65f2f4df5) 00000020:00000080:1.0:1782221952.605530:0:6503:0:(genops.c:1406:class_connect()) connect: client 12746f60-61b2-4e8e-97c6-1ec65f2f4df5, cookie 0xe2b7cc26e6810d4d 00000100:00080000:1.0:1782221952.605547:0:6503:0:(import.c:512:import_select_connection()) MGC192.168.203.127@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782221952.605553:0:6503:0:(import.c:626:import_select_connection()) MGC192.168.203.127@tcp: import 0000000000602bae using connection 192.168.203.127@tcp/0@lo 00000100:00100000:1.0:1782221952.605626:0:6503:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000010847e61 x1868795081654400/t0(0) o250->MGC192.168.203.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782221952.605653:0:6503:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import 12746f60-61b2-4e8e-97c6-1ec65f2f4df5->MGS 00000020:01000004:1.0:1782221952.605675:0:6503:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1782221952.605680:0:6503:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1782221952.605704:0:6503:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000017b20b43) 00000020:00000080:1.0:1782221952.605719:0:6503:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:3.0:1782221952.606729:0:6522:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:3.0:1782221952.608954:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000010847e61 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3652:1868795081654400:0@lo:250: 00000100:00100000:3.0:1782221952.609097:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221952.609225:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081654400 00000100:00100000:3.0:1782221952.609264:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081654400 00000100:00100000:3.0:1782221952.609321:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782221952.609329:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dd9ab023 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3652:x1868795081654400:12345-0@lo:250: 00010000:00080000:3.0:1782221952.609361:0:6520:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 12746f60-61b2-4e8e-97c6-1ec65f2f4df5@0@lo t0 exp 0000000000000000 cur 151 last 0 00000020:00000080:3.0:1782221952.609396:0:6520:0:(genops.c:1406:class_connect()) connect: client 12746f60-61b2-4e8e-97c6-1ec65f2f4df5, cookie 0xe2b7cc26e6810d5b 00000100:00080000:3.0:1782221952.611793:0:6520:0:(import.c:65:import_set_state_nolock()) 000000007cb15888 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782221952.611958:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dd9ab023 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+5:3652:x1868795081654400:12345-0@lo:250: Request processed in 2624us (2857us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221952.611971:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782221952.612071:0:3652:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.203.127@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1782221952.612082:0:3652:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.203.127@tcp: connect to target with instance 0 00000100:00080000:3.0:1782221952.612093:0:3652:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.203.127@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1782221952.612099:0:3652:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1782221952.612103:0:3652:0:(import.c:65:import_set_state_nolock()) 0000000000602bae MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1782221952.612106:0:3652:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1782221952.612115:0:3652:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1782221952.612120:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000010847e61 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3652:1868795081654400:0@lo:250: 00000100:00100000:1.0:1782221952.637125:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782221952.637382:0:6503:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1782221952.637389:0:6503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1782221952.639619:0:6503:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1782221952.639636:0:6503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1782221952.643764:0:6503:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1782221952.643785:0:6503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1782221952.645411:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782221952.645643:0:6503:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1782221952.645651:0:6503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1782221952.649481:0:6503:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1782221952.649496:0:6503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1782221952.705736:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782221952.706009:0:6503:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1782221952.706017:0:6503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1782221952.708325:0:6503:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1782221952.708341:0:6503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1782221952.711833:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782221952.712051:0:6503:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1782221952.712059:0:6503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1782221952.712890:0:6503:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1782221952.712899:0:6503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1782221952.713962:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782221952.714177:0:6503:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1782221952.714188:0:6503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1782221952.715116:0:6503:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1782221952.715126:0:6503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1782221952.718635:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782221952.718945:0:6503:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1782221952.718952:0:6503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1782221952.721081:0:6503:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1782221952.721097:0:6503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1782221952.745928:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782221952.746610:0:6503:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1782221952.746622:0:6503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1782221952.748650:0:6503:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1782221952.748668:0:6503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1782221952.749712:0:6503:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1782221952.749725:0:6503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1782221952.751389:0:6503:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1782221952.751486:0:6503:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1782221952.751495:0:6503:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.127@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1782221952.751643:0:6503:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.127@tcp ctxt 0 is initialized 00000020:01000004:2.0:1782221952.751697:0:6503:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.127@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1782221952.751703:0:6503:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1782221952.751704:0:6503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782221952.751706:0:6503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782221952.751707:0:6503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782221952.751708:0:6503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782221952.751710:0:6503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782221952.751711:0:6503:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782221952.751712:0:6503:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782221952.751714:0:6503:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782221952.751715:0:6503:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782221952.751717:0:6503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782221952.751718:0:6503:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782221952.751721:0:6503:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1782221952.751723:0:6503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782221952.751725:0:6503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782221952.751726:0:6503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782221952.751732:0:6503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782221952.751732:0:6503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782221952.751733:0:6503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782221952.751734:0:6503:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782221952.751735:0:6503:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782221952.751736:0:6503:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782221952.751736:0:6503:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782221952.751737:0:6503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782221952.751738:0:6503:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782221952.751846:0:6503:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1782221952.751870:0:6503:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008bea9824 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6503:1868795081654528:0@lo:253: 00000100:00100000:2.0:1782221952.751960:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221952.752070:0:6503:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b1e3ef63 going to sleep for 11 seconds 00000100:00100000:0.0:1782221952.752144:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081654528 00000100:00100000:0.0:1782221952.752154:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081654528 00000100:00100000:0.0:1782221952.752267:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782221952.752276:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b623b820 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+5:6503:x1868795081654528:12345-0@lo:253: 20000000:01000000:0.0:1782221952.752340:0:6521:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1782221952.752344:0:6521:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1782221952.752783:0:6542:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1782221952.752900:0:6521:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1782221952.753258:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782221952.754180:0:6543:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1782221952.754586:0:6521:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1782221952.754592:0:6521:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1782221952.754599:0:6521:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1782221952.754602:0:6521:0:(mgs_llog.c:3603:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1782221952.754616:0:6521:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1782221952.754816:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782221952.754990:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1782221952.755006:0:6521:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1782221952.755025:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1782221952.755041:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1782221952.755056:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1782221952.755116:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1782221952.755125:0:6521:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1782221952.755140:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1782221952.755145:0:6521:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1782221952.755158:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1782221952.755163:0:6521:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1782221952.755176:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1782221952.755189:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1782221952.755213:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1782221952.755218:0:6521:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1782221952.755225:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782221952.755365:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1782221952.755375:0:6521:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1782221952.755390:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1782221952.755425:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1782221952.755603:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1782221952.755615:0:6521:0:(mgs_llog.c:3120:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1782221952.755644:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1782221952.755652:0:6521:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1782221952.755665:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1782221952.755679:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1782221952.755692:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1782221952.755701:0:6521:0:(mgs_llog.c:3085:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1782221952.755725:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1782221952.755733:0:6521:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1782221952.755746:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1782221952.755761:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1782221952.756995:0:6521:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1782221952.757030:0:6521:0:(mgs_llog.c:3300:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1782221952.757038:0:6521:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1782221952.757554:0:6544:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1782221952.757866:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1782221952.758049:0:6521:0:(mgs_llog.c:3346:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.127@tcp for mdt 20000000:01000000:2.0:1782221952.758052:0:6521:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.127@tcp (null) (null) (null) 00000040:00080000:2.0:1782221952.758072:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1782221952.758079:0:6521:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1782221952.758092:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1782221952.758098:0:6521:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.127@tcp (null) (null) 00000040:00080000:2.0:1782221952.758110:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1782221952.758118:0:6521:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1782221952.758132:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1782221952.758147:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1782221952.758177:0:6521:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1782221952.758180:0:6521:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1782221952.758184:0:6521:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1782221952.758413:0:6521:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1782221952.758416:0:6521:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1782221952.758895:0:6545:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1782221952.759074:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1782221952.759108:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1782221952.759123:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1782221952.759131:0:6521:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1782221952.759133:0:6521:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1782221952.759593:0:6546:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1782221952.759751:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1782221952.759844:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1782221952.759865:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:1.0:1782221952.759878:0:6521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782221952.759880:0:6521:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1782221952.759885:0:6521:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1782221952.759888:0:6521:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1782221952.759894:0:6521:0:(mgs_llog.c:5063:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1782221952.759901:0:6521:0:(mgs_llog.c:1376:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1782221952.760671:0:6547:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1782221952.760851:0:6521:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1782221952.769112:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1782221952.769157:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1782221952.769172:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1782221952.769195:0:6521:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1782221952.769220:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ac02baf9/0xe2b7cc26e6810d62 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.769272:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ac02baf9/0xe2b7cc26e6810d62 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.769284:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ac02baf9/0xe2b7cc26e6810d62 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.769291:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ac02baf9/0xe2b7cc26e6810d62 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.769297:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ac02baf9/0xe2b7cc26e6810d62 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.769303:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ac02baf9/0xe2b7cc26e6810d62 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.769310:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ac02baf9 already unused, calling callback (0000000068110196) 00010000:00010000:2.0:1782221952.769314:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ac02baf9/0xe2b7cc26e6810d62 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.769320:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ac02baf9/0xe2b7cc26e6810d62 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.769357:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ac02baf9/0xe2b7cc26e6810d62 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.769365:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ac02baf9/0xe2b7cc26e6810d62 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.769371:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ac02baf9/0xe2b7cc26e6810d62 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1782221952.769393:0:6521:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1782221952.779162:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b623b820 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+5:6503:x1868795081654528:12345-0@lo:253: Request processed in 26874us (27188us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221952.779189:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782221952.779605:0:6503:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008bea9824 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6503:1868795081654528:0@lo:253: 10000000:01000000:1.0:1782221952.779626:0:6503:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1782221952.779629:0:6503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782221952.779631:0:6503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782221952.779633:0:6503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782221952.779634:0:6503:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1782221952.779636:0:6503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782221952.779637:0:6503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782221952.779639:0:6503:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782221952.779640:0:6503:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782221952.779642:0:6503:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1782221952.779644:0:6503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782221952.779646:0:6503:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1782221952.779672:0:6503:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f720c4e1 from lustre-MDT0000 10000000:01000000:1.0:1782221952.779832:0:6503:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1782221952.779836:0:6503:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1782221952.779841:0:6503:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8f087805cd40 10000000:01000000:1.0:1782221952.779863:0:6503:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782221952.779944:0:6503:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8f087805cd40 from 1 10000000:01000000:1.0:1782221952.779949:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1782221952.779999:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: 00000000e33fbb01/0xe2b7cc26e6810d69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221952.780012:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: 00000000e33fbb01/0xe2b7cc26e6810d69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221952.780021:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: 00000000e33fbb01/0xe2b7cc26e6810d69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782221952.780043:0:6503:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000efe01f2a pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6503:1868795081654656:0@lo:101: 00000100:00100000:1.0:1782221952.780128:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221952.780223:0:6503:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e28a8c73 going to sleep for 11 seconds 00000100:00100000:3.0:1782221952.780590:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081654656 00000100:00100000:3.0:1782221952.780600:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081654656 00000100:00100000:3.0:1782221952.780695:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782221952.780705:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013603731 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+5:6503:x1868795081654656:12345-0@lo:101: 00010000:00010000:3.0:1782221952.780731:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782221952.780752:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000aa27068b/0xe2b7cc26e6810d70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6810d69 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221952.780792:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aa27068b/0xe2b7cc26e6810d70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6810d69 expref: 6 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221952.780803:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000aa27068b/0xe2b7cc26e6810d70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810d69 expref: 6 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221952.780813:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000aa27068b, rc 0) 00000100:00100000:1.0:1782221952.781028:0:6503:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000efe01f2a pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6503:1868795081654656:0@lo:101: 00010000:00010000:1.0:1782221952.781046:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: 00000000e33fbb01/0xe2b7cc26e6810d69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810d70 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221952.781055:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: 00000000e33fbb01/0xe2b7cc26e6810d69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6810d70 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782221952.781132:0:6503:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000efe01f2a pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6503:1868795081654784:0@lo:501: 00000100:00100000:1.0:1782221952.781166:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221952.781183:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013603731 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+6:6503:x1868795081654656:12345-0@lo:101: Request processed in 166us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221952.781191:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782221952.781810:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081654784 00000100:00100000:2.0:1782221952.781817:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081654784 00000100:00100000:2.0:1782221952.781844:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782221952.781851:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ce6e160 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+6:6503:x1868795081654784:12345-0@lo:501: 00000100:00100000:2.0:1782221952.782065:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ce6e160 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+6:6503:x1868795081654784:12345-0@lo:501: Request processed in 215us (899us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782221952.782073:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782221952.782110:0:6503:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e28a8c73 going to sleep for 11 seconds 00000100:00100000:2.0:1782221952.782127:0:6503:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000efe01f2a pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6503:1868795081654784:0@lo:501: 10000000:01000000:2.0:1782221952.782165:0:6503:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1782221952.782185:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: 00000000e33fbb01/0xe2b7cc26e6810d69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810d70 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.782194:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: 00000000e33fbb01/0xe2b7cc26e6810d69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810d70 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782221952.782220:0:6503:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f08490d0000 10000000:01000000:2.0:1782221952.782224:0:6503:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1782221952.782228:0:6503:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8f08490d0000 10000000:01000000:2.0:1782221952.782231:0:6503:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1782221952.782263:0:6503:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff8f08490d0000 from 1 10000000:01000000:2.0:1782221952.782265:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1782221952.782307:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: 00000000ac02baf9/0xe2b7cc26e6810d77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.782315:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: 00000000ac02baf9/0xe2b7cc26e6810d77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.782324:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: 00000000ac02baf9/0xe2b7cc26e6810d77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221952.782341:0:6503:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007e5f40f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6503:1868795081654912:0@lo:101: 00000100:00100000:2.0:1782221952.782373:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221952.782397:0:6503:0:(client.c:2701:ptlrpc_set_wait()) set 00000000cc0c531d going to sleep for 11 seconds 00000100:00100000:2.0:1782221952.782416:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081654912 00000100:00100000:2.0:1782221952.782421:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081654912 00000100:00100000:2.0:1782221952.782453:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782221952.782460:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a97efdd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+6:6503:x1868795081654912:12345-0@lo:101: 00010000:00010000:2.0:1782221952.782470:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782221952.782483:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a8251584/0xe2b7cc26e6810d7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6810d77 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.782499:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a8251584/0xe2b7cc26e6810d7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6810d77 expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.782520:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a8251584/0xe2b7cc26e6810d7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810d77 expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.782528:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a8251584, rc 0) 00000100:00100000:2.0:1782221952.782557:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a97efdd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+7:6503:x1868795081654912:12345-0@lo:101: Request processed in 98us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221952.782571:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782221952.782598:0:6503:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007e5f40f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6503:1868795081654912:0@lo:101: 00010000:00010000:2.0:1782221952.782609:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: 00000000ac02baf9/0xe2b7cc26e6810d77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810d7e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.782617:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: 00000000ac02baf9/0xe2b7cc26e6810d77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6810d7e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782221952.782628:0:6503:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1782221952.782631:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: 00000000ac02baf9/0xe2b7cc26e6810d77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810d7e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.782637:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: 00000000ac02baf9/0xe2b7cc26e6810d77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810d7e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782221952.782643:0:6503:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1782221952.782646:0:6503:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782221952.782650:0:6503:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8f08490d0000 10000000:01000000:2.0:1782221952.782652:0:6503:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1782221952.782655:0:6503:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1782221952.782657:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1782221952.782668:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: 000000005cb7f89c/0xe2b7cc26e6810d85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.782680:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: 000000005cb7f89c/0xe2b7cc26e6810d85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.782687:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: 000000005cb7f89c/0xe2b7cc26e6810d85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221952.782698:0:6503:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007e5f40f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6503:1868795081655040:0@lo:101: 00000100:00100000:2.0:1782221952.782948:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221952.782959:0:6503:0:(client.c:2701:ptlrpc_set_wait()) set 00000000cc0c531d going to sleep for 11 seconds 00000100:00100000:2.0:1782221952.782980:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081655040 00000100:00100000:2.0:1782221952.782984:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081655040 00000100:00100000:2.0:1782221952.783001:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782221952.783006:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d1584d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+7:6503:x1868795081655040:12345-0@lo:101: 00010000:00010000:2.0:1782221952.783014:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782221952.783020:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fb2c13c6/0xe2b7cc26e6810d8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6810d85 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.783034:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fb2c13c6/0xe2b7cc26e6810d8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6810d85 expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.783041:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fb2c13c6/0xe2b7cc26e6810d8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810d85 expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.783048:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fb2c13c6, rc 0) 00000100:00100000:2.0:1782221952.783074:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d1584d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+8:6503:x1868795081655040:12345-0@lo:101: Request processed in 68us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221952.783081:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782221952.783102:0:6503:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007e5f40f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6503:1868795081655040:0@lo:101: 00010000:00010000:2.0:1782221952.783121:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: 000000005cb7f89c/0xe2b7cc26e6810d85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810d8c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.783128:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: 000000005cb7f89c/0xe2b7cc26e6810d85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6810d8c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221952.783177:0:6503:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007e5f40f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6503:1868795081655168:0@lo:501: 00000100:00100000:2.0:1782221952.783202:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221952.783210:0:6503:0:(client.c:2701:ptlrpc_set_wait()) set 00000000cc0c531d going to sleep for 11 seconds 00000100:00100000:2.0:1782221952.783227:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081655168 00000100:00100000:2.0:1782221952.783230:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081655168 00000100:00100000:2.0:1782221952.783274:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782221952.783279:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fee2d621 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+8:6503:x1868795081655168:12345-0@lo:501: 00000100:00100000:2.0:1782221952.783384:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fee2d621 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+9:6503:x1868795081655168:12345-0@lo:501: Request processed in 105us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221952.783391:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782221952.783413:0:6503:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007e5f40f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6503:1868795081655168:0@lo:501: 00000100:00100000:2.0:1782221952.783659:0:6503:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007e5f40f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6503:1868795081655296:0@lo:503: 00000100:00100000:2.0:1782221952.783701:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221952.784642:0:6503:0:(client.c:2701:ptlrpc_set_wait()) set 00000000cc0c531d going to sleep for 11 seconds 00000100:00100000:2.0:1782221952.784687:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081655296 00000100:00100000:2.0:1782221952.784694:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081655296 00000100:00100000:0.0:1782221952.785016:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782221952.785028:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008216fe82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+9:6503:x1868795081655296:12345-0@lo:503: 00000100:00100000:0.0:1782221952.785190:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008216fe82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+9:6503:x1868795081655296:12345-0@lo:503: Request processed in 164us (1488us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221952.785197:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782221952.785307:0:6503:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007e5f40f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6503:1868795081655296:0@lo:503: 00000100:00100000:0.0:1782221952.786397:0:6548:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007918660f pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6548:1868795081655424:0@lo:502: 00000100:00100000:0.0:1782221952.786532:0:6548:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221952.786620:0:6548:0:(client.c:2701:ptlrpc_set_wait()) set 00000000df63134a going to sleep for 11 seconds 00000100:00100000:2.0:1782221952.786662:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081655424 00000100:00100000:2.0:1782221952.786670:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081655424 00000100:00100000:2.0:1782221952.786855:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782221952.786865:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007052abb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+9:6548:x1868795081655424:12345-0@lo:502: 00000100:00100000:2.0:1782221952.787076:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007052abb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+9:6548:x1868795081655424:12345-0@lo:502: Request processed in 213us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221952.787090:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782221952.787180:0:6548:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007918660f pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6548:1868795081655424:0@lo:502: 00000020:01000000:0.0:1782221952.787214:0:6548:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782221952.787228:0:6548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782221952.787271:0:6548:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1782221952.787277:0:6548:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1782221952.787280:0:6548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782221952.787297:0:6548:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000009380c267) 00000020:00000080:0.0:1782221952.787319:0:6548:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1782221952.787326:0:6548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1782221952.787446:0:6548:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:0.0:1782221952.787454:0:6548:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe2b7cc26e6810d9a 00000020:00000080:0.0:1782221952.787748:0:6548:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1782221952.787754:0:6548:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782221952.787758:0:6548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782221952.787759:0:6548:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1782221952.787761:0:6548:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782221952.787765:0:6548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782221952.787766:0:6548:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1782221952.787781:0:6548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782221952.787788:0:6548:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000c5443eee) 00000020:00000080:0.0:1782221952.787798:0:6548:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1782221952.787803:0:6548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1782221952.787804:0:6548:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1782221952.787807:0:6548:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1782221952.787813:0:6548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1782221952.787858:0:6548:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f720c4e1 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1782221952.787882:0:6548:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000082cd2f7f) 00000020:00000080:0.0:1782221952.787891:0:6548:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1782221952.787979:0:6548:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1782221952.787986:0:6548:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe2b7cc26e6810daf 00000020:00000080:0.0:1782221952.788079:0:6548:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1782221952.788085:0:6548:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1782221952.788091:0:6548:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xe2b7cc26e6810db6 00080000:01000000:0.0:1782221952.788096:0:6548:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:0.0:1782221952.788099:0:6548:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe2b7cc26e6810dbd 00080000:10000000:0.0:1782221952.788625:0:6548:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1782221952.788800:0:6548:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1782221952.794207:0:6548:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1782221952.870092:0:6548:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1782221952.870834:0:6548:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1782221952.875162:0:6548:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1782221952.876231:0:6548:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1782221952.879915:0:6548:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000b279a173) 00000020:00000080:2.0:1782221952.879945:0:6548:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1782221952.880038:0:6548:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1782221952.880046:0:6548:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe2b7cc26e6810dcb 00000020:00000080:2.0:1782221952.881077:0:6548:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1782221952.889104:0:6548:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:0.0:1782221952.898865:0:6548:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:2.0:1782221952.907519:0:6548:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:2.0:1782221952.911964:0:6548:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:2.0:1782221952.915093:0:6548:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:2.0:1782221952.918158:0:6548:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:0.0:1782221952.921371:0:6548:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xe2b7cc26e6810dd2 00000020:00000080:0.0:1782221952.922129:0:6548:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1782221952.922144:0:6548:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782221952.922152:0:6548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782221952.922154:0:6548:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1782221952.922158:0:6548:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782221952.922162:0:6548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782221952.922164:0:6548:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782221952.922167:0:6548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782221952.922169:0:6548:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1782221952.922172:0:6548:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782221952.922174:0:6548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782221952.922175:0:6548:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:0.0:1782221952.922178:0:6548:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782221952.922183:0:6548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782221952.922184:0:6548:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1782221952.922188:0:6548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1782221952.922308:0:6548:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1782221952.922381:0:6548:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007918660f pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6548:1868795081655552:0@lo:502: 00000100:00100000:0.0:1782221952.922497:0:6548:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221952.922675:0:6548:0:(client.c:2701:ptlrpc_set_wait()) set 00000000df63134a going to sleep for 11 seconds 00000100:00100000:1.0:1782221952.923004:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081655552 00000100:00100000:1.0:1782221952.923013:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081655552 00000100:00100000:1.0:1782221952.923107:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782221952.923118:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052b78980 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+9:6548:x1868795081655552:12345-0@lo:502: 00000100:00100000:1.0:1782221952.923360:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052b78980 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+9:6548:x1868795081655552:12345-0@lo:502: Request processed in 244us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221952.923376:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782221952.924420:0:6548:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007918660f pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6548:1868795081655552:0@lo:502: 00000020:01000000:0.0:1782221952.924664:0:6548:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782221952.924679:0:6548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782221952.924682:0:6548:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1782221952.924695:0:6548:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1782221952.925112:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1782221952.925142:0:6503:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1782221952.925204:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: 000000005cb7f89c/0xe2b7cc26e6810d85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810d8c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221952.925229:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: 000000005cb7f89c/0xe2b7cc26e6810d85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810d8c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782221952.925361:0:6503:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8f08490d0000 from 1 10000000:01000000:3.0:1782221952.925364:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1782221952.925424:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: 000000009b6b17ef/0xe2b7cc26e6810dd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221952.925496:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: 000000009b6b17ef/0xe2b7cc26e6810dd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221952.925507:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: 000000009b6b17ef/0xe2b7cc26e6810dd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782221952.925531:0:6503:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007b389963 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6503:1868795081655680:0@lo:101: 00000100:00100000:3.0:1782221952.925664:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221952.925867:0:6503:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f816acff going to sleep for 11 seconds 00000100:00100000:2.0:1782221952.926006:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081655680 00000100:00100000:2.0:1782221952.926016:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081655680 00000100:00100000:2.0:1782221952.926100:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782221952.926108:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3d36c96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+9:6503:x1868795081655680:12345-0@lo:101: 00010000:00010000:2.0:1782221952.926125:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782221952.926140:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bab18c58/0xe2b7cc26e6810de0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6810dd9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.926165:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bab18c58/0xe2b7cc26e6810de0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6810dd9 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.926175:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bab18c58/0xe2b7cc26e6810de0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810dd9 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.926184:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bab18c58, rc 0) 00000100:00100000:2.0:1782221952.926256:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3d36c96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+10:6503:x1868795081655680:12345-0@lo:101: Request processed in 126us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221952.926273:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782221952.926355:0:6503:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007b389963 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6503:1868795081655680:0@lo:101: 00010000:00010000:3.0:1782221952.926370:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: 000000009b6b17ef/0xe2b7cc26e6810dd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810de0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221952.926378:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: 000000009b6b17ef/0xe2b7cc26e6810dd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6810de0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782221952.927124:0:6503:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007b389963 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6503:1868795081655808:0@lo:256: 00000100:00100000:3.0:1782221952.927174:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221952.927904:0:6503:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f816acff going to sleep for 11 seconds 00000100:00100000:1.0:1782221952.928046:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081655808 00000100:00100000:1.0:1782221952.928055:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081655808 00000100:00100000:1.0:1782221952.928097:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782221952.928103:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc4b3d91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+10:6503:x1868795081655808:12345-0@lo:256: 20000000:01000000:1.0:1782221952.928128:0:6519:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1782221952.928135:0:6519:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1782221952.928255:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc4b3d91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+10:6503:x1868795081655808:12345-0@lo:256: Request processed in 151us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221952.928263:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782221952.928363:0:6503:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007b389963 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6503:1868795081655808:0@lo:256: 10000000:01000000:3.0:1782221952.929452:0:6503:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1782221952.929483:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: 000000009b6b17ef/0xe2b7cc26e6810dd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810de0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221952.929497:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: 000000009b6b17ef/0xe2b7cc26e6810dd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810de0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782221952.929507:0:6503:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f08490d0000 from 1 10000000:01000000:3.0:1782221952.929511:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782221952.929684:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: 00000000e860d6b9/0xe2b7cc26e6810de7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221952.929693:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: 00000000e860d6b9/0xe2b7cc26e6810de7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221952.929704:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: 00000000e860d6b9/0xe2b7cc26e6810de7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782221952.929737:0:6503:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007b389963 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6503:1868795081655936:0@lo:101: 00000100:00100000:3.0:1782221952.929807:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221952.929848:0:6503:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f816acff going to sleep for 11 seconds 00000100:00100000:2.0:1782221952.930082:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081655936 00000100:00100000:2.0:1782221952.930091:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081655936 00000100:00100000:2.0:1782221952.930137:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782221952.930145:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2961389 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+10:6503:x1868795081655936:12345-0@lo:101: 00010000:00010000:2.0:1782221952.930161:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782221952.930175:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000045e7c2e5/0xe2b7cc26e6810dee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6810de7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.930202:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000045e7c2e5/0xe2b7cc26e6810dee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6810de7 expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.930212:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000045e7c2e5/0xe2b7cc26e6810dee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810de7 expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.930222:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000045e7c2e5, rc 0) 00000100:00100000:2.0:1782221952.930288:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2961389 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+11:6503:x1868795081655936:12345-0@lo:101: Request processed in 143us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221952.930295:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782221952.930461:0:6503:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007b389963 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6503:1868795081655936:0@lo:101: 00010000:00010000:3.0:1782221952.930476:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: 00000000e860d6b9/0xe2b7cc26e6810de7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810dee expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221952.930484:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: 00000000e860d6b9/0xe2b7cc26e6810de7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6810dee expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782221952.930694:0:6503:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007b389963 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6503:1868795081656064:0@lo:501: 00000100:00100000:3.0:1782221952.930732:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221952.930762:0:6503:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f816acff going to sleep for 11 seconds 00000100:00100000:2.0:1782221952.930893:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081656064 00000100:00100000:2.0:1782221952.930899:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081656064 00000100:00100000:2.0:1782221952.930933:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782221952.930941:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000814ab6e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+11:6503:x1868795081656064:12345-0@lo:501: 00000100:00100000:2.0:1782221952.931122:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000814ab6e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+11:6503:x1868795081656064:12345-0@lo:501: Request processed in 183us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221952.931130:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782221952.931416:0:6503:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007b389963 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6503:1868795081656064:0@lo:501: 00000100:00100000:3.0:1782221952.931621:0:6503:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007b389963 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6503:1868795081656192:0@lo:503: 00000100:00100000:3.0:1782221952.931673:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221952.931707:0:6503:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f816acff going to sleep for 11 seconds 00000100:00100000:2.0:1782221952.931793:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081656192 00000100:00100000:2.0:1782221952.931798:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081656192 00000100:00100000:2.0:1782221952.931842:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782221952.931850:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ecfd424 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+11:6503:x1868795081656192:12345-0@lo:503: 00000040:00080000:2.0:1782221952.932037:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782221952.932075:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ecfd424 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+11:6503:x1868795081656192:12345-0@lo:503: Request processed in 225us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221952.932082:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782221952.932145:0:6503:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007b389963 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6503:1868795081656192:0@lo:503: 00000040:00080000:3.0:1782221952.933622:0:6552:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1782221952.933903:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1782221952.933927:0:6503:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782221952.934144:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: 00000000e860d6b9/0xe2b7cc26e6810de7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810dee expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.934157:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: 00000000e860d6b9/0xe2b7cc26e6810de7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810dee expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782221952.934268:0:6503:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1782221952.934271:0:6503:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f08490d0000 10000000:01000000:2.0:1782221952.934275:0:6503:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f08490d0000 10000000:01000000:2.0:1782221952.934280:0:6503:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782221952.934287:0:6503:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8f08490d0000 from 1 10000000:01000000:2.0:1782221952.934290:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782221952.934335:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: 0000000093e9daab/0xe2b7cc26e6810df5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.934343:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: 0000000093e9daab/0xe2b7cc26e6810df5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.934355:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: 0000000093e9daab/0xe2b7cc26e6810df5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221952.934393:0:6503:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001a5db6cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6503:1868795081656320:0@lo:101: 00000100:00100000:2.0:1782221952.934484:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221952.934530:0:6503:0:(client.c:2701:ptlrpc_set_wait()) set 000000007f49456c going to sleep for 11 seconds 00000100:00100000:3.0:1782221952.934831:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081656320 00000100:00100000:3.0:1782221952.934840:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081656320 00000100:00100000:3.0:1782221952.934958:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782221952.934968:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000aba0cc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+11:6503:x1868795081656320:12345-0@lo:101: 00010000:00010000:3.0:1782221952.934984:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782221952.934999:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d154b5bb/0xe2b7cc26e6810dfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6810df5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221952.935027:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d154b5bb/0xe2b7cc26e6810dfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6810df5 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221952.935037:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d154b5bb/0xe2b7cc26e6810dfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810df5 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221952.935047:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d154b5bb, rc 0) 00000100:00100000:3.0:1782221952.935097:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000aba0cc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+12:6503:x1868795081656320:12345-0@lo:101: Request processed in 131us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221952.935114:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782221952.935213:0:6503:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001a5db6cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6503:1868795081656320:0@lo:101: 00010000:00010000:2.0:1782221952.935231:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: 0000000093e9daab/0xe2b7cc26e6810df5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810dfc expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.935266:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: 0000000093e9daab/0xe2b7cc26e6810df5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6810dfc expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221952.935344:0:6503:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001a5db6cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6503:1868795081656448:0@lo:501: 00000100:00100000:2.0:1782221952.935373:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221952.935389:0:6503:0:(client.c:2701:ptlrpc_set_wait()) set 000000007f49456c going to sleep for 11 seconds 00000100:00100000:3.0:1782221952.935512:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081656448 00000100:00100000:3.0:1782221952.935516:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081656448 00000100:00100000:3.0:1782221952.935634:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782221952.935641:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064649b58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+12:6503:x1868795081656448:12345-0@lo:501: 00000100:00100000:3.0:1782221952.935893:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064649b58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+12:6503:x1868795081656448:12345-0@lo:501: Request processed in 252us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221952.935900:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782221952.936137:0:6503:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001a5db6cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6503:1868795081656448:0@lo:501: 00000100:00100000:2.0:1782221952.936170:0:6503:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001a5db6cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6503:1868795081656576:0@lo:503: 00000100:00100000:2.0:1782221952.936211:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221952.936295:0:6503:0:(client.c:2701:ptlrpc_set_wait()) set 000000007f49456c going to sleep for 11 seconds 00000100:00100000:3.0:1782221952.936343:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081656576 00000100:00100000:3.0:1782221952.936347:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081656576 00000100:00100000:3.0:1782221952.936371:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782221952.936377:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007979beb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+12:6503:x1868795081656576:12345-0@lo:503: 00000100:00100000:3.0:1782221952.936536:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007979beb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+12:6503:x1868795081656576:12345-0@lo:503: Request processed in 160us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221952.936607:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782221952.936674:0:6503:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001a5db6cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6503:1868795081656576:0@lo:503: 00000100:00100000:2.0:1782221952.937204:0:6553:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001a5db6cf pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6553:1868795081656704:0@lo:502: 00000100:00100000:2.0:1782221952.937273:0:6553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221952.937290:0:6553:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f79c4808 going to sleep for 11 seconds 00000100:00100000:3.0:1782221952.937349:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081656704 00000100:00100000:3.0:1782221952.937355:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081656704 00000100:00100000:3.0:1782221952.937381:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782221952.937388:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cabf7629 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+12:6553:x1868795081656704:12345-0@lo:502: 00000100:00100000:3.0:1782221952.937618:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cabf7629 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+12:6553:x1868795081656704:12345-0@lo:502: Request processed in 230us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221952.937625:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782221952.937952:0:6553:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001a5db6cf pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6553:1868795081656704:0@lo:502: 00000020:01000004:2.0:1782221952.938025:0:6553:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1782221952.938043:0:6553:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000001ccda752) 00000020:00000080:2.0:1782221952.938064:0:6553:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1782221952.938309:0:6553:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f720c4e1 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1782221952.938314:0:6553:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000f720c4e1 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1782221952.938321:0:6553:0:(obd_mount.c:701:lustre_put_lsi()) put 00000000f720c4e1 4 00010000:00080000:2.0:1782221952.938355:0:6553:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000cb1b8803@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.127@tcp at head 00010000:00010000:2.0:1782221952.944420:0:6553:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1782221952.944697:0:6553:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1782221952.944932:0:6553:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1782221952.944952:0:6553:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xe2b7cc26e6810e0a 00000100:00080000:2.0:1782221952.944965:0:6553:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782221952.944972:0:6553:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000cb1b8803 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:2.0:1782221952.945024:0:6553:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001a5db6cf x1868795081656832/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782221952.945064:0:6553:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1782221952.945175:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001a5db6cf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3652:1868795081656832:0@lo:38: 00000100:00100000:3.0:1782221952.945295:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221952.946857:0:6553:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000de9026f5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6553:1868795081656960:0@lo:502: 00000100:00100000:3.0:1782221952.947019:0:6553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221952.947076:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081656960 00000100:00100000:3.0:1782221952.947085:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081656960 00000100:00100000:3.0:1782221952.947143:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782221952.947153:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004edf070e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+12:6553:x1868795081656960:12345-0@lo:502: 00000100:00100000:3.0:1782221952.947311:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004edf070e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+12:6553:x1868795081656960:12345-0@lo:502: Request processed in 159us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221952.947319:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782221952.947368:0:6553:0:(client.c:2701:ptlrpc_set_wait()) set 00000000aee20f41 going to sleep for 11 seconds 00000100:00100000:3.0:1782221952.947394:0:6553:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000de9026f5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6553:1868795081656960:0@lo:502: 00000100:00100000:0.0:1782221952.948685:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081656832 00000100:00100000:0.0:1782221952.948700:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081656832 00000040:00080000:3.0:1782221952.948973:0:6553:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1782221952.949086:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1782221952.949110:0:6503:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782221952.949127:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: 0000000093e9daab/0xe2b7cc26e6810df5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810dfc expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221952.949140:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: 0000000093e9daab/0xe2b7cc26e6810df5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810dfc expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1782221952.949204:0:6503:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1782221952.949206:0:6503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782221952.949207:0:6503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782221952.949208:0:6503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782221952.949209:0:6503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782221952.949211:0:6503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782221952.949212:0:6503:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782221952.949213:0:6503:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782221952.949215:0:6503:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782221952.949216:0:6503:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782221952.949218:0:6503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782221952.949219:0:6503:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782221952.949223:0:6503:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1782221952.949226:0:6503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782221952.949249:0:6503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782221952.949250:0:6503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782221952.949251:0:6503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782221952.949252:0:6503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782221952.949253:0:6503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782221952.949253:0:6503:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782221952.949254:0:6503:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782221952.949255:0:6503:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782221952.949256:0:6503:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782221952.949257:0:6503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782221952.949258:0:6503:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782221952.949287:0:6503:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1782221952.949307:0:6503:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000de9026f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6503:1868795081657088:0@lo:253: 00000100:00100000:3.0:1782221952.949385:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221952.949517:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782221952.949527:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b389963 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3652:x1868795081656832:12345-0@lo:38: 00000100:00100000:0.0:1782221952.949676:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b389963 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3652:x1868795081656832:12345-0@lo:38: Request processed in 148us (4381us total) trans 0 rc -11/-11 00000100:00100000:0.0:1782221952.949684:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782221952.949859:0:3652:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782221952.949933:0:3652:0:(import.c:65:import_set_state_nolock()) 00000000cb1b8803 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782221952.949939:0:3652:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1782221952.949943:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001a5db6cf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3652:1868795081656832:0@lo:38: 00000100:00100000:0.0:1782221952.950094:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081657088 00000100:00100000:0.0:1782221952.950100:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081657088 00000100:00100000:0.0:1782221952.950140:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782221952.950147:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030b50ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+12:6503:x1868795081657088:12345-0@lo:253: 20000000:01000000:0.0:1782221952.950180:0:6520:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1782221952.950196:0:6520:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1782221952.951643:0:6503:0:(client.c:2701:ptlrpc_set_wait()) set 0000000016c636d5 going to sleep for 11 seconds 20000000:01000000:0.0:1782221952.958752:0:6520:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1782221952.958948:0:6520:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1782221952.959342:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030b50ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+12:6503:x1868795081657088:12345-0@lo:253: Request processed in 9190us (9952us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221952.959357:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 20000000:01000000:2.0:1782221952.959448:0:6542:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1782221952.959455:0:6542:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1782221952.959478:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f0fdb0a2/0xe2b7cc26e6810e11 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.959496:0:6542:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000bab18c58/0xe2b7cc26e6810de0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810dd9 expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.959505:0:6542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000f0fdb0a2/0xe2b7cc26e6810e11 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.959632:0:6542:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000bab18c58/0xe2b7cc26e6810de0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e6810dd9 expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.959651:0:6542:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000bab18c58/0xe2b7cc26e6810de0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e6810dd9 expref: 11 pid: 6521 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221952.959665:0:6542:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005925ebed pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6542:1868795081657216:0@lo:104: 00000100:00100000:2.0:1782221952.959935:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221952.960014:0:6542:0:(client.c:2701:ptlrpc_set_wait()) set 000000001fa562f2 going to sleep for 11 seconds 00000100:00100000:0.0:1782221952.960184:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081657216 00000100:00100000:0.0:1782221952.960193:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081657216 00000100:00100000:0.0:1782221952.960281:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782221952.960291:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0809099 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+3:6542:x1868795081657216:12345-0@lo:104: 00010000:00010000:0.0:1782221952.960305:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: 000000009b6b17ef/0xe2b7cc26e6810dd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810de0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221952.960375:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782221952.960381:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0809099 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+3:6542:x1868795081657216:12345-0@lo:104: Request processed in 92us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221952.960388:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1782221952.960538:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782221952.960609:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: 000000009b6b17ef/0xe2b7cc26e6810dd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810de0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.960618:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009b6b17ef already unused, calling callback (00000000a10b8087) 10000000:00010000:2.0:1782221952.960621:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: 000000009b6b17ef/0xe2b7cc26e6810dd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e6810de0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.960629:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: 000000009b6b17ef/0xe2b7cc26e6810dd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e6810de0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782221952.960635:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: 000000009b6b17ef/0xe2b7cc26e6810dd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e6810de0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782221952.960640:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1782221952.960846:0:6503:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000de9026f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6503:1868795081657088:0@lo:253: 10000000:01000000:3.0:1782221952.960862:0:6503:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1782221952.960865:0:6503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782221952.960867:0:6503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00010000:00010000:2.0:1782221952.961017:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: 000000009b6b17ef/0xe2b7cc26e6810dd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810de0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.961025:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782221952.961059:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: 000000009b6b17ef/0xe2b7cc26e6810dd9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810de0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.961066:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: 000000009b6b17ef/0xe2b7cc26e6810dd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810de0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.961084:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782221952.961085:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782221952.961087:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782221952.961109:0:6542:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005925ebed pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6542:1868795081657216:0@lo:104: 00010000:00010000:2.0:1782221952.961130:0:6542:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000f0fdb0a2/0xe2b7cc26e6810e11 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1782221952.961179:0:6503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782221952.961181:0:6503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782221952.961182:0:6503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782221952.961184:0:6503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782221952.961185:0:6503:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782221952.961187:0:6503:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782221952.961188:0:6503:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782221952.961190:0:6503:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782221952.961192:0:6503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782221952.961193:0:6503:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1782221952.961211:0:6503:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1782221952.966900:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001e760f13 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3654:1868795081657344:0@lo:103: 00000100:00100000:0.0:1782221952.966994:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221952.969959:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081657344 00000100:00100000:2.0:1782221952.969980:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081657344 00010000:00010000:2.0:1782221952.970028:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000bab18c58/0xe2b7cc26e6810de0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810dd9 expref: 12 pid: 6521 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221952.970082:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782221952.970092:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071ef9b51 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+12:3654:x1868795081657344:12345-0@lo:103: 00010000:00010000:2.0:1782221952.970109:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782221952.970114:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000bab18c58/0xe2b7cc26e6810de0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810dd9 expref: 12 pid: 6521 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.970127:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000bab18c58/0xe2b7cc26e6810de0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e6810dd9 expref: 12 pid: 6521 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.970147:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bab18c58/0xe2b7cc26e6810de0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e6810dd9 expref: 12 pid: 6521 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.970167:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000f0fdb0a2/0xe2b7cc26e6810e11 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.970175:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f0fdb0a2/0xe2b7cc26e6810e11 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1782221952.970195:0:6511:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010741737s 00010000:00010000:2.0:1782221952.970200:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f0fdb0a2/0xe2b7cc26e6810e11 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.970206:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f0fdb0a2/0xe2b7cc26e6810e11 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.970257:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f0fdb0a2/0xe2b7cc26e6810e11 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.970264:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f0fdb0a2/0xe2b7cc26e6810e11 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.970270:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f0fdb0a2 already unused, calling callback (0000000068110196) 00010000:00010000:2.0:1782221952.970273:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f0fdb0a2/0xe2b7cc26e6810e11 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.970282:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f0fdb0a2/0xe2b7cc26e6810e11 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.970298:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f0fdb0a2/0xe2b7cc26e6810e11 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.970312:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782221952.970399:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071ef9b51 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+11:3654:x1868795081657344:12345-0@lo:103: Request processed in 309us (3405us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221952.970408:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00080000:10000000:3.0:1782221952.973378:0:6503:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:3.0:1782221952.973578:0:6503:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1782221952.973816:0:6503:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:3.0:1782221952.973985:0:6503:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1782221952.974154:0:6503:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:3.0:1782221952.974357:0:6503:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:0.0:1782221952.975058:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001e760f13 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3654:1868795081657344:0@lo:103: 00010000:00010000:2.0:1782221952.975417:0:6542:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000f0fdb0a2/0xe2b7cc26e6810e11 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.975491:0:6542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f0fdb0a2/0xe2b7cc26e6810e11 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221952.975497:0:6542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f0fdb0a2/0xe2b7cc26e6810e11 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1782221952.980968:0:6503:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1782221952.981394:0:6503:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1782221952.983321:0:6503:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1782221952.983683:0:6503:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1782221952.985152:0:6503:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:3.0:1782221952.985362:0:6503:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:1.0:1782221952.995371:0:6503:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1782221953.017337:0:6503:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1782221953.017477:0:6558:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1782221953.017482:0:6558:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1782221953.017747:0:6559:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1782221953.021226:0:6503:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1782221953.021653:0:6503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1782221953.022935:0:6503:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1782221953.022951:0:6503:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1782221953.024650:0:6503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782221953.025905:0:6559:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782221953.027733:0:6503:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1782221953.028397:0:6503:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1782221953.028447:0:6503:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1782221953.032897:0:6503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1782221953.033266:0:6503:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:2.0:1782221953.034048:0:6503:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1782221953.034215:0:6503:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1782221953.034424:0:6503:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1782221953.034572:0:6503:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1782221953.034714:0:6503:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1782221953.034902:0:6503:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00000040:00080000:3.0:1782221953.035017:0:6559:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00100000:10000000:2.0:1782221953.035072:0:6503:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00000004:00080000:3.0:1782221953.035125:0:6559:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1782221953.035131:0:6559:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:2.0:1782221953.035223:0:6503:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1782221953.035401:0:6503:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1782221953.041105:0:6503:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1782221953.043384:0:6503:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1782221953.044064:0:6503:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1782221953.044330:0:6503:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1782221953.044549:0:6503:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1782221953.045086:0:6503:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1782221953.045425:0:6503:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1782221953.046223:0:6503:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1782221953.047177:0:6503:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1782221953.047420:0:6503:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1782221953.047646:0:6503:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1782221953.048220:0:6503:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1782221953.048578:0:6503:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1782221953.048854:0:6503:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1782221953.049231:0:6503:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1782221953.049645:0:6503:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1782221953.050194:0:6503:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1782221953.050667:0:6503:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1782221953.051139:0:6503:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1782221953.051371:0:6503:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1782221953.052514:0:6503:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1782221953.052683:0:6503:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1782221953.053109:0:6503:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1782221953.053615:0:6503:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1782221953.060669:0:6503:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1782221953.060734:0:6503:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa0b981c53988 00100000:10000000:3.0:1782221953.060745:0:6503:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1782221953.064853:0:6503:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1782221953.064878:0:6503:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.127@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1782221953.064904:0:6503:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1782221953.064934:0:6503:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1782221953.065894:0:6503:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782221953.066096:0:6503:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1782221953.582720:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782221954.606189:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782221955.626377:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782221956.652366:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782221957.675692:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782221958.123476:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1782221958.123491:0:491:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1782221958.123494:0:491:0:(import.c:65:import_set_state_nolock()) 00000000cb1b8803 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782221958.123511:0:491:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000cb1b8803 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:3.0:1782221958.123547:0:491:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d93fbbd2 x1868795081657600/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782221958.123776:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782221958.123794:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000de9026f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081657472:0@lo:400: 00000100:00100000:0.0:1782221958.123954:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221958.124075:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d93fbbd2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3652:1868795081657600:0@lo:38: 00000100:00100000:0.0:1782221958.124107:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221958.124307:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081657472 00000100:00100000:3.0:1782221958.124317:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081657472 00000100:00100000:3.0:1782221958.124519:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782221958.124552:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000462283aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+11:3656:x1868795081657472:12345-0@lo:400: 00000100:00100000:0.0:1782221958.124881:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000de9026f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081657472:0@lo:400: 00000100:00100000:2.0:1782221958.125119:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081657600 00000100:00100000:2.0:1782221958.125124:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081657600 00000100:00100000:2.0:1782221958.125152:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782221958.125172:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1c931f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3652:x1868795081657600:12345-0@lo:38: 00010000:00080000:2.0:1782221958.125196:0:6528:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 157 last 0 00000020:00000080:2.0:1782221958.125274:0:6528:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xe2b7cc26e6810e18 00000004:00100000:2.0:1782221958.125336:0:6528:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1782221958.125486:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000462283aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+11:3656:x1868795081657472:12345-0@lo:400: Request processed in 111us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221958.125513:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1782221958.125964:0:6528:0:(import.c:65:import_set_state_nolock()) 000000006684c369 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782221958.126054:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1c931f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1868795081657600:12345-0@lo:38: Request processed in 881us (1946us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221958.127517:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1782221958.127849:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d93fbbd2 x1868795081657600/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782221968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782221958.127878:0:3652:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1782221958.127900:0:3652:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1782221958.127907:0:3652:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1782221958.127911:0:3652:0:(import.c:65:import_set_state_nolock()) 00000000cb1b8803 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1782221958.127919:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d93fbbd2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3652:1868795081657600:0@lo:38: 00000001:02000400:1.0:1782221958.315973:0:6804:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1782221958.701613:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1782221959.369660:0:6856:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782221959.369884:0:6856:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1782221959.722434:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782221960.746520:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782221961.770802:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1782221962.517692:0:6958:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782221962.517944:0:6958:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1782221962.730308:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1782221962.730315:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8f08490d0000 from 3 10000000:01000000:1.0:1782221962.730320:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782221962.730372:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: 00000000e07525c3/0xe2b7cc26e6810e1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221962.730386:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: 00000000e07525c3/0xe2b7cc26e6810e1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221962.730396:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: 00000000e07525c3/0xe2b7cc26e6810e1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782221962.730425:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006248a213 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081657728:0@lo:101: 00000100:00100000:1.0:1782221962.730500:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221962.730550:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ed26b39b going to sleep for 11 seconds 00000100:00100000:2.0:1782221962.730996:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081657728 00000100:00100000:2.0:1782221962.731005:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081657728 00000100:00100000:2.0:1782221962.731054:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782221962.731062:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d560891 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+11:6523:x1868795081657728:12345-0@lo:101: 00010000:00010000:2.0:1782221962.731075:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782221962.731090:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bab18c58/0xe2b7cc26e6810e26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6810e1f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221962.734025:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bab18c58/0xe2b7cc26e6810e26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6810e1f expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221962.734043:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bab18c58/0xe2b7cc26e6810e26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810e1f expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221962.734069:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bab18c58, rc 0) 00000100:00100000:2.0:1782221962.734197:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d560891 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+12:6523:x1868795081657728:12345-0@lo:101: Request processed in 3135us (3705us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221962.734206:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782221962.737048:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006248a213 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081657728:0@lo:101: 00010000:00010000:1.0:1782221962.737080:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: 00000000e07525c3/0xe2b7cc26e6810e1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810e26 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221962.737092:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: 00000000e07525c3/0xe2b7cc26e6810e1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6810e26 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782221962.742642:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000aa9b010f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081657856:0@lo:256: 00000100:00100000:0.0:1782221962.742718:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221962.742780:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set 0000000048cd23b6 going to sleep for 11 seconds 00000100:00100000:3.0:1782221962.742950:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081657856 00000100:00100000:3.0:1782221962.742958:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081657856 00000100:00100000:3.0:1782221962.743001:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782221962.743008:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ee88022 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+12:6523:x1868795081657856:12345-0@lo:256: 20000000:01000000:3.0:1782221962.743028:0:6521:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1782221962.743042:0:6521:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1782221962.743046:0:6521:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1782221962.743132:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ee88022 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+12:6523:x1868795081657856:12345-0@lo:256: Request processed in 123us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221962.743140:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782221962.743222:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000aa9b010f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081657856:0@lo:256: 10000000:01000000:1.0:1782221962.743301:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782221962.743310:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: 00000000e07525c3/0xe2b7cc26e6810e1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810e26 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221962.743320:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: 00000000e07525c3/0xe2b7cc26e6810e1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810e26 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221962.794420:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782221963.246483:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000014e0b2db pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081658112:0@lo:400: 00000100:00100000:2.0:1782221963.248374:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782221963.248404:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000533cc840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081657984:0@lo:400: 00000100:00100000:2.0:1782221963.248504:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221963.248581:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081657984 00000100:00100000:2.0:1782221963.248588:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081657984 00000100:00100000:2.0:1782221963.248651:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782221963.248660:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d29b10c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+12:3655:x1868795081657984:12345-0@lo:400: 00000100:00100000:2.0:1782221963.248728:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d29b10c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+12:3655:x1868795081657984:12345-0@lo:400: Request processed in 69us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221963.248736:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782221963.248780:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000533cc840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081657984:0@lo:400: 00000100:00100000:0.0:1782221963.249111:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221963.249219:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081658112 00000100:00100000:1.0:1782221963.249224:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081658112 00000100:00100000:1.0:1782221963.249274:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782221963.249280:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031e28227 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081658112:12345-0@lo:400: 00000100:00100000:1.0:1782221963.249324:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031e28227 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081658112:12345-0@lo:400: Request processed in 44us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221963.249331:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1782221963.249364:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000014e0b2db x1868795081658112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782221979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782221963.249377:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000014e0b2db pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081658112:0@lo:400: 00010000:00010000:2.0:1782221963.818363:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782221964.844120:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782221965.874615:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782221966.890408:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782221967.914489:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782221968.367533:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005925ebed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3654:1868795081658240:0@lo:400: 00000100:00100000:2.0:1782221968.368287:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221968.368467:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cf9dd50d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1868795081658368:0@lo:400: 00000100:00100000:2.0:1782221968.368509:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221968.368547:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081658240 00000100:00100000:2.0:1782221968.368555:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081658240 00000100:00100000:2.0:1782221968.369461:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782221968.369475:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000213f59d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+12:3654:x1868795081658240:12345-0@lo:400: 00000100:00100000:2.0:1782221968.369543:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000213f59d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+12:3654:x1868795081658240:12345-0@lo:400: Request processed in 72us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221968.369550:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782221968.370301:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081658368 00000100:00100000:1.0:1782221968.370309:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081658368 00000100:00100000:2.0:1782221968.370416:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005925ebed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3654:1868795081658240:0@lo:400: 00000100:00100000:1.0:1782221968.370537:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782221968.370545:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ed6704c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1868795081658368:12345-0@lo:400: 00010000:00080000:2.0:1782221968.371392:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000cf9dd50d x1868795081658368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782221984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782221968.371406:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cf9dd50d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1868795081658368:0@lo:400: 00000100:00100000:1.0:1782221968.371508:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ed6704c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1868795081658368:12345-0@lo:400: Request processed in 964us (2998us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221968.371517:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1782221968.942873:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782221969.965036:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782221970.988189:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1782221971.760702:0:7456:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1782221971.760706:0:7456:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1782221971.760707:0:7456:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1782221971.761004:0:7456:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000e79623b3 00000020:01000004:1.0:1782221971.761019:0:7456:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:1.0:1782221971.761031:0:7456:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1782221971.761044:0:7456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000009298738d) 00000020:00000080:1.0:1782221971.761058:0:7456:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1782221971.827302:0:7456:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:2.0:1782221971.827896:0:7456:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:2.0:1782221971.854779:0:7456:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1782221971.855523:0:7456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1782221971.855537:0:7456:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1782221971.855553:0:7456:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe2b7cc26e6810e34 00000020:01000004:2.0:1782221971.855561:0:7456:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1782221971.856177:0:7456:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.127@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1782221971.856182:0:7456:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1782221971.856190:0:7456:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1782221971.856231:0:7456:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1782221971.856271:0:7456:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.127@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1782221971.885136:0:7456:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.127@tcp ctxt 0 is initialized 00000020:01000004:3.0:1782221971.885174:0:7456:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.127@tcp, index=0001, flags=0x20061 00000020:01000004:3.0:1782221971.885179:0:7456:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1782221971.885181:0:7456:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1782221971.885182:0:7456:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782221971.885183:0:7456:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782221971.885184:0:7456:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782221971.885185:0:7456:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782221971.885187:0:7456:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782221971.885188:0:7456:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782221971.885189:0:7456:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782221971.885191:0:7456:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782221971.885192:0:7456:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782221971.885195:0:7456:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:3.0:1782221971.885197:0:7456:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782221971.885199:0:7456:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1782221971.885200:0:7456:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782221971.885206:0:7456:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782221971.885206:0:7456:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782221971.885208:0:7456:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782221971.885208:0:7456:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782221971.885209:0:7456:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782221971.885210:0:7456:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782221971.885211:0:7456:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782221971.885211:0:7456:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782221971.885264:0:7456:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1782221971.885283:0:7456:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000031155de6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081658496:0@lo:253: 00000100:00100000:3.0:1782221971.885439:0:7456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221971.885520:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081658496 00000100:00100000:2.0:1782221971.885536:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081658496 00000100:00100000:3.0:1782221971.885574:0:7456:0:(client.c:2701:ptlrpc_set_wait()) set 000000003f1b5e8d going to sleep for 11 seconds 00000100:00100000:2.0:1782221971.885946:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782221971.885960:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ddc966ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+12:7456:x1868795081658496:12345-0@lo:253: 20000000:01000000:2.0:1782221971.886207:0:6521:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1782221971.886212:0:6521:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:2.0:1782221971.886223:0:6521:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:2.0:1782221971.886226:0:6521:0:(mgs_llog.c:3603:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:2.0:1782221971.886304:0:6521:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:2.0:1782221971.886717:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782221971.887684:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1782221971.887708:0:6521:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1782221971.887794:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1782221971.887832:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1782221971.887927:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1782221971.888155:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:2.0:1782221971.888166:0:6521:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:2.0:1782221971.888181:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:2.0:1782221971.888186:0:6521:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:2.0:1782221971.888197:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:2.0:1782221971.888202:0:6521:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:2.0:1782221971.888215:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1782221971.888231:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1782221971.888468:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:2.0:1782221971.888681:0:6521:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.127@tcp (null) (null) (null) 00000040:00080000:2.0:1782221971.888703:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:2.0:1782221971.888710:0:6521:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1782221971.888792:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:2.0:1782221971.888803:0:6521:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.127@tcp (null) (null) 00000040:00080000:2.0:1782221971.888822:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:2.0:1782221971.888829:0:6521:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1782221971.888918:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1782221971.888941:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1782221971.888953:0:6521:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1782221971.889061:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:2.0:1782221971.889072:0:6521:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:2.0:1782221971.889206:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1782221971.889281:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1782221971.889306:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:2.0:1782221971.889313:0:6521:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:2.0:1782221971.889328:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1782221971.889349:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1782221971.889354:0:6521:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:2.0:1782221971.889457:0:6521:0:(mgs_llog.c:3300:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1782221971.889465:0:6521:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:2.0:1782221971.891661:0:7462:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1782221971.892229:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1782221971.892647:0:6521:0:(mgs_llog.c:3346:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.127@tcp for mdt 20000000:01000000:3.0:1782221971.892651:0:6521:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.127@tcp (null) (null) (null) 00000040:00080000:3.0:1782221971.892676:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1782221971.892683:0:6521:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1782221971.892697:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1782221971.892703:0:6521:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.127@tcp (null) (null) 00000040:00080000:3.0:1782221971.892720:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1782221971.892791:0:6521:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:3.0:1782221971.892810:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:3.0:1782221971.892826:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:3.0:1782221971.892990:0:6521:0:(mgs_llog.c:3426:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:3.0:1782221971.893002:0:6521:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:1.0:1782221971.893990:0:7463:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:3.0:1782221971.894349:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1782221971.894456:0:6521:0:(mgs_llog.c:3484:mgs_write_log_osp_to_mdt()) add nid 192.168.203.127@tcp for mdt 20000000:01000000:3.0:1782221971.894458:0:6521:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.127@tcp (null) (null) (null) 00000040:00080000:3.0:1782221971.894537:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1782221971.894546:0:6521:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1782221971.894563:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1782221971.894568:0:6521:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.127@tcp (null) (null) 00000040:00080000:3.0:1782221971.894649:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1782221971.894670:0:6521:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:3.0:1782221971.894686:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1782221971.894702:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:3.0:1782221971.894797:0:6521:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1782221971.894802:0:6521:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1782221971.894807:0:6521:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1782221971.894899:0:6521:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1782221971.894901:0:6521:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1782221971.895663:0:7464:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1782221971.895693:0:7464:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1782221971.895705:0:7464:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1782221971.895964:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:3.0:1782221971.895983:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:3.0:1782221971.895995:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:3.0:1782221971.896002:0:6521:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1782221971.896004:0:6521:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1782221971.896524:0:7465:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1782221971.896546:0:7465:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1782221971.896562:0:7465:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:3.0:1782221971.896853:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1782221971.896873:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1782221971.896888:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:3.0:1782221971.896896:0:6521:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1782221971.896898:0:6521:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1782221971.897569:0:7466:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1782221971.897664:0:7466:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1782221971.897681:0:7466:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1782221971.897916:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1782221971.897937:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1782221971.897961:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1782221971.897973:0:6521:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1782221971.897976:0:6521:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1782221971.897982:0:6521:0:(mgs_llog.c:5063:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1782221971.897990:0:6521:0:(mgs_llog.c:1376:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1782221971.898634:0:7467:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:3.0:1782221971.898810:0:6521:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:3.0:1782221971.918616:0:6521:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1782221971.919035:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000214ff3b0/0xe2b7cc26e6810e3b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221971.919060:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000aa27068b/0xe2b7cc26e6810d70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810d69 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221971.919068:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000fb2c13c6/0xe2b7cc26e6810d8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810d85 expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221971.919143:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d154b5bb/0xe2b7cc26e6810dfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810df5 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221971.919153:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000214ff3b0/0xe2b7cc26e6810e3b lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221971.919208:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d154b5bb/0xe2b7cc26e6810dfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e6810df5 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221971.919226:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d154b5bb/0xe2b7cc26e6810dfc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e6810df5 expref: 12 pid: 6519 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221971.919289:0:6521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cf9dd50d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6521:1868795081658624:0@lo:104: 00000100:00100000:2.0:1782221971.919840:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782221971.920313:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000fb2c13c6/0xe2b7cc26e6810d8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e6810d85 expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221971.920327:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000fb2c13c6/0xe2b7cc26e6810d8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e6810d85 expref: 12 pid: 6521 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221971.920342:0:6521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001f998192 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6521:1868795081658752:0@lo:104: 00000100:00100000:2.0:1782221971.920505:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782221971.920539:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000aa27068b/0xe2b7cc26e6810d70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e6810d69 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221971.920548:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000aa27068b/0xe2b7cc26e6810d70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e6810d69 expref: 12 pid: 6519 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221971.920557:0:6521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000f084405f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6521:1868795081658880:0@lo:104: 00000100:00100000:2.0:1782221971.920577:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221971.920587:0:6521:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ac1b6ad6 going to sleep for 11 seconds 00000100:00100000:0.0:1782221971.920596:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081658624 00000100:00100000:0.0:1782221971.920605:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081658624 00000100:00100000:0.0:1782221971.920651:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081658752 00000100:00100000:0.0:1782221971.920655:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081658752 00000100:00100000:3.0:1782221971.920658:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081658880 00000100:00100000:3.0:1782221971.920662:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081658880 00000100:00100000:0.0:1782221971.920670:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782221971.920677:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005925ebed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+5:6521:x1868795081658624:12345-0@lo:104: 00010000:00010000:0.0:1782221971.920692:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: 0000000093e9daab/0xe2b7cc26e6810df5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810dfc expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221971.920765:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782221971.920771:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005925ebed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+5:6521:x1868795081658624:12345-0@lo:104: Request processed in 95us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221971.920779:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782221971.920797:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782221971.920802:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f161520f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+4:6521:x1868795081658752:12345-0@lo:104: 00010000:00010000:0.0:1782221971.920809:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: 000000005cb7f89c/0xe2b7cc26e6810d85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810d8c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.920827:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782221971.920844:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782221971.920848:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f161520f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+4:6521:x1868795081658752:12345-0@lo:104: Request processed in 47us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221971.920855:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1782221971.920861:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: 0000000093e9daab/0xe2b7cc26e6810df5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810dfc expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782221971.920866:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1782221971.920868:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000093e9daab already unused, calling callback (00000000a10b8087) 00000100:00100000:0.0:1782221971.920871:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b378d785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+3:6521:x1868795081658880:12345-0@lo:104: 10000000:00010000:3.0:1782221971.920872:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: 0000000093e9daab/0xe2b7cc26e6810df5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e6810dfc expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221971.920877:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: 00000000e33fbb01/0xe2b7cc26e6810d69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810d70 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.920880:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: 0000000093e9daab/0xe2b7cc26e6810df5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e6810dfc expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782221971.920887:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: 0000000093e9daab/0xe2b7cc26e6810df5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e6810dfc expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782221971.920893:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782221971.920914:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1782221971.920918:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b378d785 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+3:6521:x1868795081658880:12345-0@lo:104: Request processed in 48us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221971.920925:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1782221971.920926:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: 0000000093e9daab/0xe2b7cc26e6810df5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810dfc expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.920932:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782221971.920942:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782221971.920949:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: 0000000093e9daab/0xe2b7cc26e6810df5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810dfc expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.920968:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: 0000000093e9daab/0xe2b7cc26e6810df5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810dfc expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.920982:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782221971.920984:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: 00000000e33fbb01/0xe2b7cc26e6810d69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810d70 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.920990:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e33fbb01 already unused, calling callback (00000000a10b8087) 10000000:00010000:3.0:1782221971.920992:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: 00000000e33fbb01/0xe2b7cc26e6810d69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e6810d70 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.921007:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: 00000000e33fbb01/0xe2b7cc26e6810d69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e6810d70 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782221971.921012:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: 00000000e33fbb01/0xe2b7cc26e6810d69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e6810d70 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782221971.921016:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782221971.921029:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: 00000000e33fbb01/0xe2b7cc26e6810d69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810d70 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.921035:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782221971.921045:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: 00000000e33fbb01/0xe2b7cc26e6810d69 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810d70 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.921050:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: 00000000e33fbb01/0xe2b7cc26e6810d69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810d70 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.921061:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782221971.921062:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782221971.921063:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782221971.921295:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782221971.921297:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782221971.921299:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782221971.921309:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000037860dac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081659008:0@lo:103: 00000100:00100000:2.0:1782221971.921345:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221971.921393:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081659008 00000100:00100000:3.0:1782221971.921398:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081659008 00000100:00100000:2.0:1782221971.921403:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000067ff2ead pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081659136:0@lo:103: 00000100:00100000:2.0:1782221971.921435:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782221971.921438:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d154b5bb/0xe2b7cc26e6810dfc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810df5 expref: 13 pid: 6519 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782221971.921459:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081659136 00000100:00100000:3.0:1782221971.921462:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081659136 00010000:00010000:3.0:1782221971.921479:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000aa27068b/0xe2b7cc26e6810d70 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810d69 expref: 14 pid: 6519 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782221971.921493:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782221971.921495:0:6521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cf9dd50d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6521:1868795081658624:0@lo:104: 00000100:00100000:3.0:1782221971.921498:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e221935 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+14:3656:x1868795081659008:12345-0@lo:103: 00000100:00100000:2.0:1782221971.921505:0:6521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001f998192 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6521:1868795081658752:0@lo:104: 00010000:00010000:3.0:1782221971.921509:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1782221971.921512:0:6521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000f084405f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6521:1868795081658880:0@lo:104: 00010000:00010000:3.0:1782221971.921514:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d154b5bb/0xe2b7cc26e6810dfc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810df5 expref: 14 pid: 6519 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.921522:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d154b5bb/0xe2b7cc26e6810dfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e6810df5 expref: 14 pid: 6519 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.921537:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d154b5bb/0xe2b7cc26e6810dfc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e6810df5 expref: 14 pid: 6519 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221971.921573:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: 000000005cb7f89c/0xe2b7cc26e6810d85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810d8c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221971.921581:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005cb7f89c already unused, calling callback (00000000a10b8087) 10000000:00010000:0.0:1782221971.921584:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: 000000005cb7f89c/0xe2b7cc26e6810d85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e6810d8c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221971.921590:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: 000000005cb7f89c/0xe2b7cc26e6810d85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e6810d8c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782221971.921596:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: 000000005cb7f89c/0xe2b7cc26e6810d85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e6810d8c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782221971.921602:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782221971.921618:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: 000000005cb7f89c/0xe2b7cc26e6810d85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810d8c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221971.921624:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782221971.921637:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: 000000005cb7f89c/0xe2b7cc26e6810d85 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810d8c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221971.921642:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: 000000005cb7f89c/0xe2b7cc26e6810d85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810d8c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221971.921668:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782221971.921670:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782221971.921671:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782221971.921679:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c22bd882 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3654:1868795081659264:0@lo:103: 00000100:00100000:0.0:1782221971.921707:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782221971.922349:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000214ff3b0/0xe2b7cc26e6810e3b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.922626:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:01000000:1.0:1782221971.922671:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782221971.922676:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8f08490d0000 from 21 10000000:01000000:1.0:1782221971.922680:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000100:00100000:3.0:1782221971.922702:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e221935 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+13:3656:x1868795081659008:12345-0@lo:103: Request processed in 1202us (1355us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221971.922712:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1782221971.922717:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: 000000001d66af27/0xe2b7cc26e6810e42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782221971.922735:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081659264 00000100:00100000:3.0:1782221971.922740:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081659264 00010000:00010000:3.0:1782221971.922757:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000fb2c13c6/0xe2b7cc26e6810d8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810d85 expref: 13 pid: 6521 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782221971.922774:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782221971.922781:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000870692c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+13:3653:x1868795081659136:12345-0@lo:103: 00010000:00010000:3.0:1782221971.922793:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782221971.922797:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000aa27068b/0xe2b7cc26e6810d70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810d69 expref: 13 pid: 6519 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.922814:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000aa27068b/0xe2b7cc26e6810d70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e6810d69 expref: 13 pid: 6519 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221971.922826:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000037860dac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081659008:0@lo:103: 00010000:00010000:3.0:1782221971.922828:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000aa27068b/0xe2b7cc26e6810d70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e6810d69 expref: 13 pid: 6519 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.922839:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782221971.922873:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000870692c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+12:3653:x1868795081659136:12345-0@lo:103: Request processed in 93us (1437us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221971.922880:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782221971.922894:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782221971.922899:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003e85176 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+11:3654:x1868795081659264:12345-0@lo:103: 00010000:00010000:3.0:1782221971.922906:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782221971.922909:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000fb2c13c6/0xe2b7cc26e6810d8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810d85 expref: 11 pid: 6521 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.922919:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000fb2c13c6/0xe2b7cc26e6810d8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e6810d85 expref: 11 pid: 6521 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.922928:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fb2c13c6/0xe2b7cc26e6810d8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e6810d85 expref: 11 pid: 6521 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.922938:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000214ff3b0/0xe2b7cc26e6810e3b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.922945:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000214ff3b0/0xe2b7cc26e6810e3b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.922960:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000214ff3b0/0xe2b7cc26e6810e3b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.922973:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000214ff3b0/0xe2b7cc26e6810e3b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.922979:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000214ff3b0/0xe2b7cc26e6810e3b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.922985:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000214ff3b0/0xe2b7cc26e6810e3b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.922991:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000214ff3b0 already unused, calling callback (0000000068110196) 00010000:00010000:3.0:1782221971.922994:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000214ff3b0/0xe2b7cc26e6810e3b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.923002:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000214ff3b0/0xe2b7cc26e6810e3b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.923017:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000214ff3b0/0xe2b7cc26e6810e3b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.923028:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782221971.923047:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000067ff2ead pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081659136:0@lo:103: 00000100:00100000:3.0:1782221971.923056:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003e85176 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+10:3654:x1868795081659264:12345-0@lo:103: Request processed in 158us (1349us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221971.923062:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782221971.923072:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c22bd882 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3654:1868795081659264:0@lo:103: 00010000:00010000:1.0:1782221971.923151:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: 000000001d66af27/0xe2b7cc26e6810e42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221971.923172:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: 000000001d66af27/0xe2b7cc26e6810e42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221971.923173:0:6521:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000214ff3b0/0xe2b7cc26e6810e3b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221971.923180:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000214ff3b0/0xe2b7cc26e6810e3b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221971.923185:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000214ff3b0/0xe2b7cc26e6810e3b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782221971.923191:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006248a213 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081659392:0@lo:101: 20000000:01000000:2.0:1782221971.923204:0:6521:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1782221971.923260:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221971.923288:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b841f560 going to sleep for 11 seconds 00000100:00100000:3.0:1782221971.923505:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081659392 00000100:00100000:3.0:1782221971.923510:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081659392 00000100:00100000:3.0:1782221971.923541:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782221971.923547:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004cd28558 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+10:6523:x1868795081659392:12345-0@lo:101: 00010000:00010000:3.0:1782221971.923562:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782221971.923661:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000086ea1d2d/0xe2b7cc26e6810e49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6810e42 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.923691:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000086ea1d2d/0xe2b7cc26e6810e49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6810e42 expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.923701:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000086ea1d2d/0xe2b7cc26e6810e49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810e42 expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.923710:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000086ea1d2d, rc 0) 00000100:00100000:3.0:1782221971.923782:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004cd28558 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+11:6523:x1868795081659392:12345-0@lo:101: Request processed in 236us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221971.923789:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782221971.923868:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006248a213 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081659392:0@lo:101: 00010000:00010000:1.0:1782221971.923882:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: 000000001d66af27/0xe2b7cc26e6810e42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810e49 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221971.923889:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: 000000001d66af27/0xe2b7cc26e6810e42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6810e49 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782221971.923959:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006248a213 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081659520:0@lo:501: 00000100:00100000:1.0:1782221971.923990:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221971.924047:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b841f560 going to sleep for 11 seconds 00000100:00100000:3.0:1782221971.924077:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081659520 00000100:00100000:3.0:1782221971.924081:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081659520 00000100:00100000:3.0:1782221971.924100:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782221971.924105:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba84e29d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+11:6523:x1868795081659520:12345-0@lo:501: 00000100:00100000:3.0:1782221971.924327:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba84e29d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+11:6523:x1868795081659520:12345-0@lo:501: Request processed in 221us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221971.924335:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782221971.924562:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006248a213 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081659520:0@lo:501: 00000100:00100000:1.0:1782221971.924596:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006248a213 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081659648:0@lo:503: 00000100:00100000:1.0:1782221971.924644:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221971.924792:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b841f560 going to sleep for 11 seconds 00000100:00100000:2.0:1782221971.925035:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081659648 00000100:00100000:2.0:1782221971.925040:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081659648 00000100:00100000:2.0:1782221971.925070:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782221971.925091:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044a857f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+11:6523:x1868795081659648:12345-0@lo:503: 00000100:00100000:2.0:1782221971.925216:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044a857f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+11:6523:x1868795081659648:12345-0@lo:503: Request processed in 129us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221971.925225:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782221971.925272:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006248a213 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081659648:0@lo:503: 00000100:00100000:1.0:1782221971.926851:0:7469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006248a213 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7469:1868795081659776:0@lo:502: 00000100:00100000:1.0:1782221971.926946:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221971.927020:0:7469:0:(client.c:2701:ptlrpc_set_wait()) set 00000000601a6b2f going to sleep for 11 seconds 00000100:00100000:2.0:1782221971.927048:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081659776 00000100:00100000:2.0:1782221971.927057:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081659776 00000100:00100000:2.0:1782221971.927122:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782221971.927131:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5fa4895 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+11:7469:x1868795081659776:12345-0@lo:502: 00000100:00100000:2.0:1782221971.927298:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5fa4895 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+11:7469:x1868795081659776:12345-0@lo:502: Request processed in 168us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221971.927306:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782221971.927364:0:7469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006248a213 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7469:1868795081659776:0@lo:502: 00000100:00100000:1.0:1782221971.927513:0:7469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006248a213 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7469:1868795081659904:0@lo:502: 00000100:00100000:1.0:1782221971.927550:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221971.927581:0:7469:0:(client.c:2701:ptlrpc_set_wait()) set 00000000601a6b2f going to sleep for 11 seconds 00000100:00100000:2.0:1782221971.927681:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081659904 00000100:00100000:2.0:1782221971.927685:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081659904 00000100:00100000:2.0:1782221971.927730:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782221971.927736:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cbc1363b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+11:7469:x1868795081659904:12345-0@lo:502: 00000100:00100000:2.0:1782221971.928894:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cbc1363b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+11:7469:x1868795081659904:12345-0@lo:502: Request processed in 1150us (1336us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221971.928908:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782221971.929022:0:7469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006248a213 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7469:1868795081659904:0@lo:502: 00000100:00100000:0.0:1782221971.929050:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ddc966ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+10:7456:x1868795081658496:12345-0@lo:253: Request processed in 43092us (43614us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221971.929057:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000040:00080000:1.0:1782221971.929063:0:7469:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000100:00100000:3.0:1782221971.929232:0:7456:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000031155de6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081658496:0@lo:253: 10000000:01000000:3.0:1782221971.929259:0:7456:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1782221971.929262:0:7456:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782221971.929265:0:7456:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1782221971.929266:0:7456:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782221971.929267:0:7456:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:3.0:1782221971.929268:0:7456:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782221971.929269:0:7456:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782221971.929270:0:7456:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782221971.929272:0:7456:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1782221971.929275:0:7456:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782221971.929276:0:7456:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1782221971.929306:0:7456:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000e79623b3 from lustre-MDT0001 10000000:01000000:3.0:1782221971.929344:0:7456:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1782221971.929347:0:7456:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1782221971.929494:0:7456:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f087805cd40 local copy 10000000:01000000:0.0:1782221971.929500:0:7456:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1782221971.929544:0:7456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: 000000006ac4118f/0xe2b7cc26e6810e50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221971.929557:0:7456:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.127@tcp lock: 000000006ac4118f/0xe2b7cc26e6810e50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221971.929565:0:7456:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: 000000006ac4118f/0xe2b7cc26e6810e50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782221971.929588:0:7456:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c22bd882 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081660032:0@lo:101: 00000100:00100000:0.0:1782221971.929636:0:7456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1782221971.929676:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 00000100:00100000:0.0:1782221971.929680:0:7456:0:(client.c:2701:ptlrpc_set_wait()) set 000000001cd38c19 going to sleep for 11 seconds 10000000:01000000:2.0:1782221971.929709:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782221971.929719:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: 000000001d66af27/0xe2b7cc26e6810e42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810e49 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782221971.929774:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081660032 00000100:00100000:3.0:1782221971.929781:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081660032 00010000:00010000:2.0:1782221971.929797:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: 000000001d66af27/0xe2b7cc26e6810e42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810e49 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782221971.929808:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1782221971.929810:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1782221971.929812:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1782221971.929827:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: 00000000f0fdb0a2/0xe2b7cc26e6810e57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221971.929835:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: 00000000f0fdb0a2/0xe2b7cc26e6810e57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782221971.929859:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782221971.929869:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018ac4e9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+10:7456:x1868795081660032:12345-0@lo:101: 00010000:00010000:3.0:1782221971.929884:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782221971.929901:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000aa27068b/0xe2b7cc26e6810e5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6810e50 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.929932:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aa27068b/0xe2b7cc26e6810e5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6810e50 expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.929944:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000aa27068b/0xe2b7cc26e6810e5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810e50 expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.929954:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000aa27068b, rc 0) 00000100:00100000:3.0:1782221971.929995:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018ac4e9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+11:7456:x1868795081660032:12345-0@lo:101: Request processed in 129us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221971.930003:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1782221971.930031:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: 00000000f0fdb0a2/0xe2b7cc26e6810e57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221971.930046:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000f084405f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081660160:0@lo:101: 00000100:00100000:0.0:1782221971.930060:0:7456:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c22bd882 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081660032:0@lo:101: 00010000:00010000:0.0:1782221971.930075:0:7456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: 000000006ac4118f/0xe2b7cc26e6810e50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0xe2b7cc26e6810e5e expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221971.930092:0:7456:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: 000000006ac4118f/0xe2b7cc26e6810e50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0xe2b7cc26e6810e5e expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782221971.930197:0:7456:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c22bd882 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081660288:0@lo:501: 00000100:00100000:0.0:1782221971.930223:0:7456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221971.930278:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221971.930363:0:7456:0:(client.c:2701:ptlrpc_set_wait()) set 000000001cd38c19 going to sleep for 11 seconds 00000100:00100000:1.0:1782221971.930616:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081660288 00000100:00100000:1.0:1782221971.930621:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081660288 00000100:00100000:1.0:1782221971.930645:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081660160 00000100:00100000:2.0:1782221971.930646:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b1c647ed going to sleep for 11 seconds 00000100:00100000:1.0:1782221971.930648:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081660160 00000100:00100000:1.0:1782221971.930661:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782221971.930667:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ccc34a17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+12:7456:x1868795081660288:12345-0@lo:501: 00000100:00100000:1.0:1782221971.930757:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ccc34a17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+12:7456:x1868795081660288:12345-0@lo:501: Request processed in 89us (534us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782221971.930764:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782221971.930789:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782221971.930795:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089ac9df3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+11:6523:x1868795081660160:12345-0@lo:101: 00010000:00010000:1.0:1782221971.930801:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782221971.930813:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e33fbb01/0xe2b7cc26e6810e65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6810e57 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221971.930819:0:7456:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c22bd882 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081660288:0@lo:501: 00010000:00010000:1.0:1782221971.930828:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e33fbb01/0xe2b7cc26e6810e65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6810e57 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221971.930836:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e33fbb01/0xe2b7cc26e6810e65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810e57 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782221971.930843:0:7456:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 00010000:00010000:1.0:1782221971.930843:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e33fbb01, rc 0) 10000000:01000000:2.0:1782221971.930876:0:7456:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1782221971.930882:0:7456:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: 000000006ac4118f/0xe2b7cc26e6810e50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0xe2b7cc26e6810e5e expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221971.930889:0:7456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: 000000006ac4118f/0xe2b7cc26e6810e50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000400000000 nid: local remote: 0xe2b7cc26e6810e5e expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221971.930894:0:7456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.127@tcp lock: 000000006ac4118f/0xe2b7cc26e6810e50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000400000000 nid: local remote: 0xe2b7cc26e6810e5e expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221971.930923:0:7456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1782221971.930950:0:7456:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f0849b46800 10000000:01000000:2.0:1782221971.930955:0:7456:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1782221971.930969:0:7456:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8f087805cd40 10000000:01000000:2.0:1782221971.930972:0:7456:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1782221971.930974:0:7456:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8f087805cd40 from 1 10000000:01000000:2.0:1782221971.930977:0:7456:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782221971.930994:0:7456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: 00000000214ff3b0/0xe2b7cc26e6810e6c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221971.931001:0:7456:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: 00000000214ff3b0/0xe2b7cc26e6810e6c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221971.931007:0:7456:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: 00000000214ff3b0/0xe2b7cc26e6810e6c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221971.931021:0:7456:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001f998192 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081660416:0@lo:101: 00000100:00100000:2.0:1782221971.931048:0:7456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221971.931062:0:7456:0:(client.c:2701:ptlrpc_set_wait()) set 00000000eb6d0dd9 going to sleep for 11 seconds 00000100:00100000:1.0:1782221971.931119:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089ac9df3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+12:6523:x1868795081660160:12345-0@lo:101: Request processed in 324us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221971.931126:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782221971.931145:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081660416 00000100:00100000:1.0:1782221971.931148:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081660416 00000100:00100000:1.0:1782221971.931163:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782221971.931168:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd68dce7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+12:7456:x1868795081660416:12345-0@lo:101: 00010000:00010000:1.0:1782221971.931175:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782221971.931184:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007a6000f9/0xe2b7cc26e6810e73 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6810e6c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221971.931195:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007a6000f9/0xe2b7cc26e6810e73 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6810e6c expref: 13 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221971.931202:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007a6000f9/0xe2b7cc26e6810e73 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810e6c expref: 13 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221971.931208:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007a6000f9, rc 0) 00000100:00100000:1.0:1782221971.931260:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd68dce7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+13:7456:x1868795081660416:12345-0@lo:101: Request processed in 91us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221971.931266:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782221971.931297:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000f084405f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081660160:0@lo:101: 00010000:00010000:1.0:1782221971.931309:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: 00000000f0fdb0a2/0xe2b7cc26e6810e57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810e65 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221971.931335:0:7456:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001f998192 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081660416:0@lo:101: 00010000:00010000:2.0:1782221971.931344:0:7456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: 00000000214ff3b0/0xe2b7cc26e6810e6c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810e73 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221971.931351:0:7456:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: 00000000214ff3b0/0xe2b7cc26e6810e6c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6810e73 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782221971.931378:0:7456:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782221971.931382:0:7456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: 00000000214ff3b0/0xe2b7cc26e6810e6c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810e73 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221971.931390:0:7456:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: 00000000214ff3b0/0xe2b7cc26e6810e6c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810e73 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221971.931391:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: 00000000f0fdb0a2/0xe2b7cc26e6810e57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6810e65 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782221971.931398:0:7456:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8f0849b46800 10000000:01000000:2.0:1782221971.931402:0:7456:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1782221971.931405:0:7456:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff8f0849b46800 from 1 10000000:01000000:2.0:1782221971.931407:0:7456:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1782221971.931432:0:7456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: 00000000fb2c13c6/0xe2b7cc26e6810e7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221971.931438:0:7456:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: 00000000fb2c13c6/0xe2b7cc26e6810e7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221971.931444:0:7456:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: 00000000fb2c13c6/0xe2b7cc26e6810e7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221971.931455:0:7456:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001f998192 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081660544:0@lo:101: 00000100:00100000:1.0:1782221971.931537:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006248a213 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081660672:0@lo:501: 00000100:00100000:1.0:1782221971.931571:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221971.931593:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set 00000000fd09ac05 going to sleep for 11 seconds 00000100:00100000:1.0:1782221971.931607:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081660672 00000100:00100000:1.0:1782221971.931611:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081660672 00000100:00100000:1.0:1782221971.931628:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782221971.931633:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000202b390f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+13:6523:x1868795081660672:12345-0@lo:501: 00000100:00100000:2.0:1782221971.931663:0:7456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221971.931678:0:7456:0:(client.c:2701:ptlrpc_set_wait()) set 00000000eb6d0dd9 going to sleep for 11 seconds 00000100:00100000:1.0:1782221971.931749:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000202b390f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+13:6523:x1868795081660672:12345-0@lo:501: Request processed in 116us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221971.931756:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782221971.931772:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081660544 00000100:00100000:1.0:1782221971.931775:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081660544 00000100:00100000:1.0:1782221971.931788:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782221971.931793:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3586415 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+13:7456:x1868795081660544:12345-0@lo:101: 00010000:00010000:1.0:1782221971.931799:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782221971.931807:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000564a2757/0xe2b7cc26e6810e81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6810e7a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221971.931818:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000564a2757/0xe2b7cc26e6810e81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6810e7a expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221971.931820:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006248a213 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081660672:0@lo:501: 00010000:00010000:1.0:1782221971.931826:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000564a2757/0xe2b7cc26e6810e81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810e7a expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221971.931832:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000564a2757, rc 0) 00000100:00100000:2.0:1782221971.931848:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cf9dd50d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081660800:0@lo:503: 00000100:00100000:1.0:1782221971.931857:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3586415 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+14:7456:x1868795081660544:12345-0@lo:101: Request processed in 64us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221971.931863:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782221971.931896:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221971.931914:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set 00000000fc64b39d going to sleep for 11 seconds 00000100:00100000:1.0:1782221971.931927:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081660800 00000100:00100000:2.0:1782221971.931933:0:7456:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001f998192 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081660544:0@lo:101: 00000100:00100000:1.0:1782221971.931935:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081660800 00010000:00010000:2.0:1782221971.931941:0:7456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: 00000000fb2c13c6/0xe2b7cc26e6810e7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810e81 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221971.931948:0:7456:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: 00000000fb2c13c6/0xe2b7cc26e6810e7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6810e81 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782221971.931951:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1782221971.931955:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000062575df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+14:6523:x1868795081660800:12345-0@lo:503: 10000000:01000000:2.0:1782221971.931972:0:7456:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1782221971.931976:0:7456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: 00000000fb2c13c6/0xe2b7cc26e6810e7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810e81 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221971.931983:0:7456:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: 00000000fb2c13c6/0xe2b7cc26e6810e7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810e81 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782221971.931988:0:7456:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1782221971.931991:0:7456:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782221971.931996:0:7456:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8f0849b46800 10000000:01000000:2.0:1782221971.931998:0:7456:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1782221971.932000:0:7456:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1782221971.932002:0:7456:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1782221971.932013:0:7456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: 0000000093e9daab/0xe2b7cc26e6810e88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221971.932019:0:7456:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: 0000000093e9daab/0xe2b7cc26e6810e88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782221971.932031:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000062575df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+14:6523:x1868795081660800:12345-0@lo:503: Request processed in 76us (136us total) trans 0 rc 0/0 00010000:00010000:2.0:1782221971.932032:0:7456:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: 0000000093e9daab/0xe2b7cc26e6810e88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782221971.932038:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782221971.932043:0:7456:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001f998192 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081660928:0@lo:101: 00000100:00100000:2.0:1782221971.932067:0:7456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221971.932072:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cf9dd50d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081660800:0@lo:503: 00000100:00100000:1.0:1782221971.932214:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081660928 00000100:00100000:1.0:1782221971.932218:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081660928 00000100:00100000:1.0:1782221971.932257:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782221971.932264:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef7185a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+14:7456:x1868795081660928:12345-0@lo:101: 00000100:00100000:2.0:1782221971.932267:0:7456:0:(client.c:2701:ptlrpc_set_wait()) set 00000000eb6d0dd9 going to sleep for 11 seconds 00010000:00010000:1.0:1782221971.932270:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782221971.932277:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009fe7895e/0xe2b7cc26e6810e8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6810e88 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221971.932290:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009fe7895e/0xe2b7cc26e6810e8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6810e88 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221971.932297:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009fe7895e/0xe2b7cc26e6810e8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810e88 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221971.932303:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009fe7895e, rc 0) 00010000:00010000:3.0:1782221971.932482:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782221971.932489:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: 000000006ac4118f/0xe2b7cc26e6810e50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x400000000 nid: local remote: 0xe2b7cc26e6810e5e expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.932498:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006ac4118f already unused, calling callback (00000000a10b8087) 10000000:00010000:3.0:1782221971.932501:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: 000000006ac4118f/0xe2b7cc26e6810e50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x400000000 nid: local remote: 0xe2b7cc26e6810e5e expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.932510:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: 000000006ac4118f/0xe2b7cc26e6810e50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x8400000000 nid: local remote: 0xe2b7cc26e6810e5e expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782221971.932524:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: 000000006ac4118f/0xe2b7cc26e6810e50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x9400000000 nid: local remote: 0xe2b7cc26e6810e5e expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782221971.932531:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782221971.932554:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: 000000006ac4118f/0xe2b7cc26e6810e50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x4809400000020 nid: local remote: 0xe2b7cc26e6810e5e expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.932560:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782221971.932585:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: 000000006ac4118f/0xe2b7cc26e6810e50 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x4809400000020 nid: local remote: 0xe2b7cc26e6810e5e expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.932592:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: 000000006ac4118f/0xe2b7cc26e6810e50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x4809400000020 nid: local remote: 0xe2b7cc26e6810e5e expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.932606:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782221971.932608:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782221971.932609:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782221971.932718:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef7185a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:7456:x1868795081660928:12345-0@lo:101: Request processed in 455us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221971.932725:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782221971.932833:0:7470:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ab3f0ff9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7470:1868795081661184:0@lo:502: 00000100:00100000:1.0:1782221971.932870:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221971.932891:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081661184 00000100:00100000:1.0:1782221971.932900:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081661184 00000100:00100000:1.0:1782221971.932924:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782221971.932930:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000931b514d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:7470:x1868795081661184:12345-0@lo:502: 00000100:00100000:1.0:1782221971.933018:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000931b514d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:7470:x1868795081661184:12345-0@lo:502: Request processed in 88us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221971.933026:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782221971.933053:0:7470:0:(client.c:2701:ptlrpc_set_wait()) set 000000006e2bc92c going to sleep for 11 seconds 00000100:00100000:1.0:1782221971.933066:0:7470:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ab3f0ff9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7470:1868795081661184:0@lo:502: 00000020:01000000:1.0:1782221971.933093:0:7470:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782221971.933106:0:7470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782221971.933109:0:7470:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1782221971.933115:0:7470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1782221971.933119:0:7470:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.127@tcp to nid 0x20000c0a8cb7f (192.168.203.127@tcp) 00000020:00000080:1.0:1782221971.933147:0:7470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782221971.933166:0:7470:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000008c271be4) 00000020:00000080:1.0:1782221971.933187:0:7470:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1782221971.933193:0:7470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:2.0:1782221971.933340:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000031155de6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081661056:0@lo:103: 00000004:00080000:1.0:1782221971.933351:0:7470:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1782221971.933357:0:7470:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1782221971.933364:0:7470:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe2b7cc26e6810e9d 00000100:00100000:2.0:1782221971.933383:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1782221971.933398:0:7470:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ae5dbaf6@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.127@tcp at head 00000100:00100000:2.0:1782221971.933438:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081661056 00000100:00100000:2.0:1782221971.933442:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081661056 00000100:00100000:2.0:1782221971.933476:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782221971.933481:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029847213 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:3655:x1868795081661056:12345-0@lo:103: 00010000:00010000:2.0:1782221971.933493:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782221971.933509:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000aa27068b/0xe2b7cc26e6810e5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2b7cc26e6810e50 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221971.933521:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782221971.933548:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029847213 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+14:3655:x1868795081661056:12345-0@lo:103: Request processed in 67us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221971.933554:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782221971.933717:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000031155de6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081661056:0@lo:103: 00000100:00100000:3.0:1782221971.934496:0:7456:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001f998192 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081660928:0@lo:101: 00010000:00010000:3.0:1782221971.934521:0:7456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: 0000000093e9daab/0xe2b7cc26e6810e88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810e8f expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221971.934533:0:7456:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: 0000000093e9daab/0xe2b7cc26e6810e88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6810e8f expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221971.935054:0:7456:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005a73f709 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081661312:0@lo:501: 00000100:00100000:2.0:1782221971.935509:0:7456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221971.935615:0:7456:0:(client.c:2701:ptlrpc_set_wait()) set 000000002e30040f going to sleep for 11 seconds 00000100:00100000:0.0:1782221971.935790:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081661312 00000100:00100000:0.0:1782221971.935798:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081661312 00000100:00100000:0.0:1782221971.936147:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1782221971.936159:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c4642a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+14:7456:x1868795081661312:12345-0@lo:501: 00000100:00100000:0.0:1782221971.936592:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c4642a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+14:7456:x1868795081661312:12345-0@lo:501: Request processed in 434us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221971.936601:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1782221971.937036:0:7456:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005a73f709 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081661312:0@lo:501: 00000100:00100000:2.0:1782221971.937193:0:7456:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005a73f709 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081661440:0@lo:503: 00000100:00100000:2.0:1782221971.937285:0:7456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221971.937320:0:7456:0:(client.c:2701:ptlrpc_set_wait()) set 000000002e30040f going to sleep for 11 seconds 00000100:00100000:3.0:1782221971.937397:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081661440 00000100:00100000:3.0:1782221971.937404:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081661440 00000100:00100000:3.0:1782221971.937461:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782221971.937469:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a60de06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+14:7456:x1868795081661440:12345-0@lo:503: 00000100:00100000:3.0:1782221971.937714:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a60de06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+14:7456:x1868795081661440:12345-0@lo:503: Request processed in 245us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221971.937721:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782221971.938488:0:7456:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005a73f709 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081661440:0@lo:503: 00000040:00080000:2.0:1782221971.941491:0:7456:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782221971.942152:0:7456:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005a73f709 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081661568:0@lo:502: 00000100:00100000:2.0:1782221971.942330:0:7456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221971.942823:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081661568 00000100:00100000:0.0:1782221971.942834:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081661568 00000100:00100000:0.0:1782221971.943838:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782221971.944073:0:7456:0:(client.c:2701:ptlrpc_set_wait()) set 000000002e30040f going to sleep for 11 seconds 00000100:00100000:0.0:1782221971.944149:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000055adea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+14:7456:x1868795081661568:12345-0@lo:502: 00000100:00100000:0.0:1782221971.944472:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000055adea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+14:7456:x1868795081661568:12345-0@lo:502: Request processed in 614us (2142us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221971.944481:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:3.0:1782221971.945657:0:7470:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-2 is initialized 00000100:00100000:2.0:1782221971.946417:0:7456:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005a73f709 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081661568:0@lo:502: 00000040:00080000:2.0:1782221971.947491:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1782221971.947541:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:2.0:1782221971.947555:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:2.0:1782221971.947567:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:2.0:1782221971.950027:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:2.0:1782221971.950413:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:2.0:1782221971.950452:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:2.0:1782221971.950470:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:2.0:1782221971.950493:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:2.0:1782221971.950516:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:2.0:1782221971.950537:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:2.0:1782221971.950556:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000020:00000080:1.0:1782221971.950681:0:7470:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1782221971.950696:0:7470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000040:00080000:2.0:1782221971.951150:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:2.0:1782221971.951179:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:2.0:1782221971.951195:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:2.0:1782221971.951209:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:2.0:1782221971.951222:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:2.0:1782221971.951524:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:2.0:1782221971.951543:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:2.0:1782221971.951558:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000004:01000000:1.0:1782221971.951693:0:7470:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000040:00080000:2.0:1782221971.951713:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:2.0:1782221971.951733:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:2.0:1782221971.951744:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000020:00000080:1.0:1782221971.951792:0:7470:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe2b7cc26e6810ea4 00000100:00100000:2.0:1782221971.951798:0:7456:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005a73f709 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081661696:0@lo:502: 00000100:00080000:1.0:1782221971.951806:0:7470:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782221971.951813:0:7470:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000ae5dbaf6 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:1.0:1782221971.952025:0:7470:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ab3f0ff9 x1868795081661824/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782221971.952146:0:7470:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1782221971.952173:0:7456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:1.0:1782221971.952202:0:7470:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1782221971.952702:0:7456:0:(client.c:2701:ptlrpc_set_wait()) set 000000002e30040f going to sleep for 11 seconds 00000100:00100000:3.0:1782221971.953396:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000064593a52 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1868795081661952:0@lo:400: 00000100:00100000:3.0:1782221971.953477:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221971.953690:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081661696 00000100:00100000:0.0:1782221971.953700:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081661696 00000100:00100000:1.0:1782221971.953852:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ab3f0ff9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081661824:0@lo:38: 00000100:00100000:1.0:1782221971.953901:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221971.954195:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1782221971.954205:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000848f5477 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+14:7456:x1868795081661696:12345-0@lo:502: 00000100:00100000:0.0:1782221971.954409:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000848f5477 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+14:7456:x1868795081661696:12345-0@lo:502: Request processed in 205us (2237us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221971.954456:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1782221971.954523:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081661952 00000100:00100000:0.0:1782221971.954529:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081661952 00000100:00100000:0.0:1782221971.954560:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782221971.954566:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb49f378 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1868795081661952:12345-0@lo:400: 00000100:00100000:2.0:1782221971.955623:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081661824 00000100:00100000:2.0:1782221971.955641:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081661824 00000100:00100000:2.0:1782221971.955685:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782221971.955693:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065319124 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1868795081661824:12345-0@lo:38: 00010000:00020000:2.0:1782221971.955717:0:6531:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1782221971.955719:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb49f378 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1868795081661952:12345-0@lo:400: Request processed in 1151us (2240us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221971.955741:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782221971.955786:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065319124 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1868795081661824:12345-0@lo:38: Request processed in 93us (1885us total) trans 0 rc -19/-19 00000100:00100000:2.0:1782221971.955793:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1782221971.955834:0:3652:0:(import.c:65:import_set_state_nolock()) 00000000ae5dbaf6 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1782221971.955839:0:7456:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005a73f709 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081661696:0@lo:502: 00000100:00080000:0.0:1782221971.955854:0:3652:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1782221971.955859:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ab3f0ff9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081661824:0@lo:38: 00000040:00080000:2.0:1782221971.955971:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:2.0:1782221971.955988:0:7456:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000100:00080000:2.0:1782221971.956313:0:7473:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@000000005a73f709 x1868795081662080/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782221971.956325:0:7473:0:(client.c:2701:ptlrpc_set_wait()) set 000000006bff0093 going to sleep for 0 seconds 00000020:01000000:2.0:1782221971.956396:0:7470:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782221971.956404:0:7470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782221971.956406:0:7470:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1782221971.956410:0:7470:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782221971.956415:0:7470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782221971.956416:0:7470:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1782221971.956431:0:7470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782221971.956433:0:7470:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1782221971.956457:0:7470:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d7a8ed02 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7470:1868795081662208:0@lo:502: 00000100:00100000:2.0:1782221971.956519:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221971.956559:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081662208 00000100:00100000:2.0:1782221971.956561:0:7470:0:(client.c:2701:ptlrpc_set_wait()) set 0000000022922d35 going to sleep for 11 seconds 00000100:00100000:0.0:1782221971.956566:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081662208 00000100:00100000:0.0:1782221971.956622:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1782221971.956629:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ad5867b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+14:7470:x1868795081662208:12345-0@lo:502: 00000100:00100000:0.0:1782221971.956752:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ad5867b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+14:7470:x1868795081662208:12345-0@lo:502: Request processed in 123us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221971.956759:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1782221971.956805:0:7470:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d7a8ed02 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7470:1868795081662208:0@lo:502: 00000020:01000000:0.0:1782221971.956828:0:7470:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782221971.956834:0:7470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782221971.956836:0:7470:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1782221971.957265:0:7470:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1782221971.957338:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1782221971.957381:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1782221971.957393:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: 00000000f0fdb0a2/0xe2b7cc26e6810e57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810e65 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221971.957417:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: 00000000f0fdb0a2/0xe2b7cc26e6810e57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810e65 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782221971.957437:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1782221971.957440:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8f087805cd40 from 1 10000000:01000000:0.0:1782221971.957443:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1782221971.957477:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: 00000000cf189505/0xe2b7cc26e6810eab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221971.957485:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: 00000000cf189505/0xe2b7cc26e6810eab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221971.957494:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: 00000000cf189505/0xe2b7cc26e6810eab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782221971.957512:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003a1901ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081662336:0@lo:101: 00000100:00100000:0.0:1782221971.957551:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221971.957592:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set 0000000045d1085f going to sleep for 11 seconds 00000100:00100000:2.0:1782221971.959358:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081662336 00000100:00100000:2.0:1782221971.959370:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081662336 00010000:00080000:3.0:1782221971.959376:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000064593a52 x1868795081661952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782221987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782221971.959398:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000064593a52 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1868795081661952:0@lo:400: 00000100:00100000:2.0:1782221971.959439:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1782221971.959450:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c6a11bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+14:6523:x1868795081662336:12345-0@lo:101: 00010000:00010000:2.0:1782221971.959467:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782221971.959486:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005cb7f89c/0xe2b7cc26e6810eb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6810eab expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221971.959517:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005cb7f89c/0xe2b7cc26e6810eb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6810eab expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221971.959529:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005cb7f89c/0xe2b7cc26e6810eb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810eab expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221971.959540:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005cb7f89c, rc 0) 00000100:00100000:2.0:1782221971.959620:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c6a11bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:6523:x1868795081662336:12345-0@lo:101: Request processed in 172us (2068us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221971.959627:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000020:01000000:1.0:1782221971.960208:0:7474:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782221971.960224:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782221971.960227:0:7474:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1782221971.960248:0:7474:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1782221971.960253:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782221971.960272:0:7474:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000543cef40) 00000020:00000080:1.0:1782221971.960298:0:7474:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lod with refcount 2 00000020:00000080:1.0:1782221971.960305:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1782221971.960466:0:7474:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1782221971.960475:0:7474:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe2b7cc26e6810ec0 00000020:00000080:1.0:1782221971.960922:0:7474:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1782221971.960928:0:7474:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782221971.960932:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782221971.960933:0:7474:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1782221971.960936:0:7474:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782221971.960941:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782221971.960942:0:7474:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1782221971.960945:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782221971.961146:0:7474:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (0000000026b153d6) 00000020:00000080:1.0:1782221971.961161:0:7474:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdt with refcount 2 00000020:00000080:1.0:1782221971.961168:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1782221971.961170:0:7474:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1782221971.961173:0:7474:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1782221971.961180:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1782221971.961258:0:7474:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e79623b3 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1782221971.961273:0:7474:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000e242528b) 00000020:00000080:1.0:1782221971.961281:0:7474:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdd with refcount 2 00000004:01000000:1.0:1782221971.961363:0:7474:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1782221971.961369:0:7474:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe2b7cc26e6810ed5 00000020:00000080:1.0:1782221971.961487:0:7474:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1782221971.961495:0:7474:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1782221971.961499:0:7474:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xe2b7cc26e6810edc 00080000:01000000:1.0:1782221971.961505:0:7474:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1782221971.961508:0:7474:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe2b7cc26e6810ee3 00000100:00100000:0.0:1782221971.962481:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003a1901ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081662336:0@lo:101: 00010000:00010000:0.0:1782221971.962516:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: 00000000cf189505/0xe2b7cc26e6810eab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810eb2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221971.962531:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: 00000000cf189505/0xe2b7cc26e6810eab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6810eb2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782221971.962646:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003a1901ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081662464:0@lo:501: 00000100:00100000:0.0:1782221971.962736:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221971.962807:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set 0000000045d1085f going to sleep for 11 seconds 00000100:00100000:0.0:1782221971.962880:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081662464 00000100:00100000:0.0:1782221971.962889:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081662464 00000100:00100000:0.0:1782221971.962942:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1782221971.962953:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee7920f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:6523:x1868795081662464:12345-0@lo:501: 00080000:10000000:1.0:1782221971.963390:0:7474:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000100:00100000:0.0:1782221971.963528:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee7920f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:6523:x1868795081662464:12345-0@lo:501: Request processed in 575us (800us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782221971.963538:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1782221971.963750:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003a1901ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081662464:0@lo:501: 10000000:01000000:2.0:1782221971.963794:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1782221971.963804:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: 00000000cf189505/0xe2b7cc26e6810eab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810eb2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221971.963813:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: 00000000cf189505/0xe2b7cc26e6810eab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810eb2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 40000000:02000000:1.0:1782221971.963955:0:7474:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:3.0:1782221972.010662:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782221972.059552:0:7474:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:0.0:1782221972.059872:0:7474:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:0.0:1782221972.062816:0:7474:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1782221972.063297:0:7474:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1782221972.079647:0:7474:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1782221972.079662:0:7474:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782221972.079668:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782221972.079670:0:7474:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1782221972.079674:0:7474:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782221972.079681:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782221972.079682:0:7474:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1782221972.079685:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1782221972.079690:0:7474:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.127@tcp to nid 0x20000c0a8cb7f (192.168.203.127@tcp) 00000020:00000080:0.0:1782221972.079717:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782221972.079743:0:7474:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (000000005d4c7819) 00000020:00000080:0.0:1782221972.079767:0:7474:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osp with refcount 2 00000020:00000080:0.0:1782221972.079773:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1782221972.079860:0:7474:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1782221972.079866:0:7474:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:0.0:1782221972.079872:0:7474:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe2b7cc26e6810ef1 00010000:00080000:0.0:1782221972.079902:0:7474:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000096769fa@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.127@tcp at head 00010000:00010000:0.0:1782221972.086574:0:7474:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-3 is initialized 00000020:00000080:1.0:1782221972.087435:0:7474:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1782221972.087449:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1782221972.087489:0:7474:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1782221972.087511:0:7474:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe2b7cc26e6810ef8 00000100:00080000:1.0:1782221972.087521:0:7474:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782221972.087526:0:7474:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000096769fa using connection 192.168.203.127@tcp/0@lo 00000100:00100000:1.0:1782221972.087559:0:7474:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000532bd497 x1868795081662592/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782221972.087615:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000532bd497 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1868795081662592:0@lo:38: 00000100:00100000:0.0:1782221972.087680:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1782221972.087750:0:7474:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1782221972.087804:0:7474:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782221972.087808:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782221972.087810:0:7474:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1782221972.087813:0:7474:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1782221972.087816:0:7474:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1782221972.087817:0:7474:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782221972.087818:0:7474:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782221972.087820:0:7474:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1782221972.087822:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782221972.087824:0:7474:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1782221972.087826:0:7474:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782221972.087830:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782221972.087831:0:7474:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1782221972.087835:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1782221972.087873:0:7474:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1782221972.087886:0:7474:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782221972.087890:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782221972.087891:0:7474:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1782221972.087894:0:7474:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782221972.087896:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782221972.087897:0:7474:0:(obd_config.c:1561:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782221972.087900:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782221972.087901:0:7474:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1782221972.087926:0:7474:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782221972.087929:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782221972.087930:0:7474:0:(obd_config.c:1561:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:1.0:1782221972.087933:0:7474:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00080000:1.0:1782221972.088064:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1782221972.088068:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1782221972.088070:0:8:0:(import.c:65:import_set_state_nolock()) 00000000ae5dbaf6 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782221972.088074:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 170 00000100:00080000:1.0:1782221972.088078:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1782221972.088081:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000ae5dbaf6 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:1.0:1782221972.088093:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001993a376 x1868795081662976/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782221972.088147:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081662592 00000100:00100000:2.0:1782221972.088162:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081662592 00000100:00100000:2.0:1782221972.088192:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782221972.088197:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e302d2fe pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1868795081662592:12345-0@lo:38: 00010000:00080000:2.0:1782221972.088217:0:6531:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 171 last 0 00000020:00000080:2.0:1782221972.088264:0:6531:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe2b7cc26e6810eff 00000004:00100000:2.0:1782221972.088277:0:6531:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1782221972.088282:0:6531:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:2.0:1782221972.088345:0:7456:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:2.0:1782221972.088372:0:7456:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1782221972.088385:0:7456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: 0000000093e9daab/0xe2b7cc26e6810e88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810e8f expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.088394:0:7456:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: 0000000093e9daab/0xe2b7cc26e6810e88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810e8f expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782221972.088401:0:7456:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8f0849b46800 from 1 10000000:01000000:2.0:1782221972.088404:0:7456:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782221972.088437:0:7456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: 00000000bc3218fe/0xe2b7cc26e6810f06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.088445:0:7456:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: 00000000bc3218fe/0xe2b7cc26e6810f06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.088452:0:7456:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: 00000000bc3218fe/0xe2b7cc26e6810f06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221972.088467:0:7456:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000da76a15a pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081663104:0@lo:101: 00000100:00100000:2.0:1782221972.088504:0:7456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221972.088522:0:7456:0:(client.c:2701:ptlrpc_set_wait()) set 00000000df8c75bf going to sleep for 11 seconds 00000100:00100000:2.0:1782221972.088557:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081663104 00000100:00100000:2.0:1782221972.088561:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081663104 00000100:00100000:2.0:1782221972.088590:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782221972.088596:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ac79c81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:7456:x1868795081663104:12345-0@lo:101: 00010000:00010000:2.0:1782221972.088607:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782221972.088617:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000068185924/0xe2b7cc26e6810f0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6810f06 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.088637:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000068185924/0xe2b7cc26e6810f0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6810f06 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.088647:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000068185924/0xe2b7cc26e6810f0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810f06 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.088655:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000068185924, rc 0) 00000100:00100000:2.0:1782221972.088688:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ac79c81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:7456:x1868795081663104:12345-0@lo:101: Request processed in 93us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221972.088694:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782221972.088736:0:7456:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000da76a15a pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081663104:0@lo:101: 00010000:00010000:2.0:1782221972.088748:0:7456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: 00000000bc3218fe/0xe2b7cc26e6810f06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810f0d expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.088756:0:7456:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: 00000000bc3218fe/0xe2b7cc26e6810f06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6810f0d expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221972.089299:0:7456:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000da76a15a pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081663232:0@lo:256: 00000100:00100000:2.0:1782221972.089336:0:7456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221972.089354:0:7456:0:(client.c:2701:ptlrpc_set_wait()) set 00000000df8c75bf going to sleep for 11 seconds 00000100:00100000:2.0:1782221972.089370:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081663232 00000100:00100000:2.0:1782221972.089380:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081663232 00000100:00100000:2.0:1782221972.089407:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1782221972.089413:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000adafbc3d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:7456:x1868795081663232:12345-0@lo:256: 20000000:01000000:2.0:1782221972.089438:0:6521:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1782221972.089453:0:6521:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1782221972.089456:0:6521:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1782221972.089526:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000adafbc3d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:7456:x1868795081663232:12345-0@lo:256: Request processed in 113us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221972.089532:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1782221972.089571:0:7456:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000da76a15a pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081663232:0@lo:256: 10000000:01000000:2.0:1782221972.090113:0:7456:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1782221972.090129:0:7456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: 00000000bc3218fe/0xe2b7cc26e6810f06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810f0d expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.090137:0:7456:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: 00000000bc3218fe/0xe2b7cc26e6810f06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810f0d expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782221972.090145:0:7456:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f0849b46800 from 1 10000000:01000000:2.0:1782221972.090147:0:7456:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782221972.090169:0:7456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: 00000000f6344b0b/0xe2b7cc26e6810f14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.090176:0:7456:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: 00000000f6344b0b/0xe2b7cc26e6810f14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.090183:0:7456:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: 00000000f6344b0b/0xe2b7cc26e6810f14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221972.090196:0:7456:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000da76a15a pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081663360:0@lo:101: 00000100:00100000:2.0:1782221972.090258:0:7456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221972.090274:0:7456:0:(client.c:2701:ptlrpc_set_wait()) set 00000000df8c75bf going to sleep for 11 seconds 00000100:00100000:2.0:1782221972.090295:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081663360 00000100:00100000:2.0:1782221972.090300:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081663360 00000100:00100000:2.0:1782221972.090328:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782221972.090335:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000094d4e7f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:7456:x1868795081663360:12345-0@lo:101: 00010000:00010000:2.0:1782221972.090344:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782221972.090354:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a53b3067/0xe2b7cc26e6810f1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6810f14 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.090372:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a53b3067/0xe2b7cc26e6810f1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6810f14 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.090380:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a53b3067/0xe2b7cc26e6810f1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810f14 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.090387:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a53b3067, rc 0) 00000100:00100000:2.0:1782221972.090416:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000094d4e7f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:7456:x1868795081663360:12345-0@lo:101: Request processed in 83us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221972.090436:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782221972.090479:0:7456:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000da76a15a pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081663360:0@lo:101: 00010000:00010000:2.0:1782221972.090491:0:7456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: 00000000f6344b0b/0xe2b7cc26e6810f14 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810f1b expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.090498:0:7456:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: 00000000f6344b0b/0xe2b7cc26e6810f14 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6810f1b expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221972.090583:0:7456:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000da76a15a pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081663488:0@lo:501: 00000100:00100000:2.0:1782221972.090617:0:7456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221972.090631:0:7456:0:(client.c:2701:ptlrpc_set_wait()) set 00000000df8c75bf going to sleep for 11 seconds 00000100:00100000:2.0:1782221972.090645:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081663488 00000100:00100000:2.0:1782221972.090648:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081663488 00000100:00100000:2.0:1782221972.090668:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782221972.090673:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000775e8f82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:7456:x1868795081663488:12345-0@lo:501: 00000100:00100000:2.0:1782221972.090764:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000775e8f82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:7456:x1868795081663488:12345-0@lo:501: Request processed in 91us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221972.090770:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782221972.090798:0:7456:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000da76a15a pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081663488:0@lo:501: 00000100:00100000:2.0:1782221972.090819:0:7456:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000da76a15a pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081663616:0@lo:503: 00000100:00100000:2.0:1782221972.090850:0:7456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221972.090860:0:7456:0:(client.c:2701:ptlrpc_set_wait()) set 00000000df8c75bf going to sleep for 11 seconds 00000100:00100000:2.0:1782221972.090871:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081663616 00000100:00100000:2.0:1782221972.090874:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081663616 00000100:00100000:2.0:1782221972.090894:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782221972.090899:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000739b08fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:7456:x1868795081663616:12345-0@lo:503: 00000040:00080000:2.0:1782221972.090930:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782221972.090963:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000739b08fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:7456:x1868795081663616:12345-0@lo:503: Request processed in 64us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221972.090969:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782221972.091004:0:7456:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000da76a15a pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081663616:0@lo:503: 00000040:00080000:2.0:1782221972.091259:0:7456:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782221972.091302:0:7456:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:2.0:1782221972.091365:0:7456:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782221972.092183:0:7479:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:2.0:1782221972.092219:0:7456:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1782221972.092264:0:7456:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782221972.092274:0:7456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: 00000000f6344b0b/0xe2b7cc26e6810f14 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810f1b expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.092284:0:7456:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: 00000000f6344b0b/0xe2b7cc26e6810f14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810f1b expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782221972.092323:0:7456:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1782221972.092326:0:7456:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f0849b46800 10000000:01000000:2.0:1782221972.092328:0:7456:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f0849b46800 10000000:01000000:2.0:1782221972.092332:0:7456:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782221972.092336:0:7456:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8f0849b46800 from 1 10000000:01000000:2.0:1782221972.092338:0:7456:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782221972.092371:0:7456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: 0000000061b8e0dc/0xe2b7cc26e6810f22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.092378:0:7456:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: 0000000061b8e0dc/0xe2b7cc26e6810f22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.092387:0:7456:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: 0000000061b8e0dc/0xe2b7cc26e6810f22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221972.092402:0:7456:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000da76a15a pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081663744:0@lo:101: 00000100:00100000:2.0:1782221972.092459:0:7456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221972.092477:0:7456:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b1c647ed going to sleep for 11 seconds 00000100:00100000:2.0:1782221972.092514:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081663744 00000100:00100000:2.0:1782221972.092521:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081663744 00000100:00100000:2.0:1782221972.092549:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1782221972.092556:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088164688 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:7456:x1868795081663744:12345-0@lo:101: 00010000:00010000:2.0:1782221972.092566:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782221972.092580:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b72f0ca3/0xe2b7cc26e6810f29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6810f22 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.092597:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b72f0ca3/0xe2b7cc26e6810f29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6810f22 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.092606:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b72f0ca3/0xe2b7cc26e6810f29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810f22 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.092611:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b72f0ca3, rc 0) 00000100:00100000:2.0:1782221972.092642:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088164688 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:7456:x1868795081663744:12345-0@lo:101: Request processed in 87us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221972.092648:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782221972.093201:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001993a376 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081662976:0@lo:38: 00000100:00100000:0.0:1782221972.093252:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221972.093295:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d8f40dbc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081662720:0@lo:400: 00000100:00100000:0.0:1782221972.093321:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221972.093339:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782221972.093345:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000eeb73a4b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081662848:0@lo:400: 00000100:00100000:0.0:1782221972.093368:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221972.093405:0:6532:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1782221972.093412:0:6532:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1782221972.093437:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081662720 00000100:00100000:0.0:1782221972.093441:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081662720 00000100:00100000:0.0:1782221972.093468:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782221972.093474:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069ebea54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:3653:x1868795081662720:12345-0@lo:400: 00000100:00100000:0.0:1782221972.093510:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069ebea54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:3653:x1868795081662720:12345-0@lo:400: Request processed in 36us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221972.093516:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782221972.093540:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081662848 00000100:00100000:0.0:1782221972.093544:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081662848 00000100:00100000:0.0:1782221972.093565:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782221972.093571:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df676608 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081662848:12345-0@lo:400: 00000100:00100000:0.0:1782221972.093607:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df676608 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081662848:12345-0@lo:400: Request processed in 36us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221972.093612:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1782221972.093710:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000eeb73a4b x1868795081662848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782221988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782221972.093735:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000eeb73a4b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081662848:0@lo:400: 00000100:00100000:0.0:1782221972.093746:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d8f40dbc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081662720:0@lo:400: 00000100:00100000:0.0:1782221972.093793:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081662976 00000100:00100000:0.0:1782221972.093796:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081662976 00000100:00100000:0.0:1782221972.093888:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782221972.093892:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e523ab71 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3652:x1868795081662976:12345-0@lo:38: 00000100:00100000:0.0:1782221972.093936:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e523ab71 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3652:x1868795081662976:12345-0@lo:38: Request processed in 42us (684us total) trans 0 rc -11/-11 00000100:00100000:0.0:1782221972.093942:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782221972.093962:0:3652:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782221972.093968:0:3652:0:(import.c:65:import_set_state_nolock()) 00000000ae5dbaf6 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782221972.093972:0:3652:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1782221972.093975:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001993a376 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081662976:0@lo:38: 00000100:00100000:2.0:1782221972.095098:0:7456:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000da76a15a pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081663744:0@lo:101: 00010000:00010000:2.0:1782221972.095119:0:7456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: 0000000061b8e0dc/0xe2b7cc26e6810f22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810f29 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.095129:0:7456:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: 0000000061b8e0dc/0xe2b7cc26e6810f22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6810f29 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221972.095221:0:7456:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000da76a15a pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081663872:0@lo:501: 00000100:00100000:2.0:1782221972.095445:0:7456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221972.095487:0:7456:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b1c647ed going to sleep for 11 seconds 00000100:00080000:1.0:1782221972.096020:0:6531:0:(import.c:65:import_set_state_nolock()) 00000000df547c23 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782221972.096086:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e302d2fe pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3652:x1868795081662592:12345-0@lo:38: Request processed in 7887us (8406us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221972.096102:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782221972.096170:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081663872 00000100:00100000:0.0:1782221972.096177:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081663872 00000100:00100000:0.0:1782221972.096221:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1782221972.096229:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000584d8310 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:7456:x1868795081663872:12345-0@lo:501: 00000100:00100000:0.0:1782221972.096355:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000584d8310 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:7456:x1868795081663872:12345-0@lo:501: Request processed in 127us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221972.096362:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1782221972.096465:0:3652:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782221972.096472:0:3652:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1782221972.096479:0:3652:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xe2400010450010a0 00000100:00080000:2.0:1782221972.096485:0:3652:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1782221972.096487:0:3652:0:(import.c:65:import_set_state_nolock()) 00000000096769fa lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1782221972.096506:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000532bd497 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1868795081662592:0@lo:38: 00000100:00100000:2.0:1782221972.096548:0:7456:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000da76a15a pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081663872:0@lo:501: 00000100:00100000:2.0:1782221972.096591:0:7456:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000da76a15a pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081664000:0@lo:503: 00000100:00100000:2.0:1782221972.096632:0:7456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221972.096649:0:7456:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b1c647ed going to sleep for 11 seconds 00000100:00100000:2.0:1782221972.096663:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081664000 00000100:00100000:2.0:1782221972.096667:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081664000 00000100:00100000:2.0:1782221972.096693:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782221972.096697:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a4a8af49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:7456:x1868795081664000:12345-0@lo:503: 00000100:00100000:2.0:1782221972.096767:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a4a8af49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:7456:x1868795081664000:12345-0@lo:503: Request processed in 69us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221972.096773:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782221972.096811:0:7456:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000da76a15a pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081664000:0@lo:503: 00000040:00080000:2.0:1782221972.097029:0:7456:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782221972.097086:0:7456:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000da76a15a pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081664128:0@lo:502: 00000100:00100000:2.0:1782221972.097119:0:7456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221972.097132:0:7456:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b1c647ed going to sleep for 11 seconds 00000100:00100000:2.0:1782221972.097145:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081664128 00000100:00100000:2.0:1782221972.097150:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081664128 00000100:00100000:2.0:1782221972.097186:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782221972.097192:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000483c2e25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:7456:x1868795081664128:12345-0@lo:502: 00000100:00100000:2.0:1782221972.097300:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000483c2e25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:7456:x1868795081664128:12345-0@lo:502: Request processed in 109us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221972.097306:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782221972.097344:0:7456:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000da76a15a pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081664128:0@lo:502: 00000040:00080000:2.0:1782221972.097509:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1782221972.097540:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1782221972.097555:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1782221972.097569:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1782221972.097582:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1782221972.097596:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1782221972.097608:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1782221972.097622:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1782221972.097634:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1782221972.097645:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1782221972.097658:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1782221972.097671:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1782221972.097685:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1782221972.097697:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1782221972.097710:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1782221972.097721:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1782221972.097734:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1782221972.097746:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1782221972.097759:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1782221972.097773:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1782221972.097785:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1782221972.097797:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1782221972.097810:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1782221972.097823:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1782221972.097835:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1782221972.097847:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1782221972.097875:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1782221972.097889:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:2.0:1782221972.097910:0:7456:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000da76a15a pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081664256:0@lo:502: 00000100:00100000:2.0:1782221972.097946:0:7456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221972.097962:0:7456:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f4b43191 going to sleep for 11 seconds 00000100:00100000:2.0:1782221972.097980:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081664256 00000100:00100000:2.0:1782221972.097983:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081664256 00000100:00100000:2.0:1782221972.098014:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782221972.098019:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044b09db7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:7456:x1868795081664256:12345-0@lo:502: 00000100:00100000:2.0:1782221972.098086:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044b09db7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:7456:x1868795081664256:12345-0@lo:502: Request processed in 67us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221972.098093:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782221972.098131:0:7456:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000da76a15a pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081664256:0@lo:502: 00000040:00080000:2.0:1782221972.098163:0:7456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1782221972.098169:0:7456:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1782221972.098471:0:7481:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1782221972.098491:0:7481:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000608d89e0) 00000020:00000080:2.0:1782221972.098509:0:7481:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type lwp with refcount 2 00000100:00100000:0.0:1782221972.099616:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782221972.099631:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b1e38df9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081664384:0@lo:41: 00000100:00100000:0.0:1782221972.099680:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221972.099727:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081664384 00000100:00100000:0.0:1782221972.099733:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081664384 00000100:00100000:0.0:1782221972.099775:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782221972.099781:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d27255d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3656:x1868795081664384:12345-0@lo:41: 00000004:00000024:0.0:1782221972.099808:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1782221972.099847:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d27255d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3656:x1868795081664384:12345-0@lo:41: Request processed in 67us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221972.099853:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782221972.099887:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b1e38df9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081664384:0@lo:41: 00000020:01000004:3.0:1782221972.100407:0:7481:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e79623b3 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1782221972.100412:0:7481:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000e79623b3 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1782221972.100415:0:7481:0:(obd_mount.c:701:lustre_put_lsi()) put 00000000e79623b3 3 00010000:00080000:3.0:1782221972.100455:0:7481:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002c136397@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.127@tcp at head 00010000:00010000:3.0:1782221972.102624:0:7481:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-4 is initialized 00000020:00000080:3.0:1782221972.102737:0:7481:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1782221972.102786:0:7481:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1782221972.102799:0:7481:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xe2b7cc26e6810f37 00000100:00080000:3.0:1782221972.102809:0:7481:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782221972.102815:0:7481:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000002c136397 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:3.0:1782221972.102852:0:7481:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005375793a x1868795081664512/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782221972.102888:0:7481:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1782221972.103196:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005375793a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3652:1868795081664512:0@lo:38: 00000100:00100000:0.0:1782221972.103294:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221972.103400:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081664512 00000100:00100000:1.0:1782221972.103409:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081664512 00000100:00100000:1.0:1782221972.103453:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782221972.103460:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1e38df9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3652:x1868795081664512:12345-0@lo:38: 00010000:00080000:1.0:1782221972.103496:0:6527:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 171 last 0 00000020:00000080:1.0:1782221972.103532:0:6527:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xe2b7cc26e6810f3e 00000004:00100000:1.0:1782221972.103546:0:6527:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782221972.103584:0:6527:0:(import.c:65:import_set_state_nolock()) 000000007f8d40a2 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782221972.103628:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1e38df9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1868795081664512:12345-0@lo:38: Request processed in 168us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221972.103634:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1782221972.104016:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005375793a x1868795081664512/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782221982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782221972.104027:0:3652:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782221972.104039:0:3652:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1782221972.104046:0:3652:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1782221972.104050:0:3652:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1782221972.104052:0:3652:0:(import.c:65:import_set_state_nolock()) 000000002c136397 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1782221972.104057:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005375793a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3652:1868795081664512:0@lo:38: 00000040:00080000:3.0:1782221972.107080:0:7481:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1782221972.107215:0:7456:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1782221972.107275:0:7456:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782221972.107294:0:7456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: 0000000061b8e0dc/0xe2b7cc26e6810f22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810f29 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221972.107305:0:7456:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: 0000000061b8e0dc/0xe2b7cc26e6810f22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810f29 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1782221972.107353:0:7456:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1782221972.107356:0:7456:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1782221972.107357:0:7456:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782221972.107358:0:7456:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782221972.107359:0:7456:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782221972.107361:0:7456:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782221972.107363:0:7456:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782221972.107364:0:7456:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782221972.107366:0:7456:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782221972.107368:0:7456:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782221972.107369:0:7456:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782221972.107373:0:7456:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:1.0:1782221972.107375:0:7456:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1782221972.107377:0:7456:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1782221972.107378:0:7456:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782221972.107379:0:7456:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782221972.107380:0:7456:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782221972.107381:0:7456:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782221972.107387:0:7456:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782221972.107388:0:7456:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782221972.107389:0:7456:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782221972.107390:0:7456:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782221972.107391:0:7456:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782221972.107417:0:7456:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1782221972.107446:0:7456:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c90933bf pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081664640:0@lo:253: 00000100:00100000:1.0:1782221972.107510:0:7456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221972.107545:0:7456:0:(client.c:2701:ptlrpc_set_wait()) set 0000000084239611 going to sleep for 11 seconds 00000100:00100000:1.0:1782221972.107565:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081664640 00000100:00100000:1.0:1782221972.107582:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081664640 00000100:00100000:1.0:1782221972.107622:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1782221972.107628:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fde29184 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:7456:x1868795081664640:12345-0@lo:253: 20000000:01000000:1.0:1782221972.107655:0:6520:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1782221972.107669:0:6520:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 40000000:00080000:0.0:1782221972.108509:0:7482:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000001:00100000:0.0:1782221972.112986:0:6505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1782221972.113056:0:6520:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1782221972.113073:0:6520:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1782221972.113367:0:6542:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1782221972.113372:0:6542:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1782221972.113391:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003b903220/0xe2b7cc26e6810f45 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.113410:0:6542:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000bab18c58/0xe2b7cc26e6810e26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810e1f expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.113417:0:6542:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000068185924/0xe2b7cc26e6810f0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810f06 expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.113435:0:6542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003b903220/0xe2b7cc26e6810f45 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.113472:0:6542:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000068185924/0xe2b7cc26e6810f0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e6810f06 expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.113484:0:6542:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000068185924/0xe2b7cc26e6810f0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e6810f06 expref: 18 pid: 6519 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221972.113512:0:6542:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000da76a15a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6542:1868795081664768:0@lo:104: 00000100:00100000:2.0:1782221972.113585:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782221972.113637:0:6542:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000bab18c58/0xe2b7cc26e6810e26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e6810e1f expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.113645:0:6542:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000bab18c58/0xe2b7cc26e6810e26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e6810e1f expref: 18 pid: 6520 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221972.113653:0:6542:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001f998192 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6542:1868795081664896:0@lo:104: 00000100:00100000:2.0:1782221972.113673:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221972.113690:0:6542:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d062ca32 going to sleep for 11 seconds 00000100:00100000:2.0:1782221972.113715:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081664768 00000100:00100000:2.0:1782221972.113721:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081664768 00000100:00100000:2.0:1782221972.113755:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081664896 00000100:00100000:2.0:1782221972.113757:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081664896 00000100:00100000:2.0:1782221972.113771:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782221972.113778:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7a8ed02 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+4:6542:x1868795081664768:12345-0@lo:104: 00010000:00010000:2.0:1782221972.113791:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: 00000000bc3218fe/0xe2b7cc26e6810f06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810f0d expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.113837:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782221972.113842:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7a8ed02 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+4:6542:x1868795081664768:12345-0@lo:104: Request processed in 65us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221972.113848:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782221972.113862:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782221972.113866:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf9dd50d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+3:6542:x1868795081664896:12345-0@lo:104: 00010000:00010000:2.0:1782221972.113872:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: 00000000e07525c3/0xe2b7cc26e6810e1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810e26 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.113909:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782221972.113914:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf9dd50d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+3:6542:x1868795081664896:12345-0@lo:104: Request processed in 48us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221972.113919:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782221972.113952:0:6542:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000da76a15a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6542:1868795081664768:0@lo:104: 00000100:00100000:2.0:1782221972.113959:0:6542:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001f998192 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6542:1868795081664896:0@lo:104: 00010000:00010000:2.0:1782221972.113975:0:6542:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003b903220/0xe2b7cc26e6810f45 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.113992:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782221972.113996:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: 00000000bc3218fe/0xe2b7cc26e6810f06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810f0d expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.114002:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bc3218fe already unused, calling callback (00000000a10b8087) 10000000:00010000:2.0:1782221972.114005:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: 00000000bc3218fe/0xe2b7cc26e6810f06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e6810f0d expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.114012:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: 00000000bc3218fe/0xe2b7cc26e6810f06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e6810f0d expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782221972.114018:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: 00000000bc3218fe/0xe2b7cc26e6810f06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e6810f0d expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782221972.114023:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1782221972.114048:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: 00000000bc3218fe/0xe2b7cc26e6810f06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810f0d expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.114054:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782221972.114076:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: 00000000bc3218fe/0xe2b7cc26e6810f06 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810f0d expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.114081:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: 00000000bc3218fe/0xe2b7cc26e6810f06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810f0d expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.114090:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782221972.114092:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: 00000000e07525c3/0xe2b7cc26e6810e1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810e26 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.114097:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e07525c3 already unused, calling callback (00000000a10b8087) 10000000:00010000:2.0:1782221972.114098:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: 00000000e07525c3/0xe2b7cc26e6810e1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e6810e26 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.114103:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: 00000000e07525c3/0xe2b7cc26e6810e1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e6810e26 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782221972.114109:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: 00000000e07525c3/0xe2b7cc26e6810e1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e6810e26 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782221972.114113:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1782221972.114124:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: 00000000e07525c3/0xe2b7cc26e6810e1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810e26 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.114129:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782221972.114141:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: 00000000e07525c3/0xe2b7cc26e6810e1f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810e26 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.114146:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: 00000000e07525c3/0xe2b7cc26e6810e1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810e26 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.114158:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782221972.114165:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782221972.114167:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782221972.114172:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782221972.114183:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001f998192 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081665024:0@lo:103: 00000100:00100000:2.0:1782221972.114211:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221972.114272:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000da76a15a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081665152:0@lo:103: 00000100:00100000:2.0:1782221972.114297:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221972.114326:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081665024 00000100:00100000:2.0:1782221972.114330:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081665024 00010000:00010000:2.0:1782221972.114346:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000068185924/0xe2b7cc26e6810f0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810f06 expref: 19 pid: 6519 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221972.114364:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081665152 00000100:00100000:2.0:1782221972.114367:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081665152 00010000:00010000:2.0:1782221972.114376:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000bab18c58/0xe2b7cc26e6810e26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810e1f expref: 20 pid: 6520 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221972.114387:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782221972.114391:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f084405f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:3656:x1868795081665024:12345-0@lo:103: 00010000:00010000:2.0:1782221972.114399:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782221972.114403:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000068185924/0xe2b7cc26e6810f0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810f06 expref: 20 pid: 6519 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.114410:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000068185924/0xe2b7cc26e6810f0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e6810f06 expref: 20 pid: 6519 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.114434:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000068185924/0xe2b7cc26e6810f0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e6810f06 expref: 20 pid: 6519 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.114445:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782221972.114477:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f084405f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+19:3656:x1868795081665024:12345-0@lo:103: Request processed in 85us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221972.114485:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782221972.114497:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782221972.114503:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000099bdb552 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:3653:x1868795081665152:12345-0@lo:103: 00010000:00010000:2.0:1782221972.114511:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782221972.114514:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000bab18c58/0xe2b7cc26e6810e26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810e1f expref: 18 pid: 6520 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.114522:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000bab18c58/0xe2b7cc26e6810e26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e6810e1f expref: 18 pid: 6520 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.114531:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bab18c58/0xe2b7cc26e6810e26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e6810e1f expref: 18 pid: 6520 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.114540:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003b903220/0xe2b7cc26e6810f45 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.114547:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003b903220/0xe2b7cc26e6810f45 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1782221972.114559:0:6511:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010741737s 00010000:00010000:2.0:1782221972.114562:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003b903220/0xe2b7cc26e6810f45 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.114568:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003b903220/0xe2b7cc26e6810f45 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.114574:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003b903220/0xe2b7cc26e6810f45 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.114589:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003b903220/0xe2b7cc26e6810f45 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.114594:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003b903220 already unused, calling callback (0000000068110196) 00010000:00010000:2.0:1782221972.114597:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003b903220/0xe2b7cc26e6810f45 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.114602:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003b903220/0xe2b7cc26e6810f45 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.114613:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003b903220/0xe2b7cc26e6810f45 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.114621:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782221972.114646:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000099bdb552 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:3653:x1868795081665152:12345-0@lo:103: Request processed in 144us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221972.114652:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1782221972.114702:0:6542:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003b903220/0xe2b7cc26e6810f45 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.114709:0:6542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003b903220/0xe2b7cc26e6810f45 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221972.114714:0:6542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003b903220/0xe2b7cc26e6810f45 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221972.114738:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000da76a15a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081665152:0@lo:103: 00000100:00100000:2.0:1782221972.114756:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001f998192 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081665024:0@lo:103: 00000100:00100000:0.0:1782221972.115072:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fde29184 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:7456:x1868795081664640:12345-0@lo:253: Request processed in 7443us (7561us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221972.115081:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1782221972.115150:0:7456:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c90933bf pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7456:1868795081664640:0@lo:253: 10000000:01000000:1.0:1782221972.115161:0:7456:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1782221972.115164:0:7456:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782221972.115166:0:7456:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1782221972.115167:0:7456:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782221972.115168:0:7456:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782221972.115169:0:7456:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782221972.115170:0:7456:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782221972.115171:0:7456:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782221972.115172:0:7456:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782221972.115173:0:7456:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782221972.115174:0:7456:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782221972.115176:0:7456:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1782221972.115187:0:7456:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1782221972.122187:0:7456:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:1.0:1782221972.122655:0:7456:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1782221972.122875:0:7456:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1782221972.123070:0:7456:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1782221972.123276:0:7456:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1782221972.123450:0:7456:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1782221972.124746:0:7456:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1782221972.125014:0:7456:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1782221972.125191:0:7456:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:3.0:1782221972.125400:0:7456:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1782221972.125614:0:7456:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:3.0:1782221972.125801:0:7456:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1782221972.127715:0:7456:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1782221972.128001:0:7487:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1782221972.128049:0:7487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005375793a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7487:1868795081665280:0@lo:700: 00000100:00100000:3.0:1782221972.128113:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221972.128162:0:7487:0:(client.c:2701:ptlrpc_set_wait()) set 00000000265cde15 going to sleep for 11 seconds 00000040:01000000:0.0:1782221972.128207:0:7456:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1782221972.128528:0:7488:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000038ca5162 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1868795081665408:0@lo:1000: 00000100:00100000:0.0:1782221972.128563:0:7488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221972.128607:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081665408 00000100:00100000:0.0:1782221972.128613:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081665408 00000100:00100000:0.0:1782221972.128651:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782221972.128658:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ecd1036 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7488:x1868795081665408:12345-0@lo:1000: 00000100:00100000:0.0:1782221972.128722:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ecd1036 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7488:x1868795081665408:12345-0@lo:1000: Request processed in 65us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221972.128729:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782221972.128755:0:7488:0:(client.c:2701:ptlrpc_set_wait()) set 000000006fab56fe going to sleep for 11 seconds 00000100:00100000:0.0:1782221972.128775:0:7488:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000038ca5162 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1868795081665408:0@lo:1000: 00000040:01000000:0.0:1782221972.128808:0:7488:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:0.0:1782221972.128826:0:7488:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000038ca5162 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1868795081665536:0@lo:700: 00000100:00100000:0.0:1782221972.128850:0:7488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221972.128862:0:7488:0:(client.c:2701:ptlrpc_set_wait()) set 000000003b38e7d8 going to sleep for 11 seconds 00000040:01000000:3.0:1782221972.129317:0:7456:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1782221972.129437:0:7456:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1782221972.129931:0:7456:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1782221972.129940:0:7456:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1782221972.130065:0:7456:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782221972.130743:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081665280 00000100:00100000:2.0:1782221972.130758:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081665280 00000100:00100000:2.0:1782221972.130802:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782221972.130810:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da4361e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7487:x1868795081665280:12345-0@lo:700: 00000100:00100000:2.0:1782221972.130953:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081665536 00000100:00100000:2.0:1782221972.130957:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081665536 00000100:00100000:2.0:1782221972.130979:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782221972.130984:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e4ca95c pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7488:x1868795081665536:12345-0@lo:700: 00000100:00100000:2.0:1782221972.131057:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e4ca95c pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7488:x1868795081665536:12345-0@lo:700: Request processed in 73us (2207us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221972.131063:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782221972.131136:0:7488:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000038ca5162 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1868795081665536:0@lo:700: 00000100:00100000:0.0:1782221972.131192:0:7488:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000038ca5162 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7488:1868795081665664:0@lo:900: 00000100:00100000:0.0:1782221972.131222:0:7488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221972.131280:0:7488:0:(client.c:2701:ptlrpc_set_wait()) set 000000003b38e7d8 going to sleep for 11 seconds 00000100:00100000:2.0:1782221972.131334:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081665664 00000100:00100000:2.0:1782221972.131338:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081665664 00000100:00100000:2.0:1782221972.131362:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782221972.131369:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071ef9b51 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7488:x1868795081665664:12345-0@lo:900: 00000100:00100000:2.0:1782221972.131411:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071ef9b51 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7488:x1868795081665664:12345-0@lo:900: Request processed in 42us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221972.131418:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1782221972.131486:0:7488:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000038ca5162 x1868795081665664/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1782221988 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782221972.131496:0:7488:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000038ca5162 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7488:1868795081665664:0@lo:900: 00000100:00100000:0.0:1782221972.131551:0:7488:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000038ca5162 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1868795081665792:0@lo:1000: 00000100:00100000:0.0:1782221972.131590:0:7488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221972.131612:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081665792 00000100:00100000:0.0:1782221972.131615:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081665792 00000100:00100000:0.0:1782221972.131637:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782221972.131643:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003e85176 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:7488:x1868795081665792:12345-0@lo:1000: 00000100:00100000:0.0:1782221972.131704:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003e85176 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:7488:x1868795081665792:12345-0@lo:1000: Request processed in 62us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221972.131711:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782221972.131735:0:7488:0:(client.c:2701:ptlrpc_set_wait()) set 000000004cca58ef going to sleep for 11 seconds 00000100:00100000:0.0:1782221972.131747:0:7488:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000038ca5162 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1868795081665792:0@lo:1000: 00000004:00080000:0.0:1782221972.131784:0:7488:0:(osp_trans.c:1593:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000003b38e7d8 with version 0 00000020:00100000:0.0:1782221972.131797:0:7488:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1782221972.131802:0:7488:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000038ca5162 x1868795081666048/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782221972.131819:0:7488:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000038ca5162 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1868795081666048:0@lo:1000: 00000100:00100000:0.0:1782221972.131844:0:7488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221972.131862:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081666048 00000100:00100000:0.0:1782221972.131866:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081666048 00000100:00100000:0.0:1782221972.131885:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782221972.131890:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a1901ea pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7488:x1868795081666048:12345-0@lo:1000: 00000100:00100000:0.0:1782221972.132146:0:7488:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c02a01bc going to sleep for 11 seconds 00000040:00080000:3.0:1782221972.132862:0:7456:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000020:00080000:1.0:1782221972.133370:0:7486:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1782221972.133374:0:7486:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:00080000:3.0:1782221972.133838:0:7456:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1782221972.133879:0:7456:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1782221972.134075:0:7456:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1782221972.134763:0:7456:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1782221972.135781:0:7456:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1782221972.135941:0:7456:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1782221972.136086:0:7456:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1782221972.136219:0:7456:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1782221972.137873:0:7456:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1782221972.138106:0:7456:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1782221972.138273:0:7456:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1782221972.138417:0:7456:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1782221972.138600:0:7456:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1782221972.138745:0:7456:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1782221972.138889:0:7456:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1782221972.139022:0:7456:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1782221972.139165:0:7456:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1782221972.139330:0:7456:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00000001:00080000:2.0:1782221972.139693:0:6505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 40000000:02000000:2.0:1782221972.139737:0:6533:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:1.0:1782221972.143770:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a1901ea pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7488:x1868795081666048:12345-0@lo:1000: Request processed in 11873us (11919us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1782221972.143785:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00100000:10000000:3.0:1782221972.144027:0:7456:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1782221972.144288:0:7456:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1782221972.144663:0:7456:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1782221972.144800:0:7456:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1782221972.144944:0:7456:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1782221972.145106:0:7456:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1782221972.145271:0:7456:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1782221972.145413:0:7456:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1782221972.145577:0:7456:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1782221972.145718:0:7456:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1782221972.145851:0:7456:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1782221972.145971:0:7456:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1782221972.146111:0:7456:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1782221972.146277:0:7456:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1782221972.146411:0:7456:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1782221972.146559:0:7456:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1782221972.146701:0:7456:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1782221972.146865:0:7456:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1782221972.147064:0:7456:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000004:00080000:1.0:1782221972.147268:0:7488:0:(osp_trans.c:1042:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1782221972.147273:0:7488:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1782221972.147291:0:7488:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000038ca5162 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1868795081666048:0@lo:1000: 00000100:00100000:1.0:1782221972.147381:0:7488:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c90933bf pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1868795081666176:0@lo:1000: 00000100:00100000:1.0:1782221972.147454:0:7488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221972.147502:0:7488:0:(client.c:2701:ptlrpc_set_wait()) set 00000000144a15f4 going to sleep for 11 seconds 00000100:00100000:0.0:1782221972.147583:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081666176 00000100:00100000:0.0:1782221972.147590:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081666176 00000100:00100000:0.0:1782221972.147640:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782221972.147647:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f74fd03f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7488:x1868795081666176:12345-0@lo:1000: 00000100:00100000:0.0:1782221972.147720:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f74fd03f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7488:x1868795081666176:12345-0@lo:1000: Request processed in 74us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221972.147728:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782221972.147756:0:7488:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c90933bf pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1868795081666176:0@lo:1000: 00000040:00080000:0.0:1782221972.147774:0:7488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1782221972.147799:0:7488:0:(osp_trans.c:1593:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000003b38e7d8 with version 1 00000040:00080000:0.0:1782221972.149822:0:7488:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1782221972.149911:0:7488:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1782221972.151392:0:7477:0:(osp_trans.c:1338:osp_get_next_request()) ou 000000009c6fffac version 1 rpc_version 1 00000020:00100000:3.0:1782221972.151440:0:7477:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1782221972.151450:0:7477:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000061eb092a x1868795081666432/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782221972.151473:0:7477:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000061eb092a pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7477:1868795081666432:0@lo:1000: 00000100:00100000:3.0:1782221972.151548:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221972.152489:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da4361e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7487:x1868795081665280:12345-0@lo:700: Request processed in 21677us (24373us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221972.152501:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1782221972.152555:0:7487:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005375793a x1868795081665280/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1782221988 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782221972.152570:0:7487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005375793a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7487:1868795081665280:0@lo:700: 40000000:02000000:2.0:1782221972.152583:0:7487:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000100:00100000:3.0:1782221972.153286:0:7477:0:(client.c:2701:ptlrpc_set_wait()) set 00000000411919ca going to sleep for 11 seconds 00000100:00100000:1.0:1782221972.155455:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081666432 00000100:00100000:1.0:1782221972.155467:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081666432 00000100:00100000:0.0:1782221972.158416:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782221972.158439:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1340f0f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7477:x1868795081666432:12345-0@lo:1000: 00000001:00080000:3.0:1782221972.161815:0:7456:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1782221972.161862:0:7456:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa0b981c8b988 00100000:10000000:3.0:1782221972.161870:0:7456:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1782221972.162370:0:7456:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1782221972.162401:0:7456:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.127@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1782221972.162418:0:7456:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1782221972.162457:0:7456:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1782221972.168992:0:7456:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782221972.169193:0:7456:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000001:00080000:2.0:1782221972.175336:0:6505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:3.0:1782221972.176194:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1340f0f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7477:x1868795081666432:12345-0@lo:1000: Request processed in 17747us (24636us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1782221972.176222:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000004:00080000:2.0:1782221972.176282:0:7477:0:(osp_trans.c:1042:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1782221972.176290:0:7477:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1782221972.176313:0:7477:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000061eb092a pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7477:1868795081666432:0@lo:1000: 00000040:00080000:0.0:1782221972.189716:0:7487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782221972.211900:0:7487:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1782221972.212061:0:7487:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1782221972.212068:0:7487:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000100:00100000:2.0:1782221972.970484:0:7473:0:(client.c:2701:ptlrpc_set_wait()) set 000000006bff0093 going to sleep for 0 seconds 00010000:00010000:3.0:1782221973.035374:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782221973.997634:0:7473:0:(client.c:2701:ptlrpc_set_wait()) set 000000006bff0093 going to sleep for 0 seconds 00010000:00010000:0.0:1782221974.063615:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782221975.019929:0:7473:0:(client.c:2701:ptlrpc_set_wait()) set 000000006bff0093 going to sleep for 0 seconds 00010000:00010000:2.0:1782221975.082333:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782221976.049309:0:7473:0:(client.c:2701:ptlrpc_set_wait()) set 000000006bff0093 going to sleep for 0 seconds 00010000:00010000:3.0:1782221976.112210:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782221976.115123:0:7732:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:0.0:1782221976.883197:0:7785:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782221976.883560:0:7785:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1782221977.066376:0:7473:0:(client.c:2701:ptlrpc_set_wait()) set 000000006bff0093 going to sleep for 0 seconds 00010000:00010000:1.0:1782221977.139957:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782221977.580726:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000000ce5ee2e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081666560:0@lo:41: 00000100:00100000:1.0:1782221977.580795:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221977.580864:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081666560 00000100:00100000:1.0:1782221977.580871:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081666560 00000100:00100000:1.0:1782221977.580916:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782221977.580924:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6c693b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081666560:12345-0@lo:41: 00000004:00000024:1.0:1782221977.580962:0:7480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1782221977.581015:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6c693b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081666560:12345-0@lo:41: Request processed in 91us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221977.581022:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782221977.581065:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000000ce5ee2e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081666560:0@lo:41: 00000100:00080000:3.0:1782221977.581179:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1782221977.581184:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1782221977.581186:0:37:0:(import.c:65:import_set_state_nolock()) 00000000ae5dbaf6 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782221977.581198:0:37:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000ae5dbaf6 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:3.0:1782221977.581217:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c8dd80da x1868795081666944/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782221977.581282:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c5c8e7a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1868795081666816:0@lo:400: 00000100:00100000:3.0:1782221977.581312:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221977.581334:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782221977.581339:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002d2ba0a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081666688:0@lo:400: 00000100:00100000:3.0:1782221977.581363:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221977.581399:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c8dd80da pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081666944:0@lo:38: 00000100:00100000:3.0:1782221977.581425:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221977.581455:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081666816 00000100:00100000:3.0:1782221977.581459:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081666816 00000100:00100000:3.0:1782221977.581488:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782221977.581495:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f76df0e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1868795081666816:12345-0@lo:400: 00000100:00100000:3.0:1782221977.581532:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f76df0e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1868795081666816:12345-0@lo:400: Request processed in 38us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221977.581538:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782221977.581557:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081666944 00000100:00100000:3.0:1782221977.581560:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081666944 00000100:00100000:3.0:1782221977.581577:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782221977.581581:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb841fcb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1868795081666944:12345-0@lo:38: 00010000:00080000:3.0:1782221977.581601:0:6531:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 176 last 0 00000020:00000080:3.0:1782221977.581634:0:6531:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe2b7cc26e6810f4c 00000004:00100000:3.0:1782221977.581647:0:6531:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1782221977.581652:0:6531:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1782221977.581714:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000018ca83bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1868795081667072:0@lo:400: 00000100:00100000:3.0:1782221977.581747:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221977.581773:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081667072 00000100:00100000:3.0:1782221977.581777:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081667072 00000100:00100000:3.0:1782221977.581796:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782221977.581801:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000022cf43d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1868795081667072:12345-0@lo:400: 00000100:00100000:3.0:1782221977.581831:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000022cf43d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1868795081667072:12345-0@lo:400: Request processed in 30us (85us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221977.581837:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1782221977.581859:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000018ca83bc x1868795081667072/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782221993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782221977.581869:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000018ca83bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1868795081667072:0@lo:400: 00010000:00080000:3.0:1782221977.581892:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000c5c8e7a3 x1868795081666816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782221993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782221977.581900:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c5c8e7a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1868795081666816:0@lo:400: 00000100:00100000:1.0:1782221977.582222:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081666688 00000100:00100000:1.0:1782221977.582226:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081666688 00000100:00100000:1.0:1782221977.582287:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1782221977.582293:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064029b1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:3656:x1868795081666688:12345-0@lo:400: 00000100:00100000:1.0:1782221977.582327:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064029b1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:3656:x1868795081666688:12345-0@lo:400: Request processed in 35us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221977.582333:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782221977.582478:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002d2ba0a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081666688:0@lo:400: 00000100:00080000:3.0:1782221977.597501:0:6531:0:(import.c:65:import_set_state_nolock()) 00000000e0d77e76 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782221977.597607:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb841fcb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3652:x1868795081666944:12345-0@lo:38: Request processed in 16023us (16180us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221977.597618:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1782221977.597735:0:3652:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1782221977.597756:0:3652:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xe2400010450010a0 00000100:00080000:1.0:1782221977.597762:0:3652:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1782221977.597764:0:3652:0:(import.c:65:import_set_state_nolock()) 00000000ae5dbaf6 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1782221977.597780:0:3652:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000006bff0093): req@000000005a73f709 x1868795081662080/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782221977.597798:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c8dd80da pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081666944:0@lo:38: 00000100:00100000:1.0:1782221977.598256:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001f998192 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081667200:0@lo:41: 00000100:00100000:1.0:1782221977.598289:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221977.598460:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081667200 00000100:00100000:2.0:1782221977.598468:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081667200 00000100:00100000:2.0:1782221977.598507:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782221977.598514:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ce5ee2e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3654:x1868795081667200:12345-0@lo:41: 00000004:00000024:2.0:1782221977.598540:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1782221977.598580:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ce5ee2e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3654:x1868795081667200:12345-0@lo:41: Request processed in 66us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221977.598586:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782221977.598659:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001f998192 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081667200:0@lo:41: 00000100:00100000:3.0:1782221977.598828:0:7473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221977.598852:0:7473:0:(client.c:2701:ptlrpc_set_wait()) set 000000006bff0093 going to sleep for 11 seconds 00000100:00100000:2.0:1782221977.598895:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081662080 00000100:00100000:2.0:1782221977.598900:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081662080 00000100:00100000:2.0:1782221977.598962:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782221977.598968:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d2ba0a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7473:x1868795081662080:12345-0@lo:1000: 00000100:00100000:2.0:1782221977.599030:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d2ba0a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7473:x1868795081662080:12345-0@lo:1000: Request processed in 63us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221977.599036:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782221977.599082:0:7473:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005a73f709 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7473:1868795081662080:0@lo:1000: 00000040:01000000:3.0:1782221977.599109:0:7473:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1782221977.599138:0:7473:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c5c8e7a3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7473:1868795081667328:0@lo:1000: 00000100:00100000:3.0:1782221977.599167:0:7473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221977.599266:0:7473:0:(client.c:2701:ptlrpc_set_wait()) set 000000009066549e going to sleep for 11 seconds 00000100:00100000:1.0:1782221977.599358:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081667328 00000100:00100000:1.0:1782221977.599362:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081667328 00000100:00100000:1.0:1782221977.599395:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782221977.599400:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018ca83bc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7473:x1868795081667328:12345-0@lo:1000: 00000100:00100000:1.0:1782221977.599499:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018ca83bc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7473:x1868795081667328:12345-0@lo:1000: Request processed in 99us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221977.599511:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782221977.599615:0:7473:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c5c8e7a3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7473:1868795081667328:0@lo:1000: 00000100:00100000:3.0:1782221977.599655:0:7473:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c5c8e7a3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7473:1868795081667456:0@lo:700: 00000100:00100000:3.0:1782221977.599680:0:7473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221977.599837:0:7473:0:(client.c:2701:ptlrpc_set_wait()) set 0000000001e7c4bd going to sleep for 11 seconds 00000100:00100000:2.0:1782221977.599869:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081667456 00000100:00100000:2.0:1782221977.599874:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081667456 00000100:00100000:2.0:1782221977.599937:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782221977.599944:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c8dd80da pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7473:x1868795081667456:12345-0@lo:700: 00000100:00100000:2.0:1782221977.599994:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c8dd80da pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7473:x1868795081667456:12345-0@lo:700: Request processed in 51us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221977.600000:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782221977.600052:0:7473:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c5c8e7a3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7473:1868795081667456:0@lo:700: 00000100:00100000:1.0:1782221977.600170:0:7473:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ae13906f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7473:1868795081667584:0@lo:1000: 00000100:00100000:1.0:1782221977.600198:0:7473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221977.600212:0:7473:0:(client.c:2701:ptlrpc_set_wait()) set 000000004118826c going to sleep for 11 seconds 00000100:00100000:1.0:1782221977.600308:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081667584 00000100:00100000:1.0:1782221977.600312:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081667584 00000100:00100000:1.0:1782221977.600336:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782221977.600341:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008009aaab pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7473:x1868795081667584:12345-0@lo:1000: 00000100:00100000:1.0:1782221977.600404:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008009aaab pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7473:x1868795081667584:12345-0@lo:1000: Request processed in 63us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221977.600411:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782221977.600437:0:7473:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ae13906f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7473:1868795081667584:0@lo:1000: 00000004:00080000:1.0:1782221977.600477:0:7473:0:(osp_trans.c:1593:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000421c13e0 with version 0 00000020:00100000:1.0:1782221977.600490:0:7473:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1782221977.600495:0:7473:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000ae13906f x1868795081667840/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782221977.600507:0:7473:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ae13906f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7473:1868795081667840:0@lo:1000: 00000100:00100000:1.0:1782221977.600531:0:7473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221977.600545:0:7473:0:(client.c:2701:ptlrpc_set_wait()) set 00000000413992ad going to sleep for 11 seconds 00000100:00100000:1.0:1782221977.600557:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081667840 00000100:00100000:1.0:1782221977.600560:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081667840 00000100:00100000:1.0:1782221977.600581:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782221977.600586:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005073586a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7473:x1868795081667840:12345-0@lo:1000: 00000001:00080000:1.0:1782221977.602223:0:7458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:1.0:1782221977.602376:0:7458:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1782221977.602520:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005073586a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7473:x1868795081667840:12345-0@lo:1000: Request processed in 1931us (1987us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1782221977.602539:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:1.0:1782221977.602608:0:7473:0:(osp_trans.c:1042:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1782221977.602612:0:7473:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1782221977.602625:0:7473:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ae13906f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7473:1868795081667840:0@lo:1000: 00000100:00100000:1.0:1782221977.602702:0:7473:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ae13906f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7473:1868795081667968:0@lo:1000: 00000100:00100000:1.0:1782221977.602736:0:7473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221977.602865:0:7473:0:(client.c:2701:ptlrpc_set_wait()) set 0000000011f2f22b going to sleep for 11 seconds 00000100:00100000:3.0:1782221977.603026:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081667968 00000100:00100000:3.0:1782221977.603031:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081667968 00000100:00100000:3.0:1782221977.603103:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782221977.603111:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed424db6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7473:x1868795081667968:12345-0@lo:1000: 00000100:00100000:3.0:1782221977.603186:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed424db6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7473:x1868795081667968:12345-0@lo:1000: Request processed in 77us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221977.603193:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782221977.603265:0:7473:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ae13906f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7473:1868795081667968:0@lo:1000: 00000040:00080000:1.0:1782221977.603286:0:7473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1782221977.603317:0:7473:0:(osp_trans.c:1593:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000421c13e0 with version 1 00000040:00080000:1.0:1782221977.605479:0:7473:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1782221977.605551:0:7473:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 6, retries 0 00000004:00080000:1.0:1782221977.605556:0:7473:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00080000:1.0:1782221977.605636:0:7471:0:(osp_trans.c:1338:osp_get_next_request()) ou 00000000c1ab8a75 version 1 rpc_version 1 00000020:00100000:1.0:1782221977.605666:0:7471:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1782221977.605675:0:7471:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000ae13906f x1868795081668224/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782221977.605696:0:7471:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ae13906f pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7471:1868795081668224:0@lo:1000: 00000100:00100000:1.0:1782221977.605755:0:7471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221977.606155:0:7471:0:(client.c:2701:ptlrpc_set_wait()) set 0000000011f2f22b going to sleep for 11 seconds 00000100:00100000:2.0:1782221977.606191:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081668224 00000100:00100000:2.0:1782221977.606204:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081668224 00000100:00100000:2.0:1782221977.606397:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782221977.606406:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c90933bf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7471:x1868795081668224:12345-0@lo:1000: 00000001:00080000:1.0:1782221977.615552:0:7458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:3.0:1782221977.616430:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c90933bf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7471:x1868795081668224:12345-0@lo:1000: Request processed in 10021us (10670us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1782221977.616443:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:1.0:1782221977.616502:0:7471:0:(osp_trans.c:1042:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1782221977.616508:0:7471:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1782221977.616523:0:7471:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ae13906f pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7471:1868795081668224:0@lo:1000: 00010000:00010000:2.0:1782221978.154518:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782221979.180907:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1782221979.541554:0:7886:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782221979.541777:0:7886:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1782221980.206517:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782221980.500369:0:7934:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe48c70f40 20000000:00000080:2.0:1782221980.500385:0:7934:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f087fb4b000 uarg=0000000000000000 20000000:01000000:2.0:1782221980.500436:0:7934:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1782221980.500559:0:7934:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1782221980.500565:0:7934:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1782221980.500647:0:7934:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1782221980.500660:0:7934:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1782221980.509831:0:7934:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782221980.512029:0:7934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1782221980.512077:0:7934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1782221980.512097:0:7934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1782221980.512115:0:7934:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1782221980.512133:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000bc082185/0xe2b7cc26e6810f53 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221980.512151:0:7934:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000045e7c2e5/0xe2b7cc26e6810dee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810de7 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221980.512158:0:7934:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a53b3067/0xe2b7cc26e6810f1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810f14 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221980.512165:0:7934:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000bc082185/0xe2b7cc26e6810f53 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221980.512202:0:7934:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a53b3067/0xe2b7cc26e6810f1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e6810f14 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221980.512215:0:7934:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a53b3067/0xe2b7cc26e6810f1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e6810f14 expref: 15 pid: 6520 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221980.512272:0:7934:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000da76a15a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7934:1868795081668352:0@lo:104: 00000100:00100000:2.0:1782221980.512346:0:7934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782221980.512408:0:7934:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000045e7c2e5/0xe2b7cc26e6810dee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e6810de7 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221980.512417:0:7934:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000045e7c2e5/0xe2b7cc26e6810dee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e6810de7 expref: 15 pid: 6521 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221980.512425:0:7934:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006e221935 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7934:1868795081668480:0@lo:104: 00000100:00100000:2.0:1782221980.512443:0:7934:0:(client.c:2701:ptlrpc_set_wait()) set 00000000941a951a going to sleep for 11 seconds 00000100:00100000:0.0:1782221980.512670:0:6510:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782221980.512689:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221980.512718:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081668352 00000100:00100000:0.0:1782221980.512725:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081668352 00000100:00100000:0.0:1782221980.512756:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081668480 00000100:00100000:0.0:1782221980.512758:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081668480 00000100:00100000:0.0:1782221980.512772:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782221980.512779:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e315b76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+4:7934:x1868795081668352:12345-0@lo:104: 00010000:00010000:0.0:1782221980.512791:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: 00000000f6344b0b/0xe2b7cc26e6810f14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810f1b expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221980.512843:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782221980.512847:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e315b76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+4:7934:x1868795081668352:12345-0@lo:104: Request processed in 69us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221980.512853:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782221980.512885:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782221980.512891:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c22bd882 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+3:7934:x1868795081668480:12345-0@lo:104: 00010000:00010000:0.0:1782221980.512897:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: 00000000e860d6b9/0xe2b7cc26e6810de7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810dee expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221980.512929:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1782221980.512933:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c22bd882 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+3:7934:x1868795081668480:12345-0@lo:104: Request processed in 44us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221980.512946:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1782221980.512963:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782221980.512967:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: 00000000f6344b0b/0xe2b7cc26e6810f14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810f1b expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221980.512975:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f6344b0b already unused, calling callback (00000000a10b8087) 10000000:00010000:0.0:1782221980.512977:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: 00000000f6344b0b/0xe2b7cc26e6810f14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e6810f1b expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221980.512985:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: 00000000f6344b0b/0xe2b7cc26e6810f14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e6810f1b expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782221980.512990:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: 00000000f6344b0b/0xe2b7cc26e6810f14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e6810f1b expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782221980.512995:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782221980.513020:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: 00000000f6344b0b/0xe2b7cc26e6810f14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810f1b expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221980.513026:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782221980.513042:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: 00000000f6344b0b/0xe2b7cc26e6810f14 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810f1b expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221980.513048:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: 00000000f6344b0b/0xe2b7cc26e6810f14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810f1b expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221980.513061:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782221980.513063:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: 00000000e860d6b9/0xe2b7cc26e6810de7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810dee expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221980.513078:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e860d6b9 already unused, calling callback (00000000a10b8087) 10000000:00010000:0.0:1782221980.513080:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: 00000000e860d6b9/0xe2b7cc26e6810de7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e6810dee expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221980.513086:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: 00000000e860d6b9/0xe2b7cc26e6810de7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e6810dee expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782221980.513092:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: 00000000e860d6b9/0xe2b7cc26e6810de7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e6810dee expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782221980.513097:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782221980.513111:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: 00000000e860d6b9/0xe2b7cc26e6810de7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810dee expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221980.513117:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782221980.513121:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: 00000000e860d6b9/0xe2b7cc26e6810de7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810dee expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221980.513126:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: 00000000e860d6b9/0xe2b7cc26e6810de7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810dee expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221980.513139:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782221980.513140:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782221980.513142:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782221980.513147:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782221980.513217:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000014e0b2db pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081668608:0@lo:103: 00000100:00100000:1.0:1782221980.513280:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221980.513306:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782221980.513311:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000533cc840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081668736:0@lo:103: 00000100:00100000:1.0:1782221980.513330:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221980.513354:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081668608 00000100:00100000:1.0:1782221980.513366:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081668608 00010000:00010000:1.0:1782221980.513383:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a53b3067/0xe2b7cc26e6810f1b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810f14 expref: 16 pid: 6520 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782221980.513403:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081668736 00000100:00100000:1.0:1782221980.513406:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081668736 00010000:00010000:1.0:1782221980.513414:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000045e7c2e5/0xe2b7cc26e6810dee lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810de7 expref: 17 pid: 6521 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782221980.513428:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782221980.513432:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae13906f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:3655:x1868795081668608:12345-0@lo:103: 00010000:00010000:1.0:1782221980.513442:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782221980.513445:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a53b3067/0xe2b7cc26e6810f1b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810f14 expref: 17 pid: 6520 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221980.513454:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a53b3067/0xe2b7cc26e6810f1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e6810f14 expref: 17 pid: 6520 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221980.513468:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782221980.513493:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae13906f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:3655:x1868795081668608:12345-0@lo:103: Request processed in 61us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221980.513499:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782221980.513512:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782221980.513517:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000532bd497 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:3655:x1868795081668736:12345-0@lo:103: 00010000:00010000:1.0:1782221980.513532:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782221980.513536:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000045e7c2e5/0xe2b7cc26e6810dee lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810de7 expref: 16 pid: 6521 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221980.513544:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000045e7c2e5/0xe2b7cc26e6810dee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e6810de7 expref: 16 pid: 6521 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221980.513554:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000bc082185/0xe2b7cc26e6810f53 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221980.513560:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bc082185/0xe2b7cc26e6810f53 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221980.513571:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bc082185/0xe2b7cc26e6810f53 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221980.513577:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bc082185/0xe2b7cc26e6810f53 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221980.513582:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000bc082185/0xe2b7cc26e6810f53 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221980.513587:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000bc082185/0xe2b7cc26e6810f53 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221980.513593:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bc082185 already unused, calling callback (0000000068110196) 00010000:00010000:1.0:1782221980.513596:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000bc082185/0xe2b7cc26e6810f53 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221980.513601:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000bc082185/0xe2b7cc26e6810f53 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221980.513618:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000bc082185/0xe2b7cc26e6810f53 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221980.513627:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782221980.513648:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000532bd497 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:3655:x1868795081668736:12345-0@lo:103: Request processed in 131us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221980.513653:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782221980.513684:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000533cc840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081668736:0@lo:103: 00000100:00100000:1.0:1782221980.513691:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000014e0b2db pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081668608:0@lo:103: 00010000:00010000:2.0:1782221980.514071:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a53b3067/0xe2b7cc26e6810f1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e6810f14 expref: 15 pid: 6520 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221980.514082:0:7934:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000da76a15a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7934:1868795081668352:0@lo:104: 00010000:00010000:2.0:1782221980.514289:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000045e7c2e5/0xe2b7cc26e6810dee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e6810de7 expref: 14 pid: 6521 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221980.514300:0:7934:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006e221935 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7934:1868795081668480:0@lo:104: 00010000:00010000:2.0:1782221980.514315:0:7934:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000bc082185/0xe2b7cc26e6810f53 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221980.514323:0:7934:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000bc082185/0xe2b7cc26e6810f53 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221980.514329:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000bc082185/0xe2b7cc26e6810f53 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221980.514334:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bc082185/0xe2b7cc26e6810f53 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221981.226586:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782221981.997388:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1782221981.997395:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8f0849b46800 from 4 10000000:01000000:2.0:1782221981.997400:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782221981.997444:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: 00000000c5b0b3d8/0xe2b7cc26e6810f5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221981.997456:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: 00000000c5b0b3d8/0xe2b7cc26e6810f5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221981.997467:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: 00000000c5b0b3d8/0xe2b7cc26e6810f5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221981.997490:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006e221935 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081668864:0@lo:101: 00000100:00100000:2.0:1782221981.997566:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221981.997612:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set 00000000941a951a going to sleep for 11 seconds 00000100:00100000:1.0:1782221981.997674:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081668864 00000100:00100000:1.0:1782221981.997681:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081668864 00000100:00100000:1.0:1782221981.997735:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782221981.997743:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001358116a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+14:6523:x1868795081668864:12345-0@lo:101: 00010000:00010000:1.0:1782221981.997764:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782221981.997775:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cf9a5a84/0xe2b7cc26e6810f61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6810f5a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221981.997806:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cf9a5a84/0xe2b7cc26e6810f61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6810f5a expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221981.997816:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cf9a5a84/0xe2b7cc26e6810f61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810f5a expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221981.997824:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cf9a5a84, rc 0) 00000100:00100000:1.0:1782221981.997872:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001358116a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:6523:x1868795081668864:12345-0@lo:101: Request processed in 129us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221981.997879:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782221981.998032:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006e221935 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081668864:0@lo:101: 00010000:00010000:3.0:1782221981.998046:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: 00000000c5b0b3d8/0xe2b7cc26e6810f5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810f61 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221981.998054:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: 00000000c5b0b3d8/0xe2b7cc26e6810f5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6810f61 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782221981.998103:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000061eb092a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081668992:0@lo:256: 00000100:00100000:3.0:1782221981.998139:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221981.998165:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set 00000000848c4b80 going to sleep for 11 seconds 00000100:00100000:1.0:1782221981.998329:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081668992 00000100:00100000:1.0:1782221981.998334:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081668992 00000100:00100000:1.0:1782221981.998377:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782221981.998384:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000570e1032 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:6523:x1868795081668992:12345-0@lo:256: 20000000:01000000:1.0:1782221981.998397:0:6521:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1782221981.998412:0:6521:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1782221981.998415:0:6521:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1782221981.998487:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000570e1032 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:6523:x1868795081668992:12345-0@lo:256: Request processed in 104us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221981.998505:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782221981.998537:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000061eb092a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081668992:0@lo:256: 10000000:01000000:1.0:1782221981.998577:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782221981.998583:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: 00000000c5b0b3d8/0xe2b7cc26e6810f5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810f61 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221981.998590:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: 00000000c5b0b3d8/0xe2b7cc26e6810f5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810f61 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782221981.998599:0:6523:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782221981.998600:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f0849b46800 from 1 10000000:01000000:1.0:1782221981.998602:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782221981.998619:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: 00000000a717179b/0xe2b7cc26e6810f68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221981.998624:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: 00000000a717179b/0xe2b7cc26e6810f68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221981.998630:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: 00000000a717179b/0xe2b7cc26e6810f68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782221981.998650:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001993a376 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081669120:0@lo:101: 00000100:00100000:1.0:1782221981.998672:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221981.998690:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b1c647ed going to sleep for 11 seconds 00000100:00100000:1.0:1782221981.998701:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081669120 00000100:00100000:1.0:1782221981.998704:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081669120 00000100:00100000:1.0:1782221981.998719:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1782221981.998723:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006969cb7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:6523:x1868795081669120:12345-0@lo:101: 00010000:00010000:1.0:1782221981.998730:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782221981.998739:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008688c264/0xe2b7cc26e6810f6f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6810f68 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221981.998764:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008688c264/0xe2b7cc26e6810f6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6810f68 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221981.998771:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008688c264/0xe2b7cc26e6810f6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810f68 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221981.998777:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008688c264, rc 0) 00000100:00100000:1.0:1782221981.999022:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006969cb7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:6523:x1868795081669120:12345-0@lo:101: Request processed in 298us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221981.999029:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1782221981.999101:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001993a376 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081669120:0@lo:101: 00010000:00010000:3.0:1782221981.999111:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: 00000000a717179b/0xe2b7cc26e6810f68 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810f6f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221981.999117:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: 00000000a717179b/0xe2b7cc26e6810f68 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6810f6f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782221981.999180:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005375793a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081669248:0@lo:501: 00000100:00100000:3.0:1782221981.999205:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221981.999228:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e7704c31 going to sleep for 11 seconds 00000100:00100000:2.0:1782221981.999336:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081669248 00000100:00100000:2.0:1782221981.999341:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081669248 00000100:00100000:2.0:1782221981.999385:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1782221981.999392:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dd9ab023 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:6523:x1868795081669248:12345-0@lo:501: 00000100:00100000:2.0:1782221981.999507:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dd9ab023 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:6523:x1868795081669248:12345-0@lo:501: Request processed in 104us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221981.999514:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1782221981.999543:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005375793a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081669248:0@lo:501: 00000100:00100000:2.0:1782221981.999570:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000da76a15a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081669376:0@lo:503: 00000100:00100000:2.0:1782221981.999607:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221981.999625:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set 0000000033e53755 going to sleep for 11 seconds 00000100:00100000:2.0:1782221981.999635:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081669376 00000100:00100000:2.0:1782221981.999643:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081669376 00000100:00100000:2.0:1782221981.999658:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1782221981.999663:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b623b820 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:6523:x1868795081669376:12345-0@lo:503: 00000100:00100000:2.0:1782221981.999727:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b623b820 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:6523:x1868795081669376:12345-0@lo:503: Request processed in 64us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221981.999734:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1782221981.999778:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000da76a15a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081669376:0@lo:503: 00000100:00100000:2.0:1782221982.000963:0:7995:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000da76a15a pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7995:1868795081669504:0@lo:502: 00000100:00100000:2.0:1782221982.001018:0:7995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221982.001053:0:7995:0:(client.c:2701:ptlrpc_set_wait()) set 000000007287ebdb going to sleep for 11 seconds 00000100:00100000:3.0:1782221982.001110:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081669504 00000100:00100000:3.0:1782221982.001116:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081669504 00000100:00100000:3.0:1782221982.001155:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1782221982.001161:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013603731 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:7995:x1868795081669504:12345-0@lo:502: 00000100:00100000:3.0:1782221982.001303:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013603731 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:7995:x1868795081669504:12345-0@lo:502: Request processed in 142us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221982.001311:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1782221982.001664:0:7995:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000da76a15a pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7995:1868795081669504:0@lo:502: 00000020:01000000:2.0:1782221982.001689:0:7995:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782221982.001698:0:7995:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782221982.001700:0:7995:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1782221982.001710:0:7995:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f0849b46800 00000020:00000080:2.0:1782221982.001713:0:7995:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1782221982.002362:0:7995:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b16680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7995:1868795081669632:0@lo:502: 00000100:00100000:2.0:1782221982.002412:0:7995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221982.002447:0:7995:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08428fc780 going to sleep for 11 seconds 00000100:00100000:1.0:1782221982.002624:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081669632 00000100:00100000:1.0:1782221982.002630:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081669632 00000100:00100000:1.0:1782221982.002675:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1782221982.002683:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:7995:x1868795081669632:12345-0@lo:502: 00000100:00100000:1.0:1782221982.002914:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:7995:x1868795081669632:12345-0@lo:502: Request processed in 231us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221982.002929:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1782221982.003092:0:7995:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b16680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7995:1868795081669632:0@lo:502: 00000020:01000000:2.0:1782221982.003117:0:7995:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782221982.003124:0:7995:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782221982.003126:0:7995:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1782221982.003131:0:7995:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1782221982.004740:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1782221982.004794:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782221982.004806:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f08427df400/0xe2b7cc26e6810f68 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810f6f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221982.004817:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f08427df400/0xe2b7cc26e6810f68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810f6f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782221982.004827:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1782221982.004829:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8f08490d0000 from 4 10000000:01000000:1.0:1782221982.004832:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782221982.004866:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f08427df800/0xe2b7cc26e6810f76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221982.004874:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f08427df800/0xe2b7cc26e6810f76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221982.004884:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f08427df800/0xe2b7cc26e6810f76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782221982.004905:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b785c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081669760:0@lo:101: 00000100:00100000:1.0:1782221982.004959:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221982.004999:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875bfca80 going to sleep for 11 seconds 00000100:00100000:3.0:1782221982.005110:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081669760 00000100:00100000:3.0:1782221982.005117:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081669760 00000100:00100000:3.0:1782221982.005160:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1782221982.005169:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:6523:x1868795081669760:12345-0@lo:101: 00010000:00010000:3.0:1782221982.005182:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782221982.005194:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0841458600/0xe2b7cc26e6810f7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6810f76 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221982.005217:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0841458600/0xe2b7cc26e6810f7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6810f76 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221982.005269:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0841458600/0xe2b7cc26e6810f7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810f76 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221982.005279:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0841458600, rc 0) 00000100:00100000:3.0:1782221982.005323:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:6523:x1868795081669760:12345-0@lo:101: Request processed in 156us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221982.005331:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1782221982.005429:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b785c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081669760:0@lo:101: 00010000:00010000:2.0:1782221982.005448:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f08427df800/0xe2b7cc26e6810f76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810f7d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221982.005463:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f08427df800/0xe2b7cc26e6810f76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6810f7d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221982.005578:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b16680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081669888:0@lo:256: 00000100:00100000:2.0:1782221982.005611:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221982.005677:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08428fc780 going to sleep for 11 seconds 00000100:00100000:3.0:1782221982.006807:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081669888 00000100:00100000:3.0:1782221982.006817:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081669888 00000100:00100000:3.0:1782221982.006870:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1782221982.006879:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:6523:x1868795081669888:12345-0@lo:256: 20000000:01000000:3.0:1782221982.006899:0:6519:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1782221982.006919:0:6519:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1782221982.006923:0:6519:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1782221982.007223:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:6523:x1868795081669888:12345-0@lo:256: Request processed in 344us (1610us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221982.007231:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1782221982.008649:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b16680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081669888:0@lo:256: 10000000:01000000:2.0:1782221982.008706:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1782221982.008716:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f08427df800/0xe2b7cc26e6810f76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810f7d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221982.008728:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f08427df800/0xe2b7cc26e6810f76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810f7d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782221982.008737:0:6523:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782221982.008739:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f08490d0000 from 1 10000000:01000000:2.0:1782221982.008741:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782221982.008772:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb83000/0xe2b7cc26e6810f84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221982.008780:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f087fb83000/0xe2b7cc26e6810f84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221982.008878:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f087fb83000/0xe2b7cc26e6810f84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221982.008896:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b16680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081670016:0@lo:101: 00000100:00100000:2.0:1782221982.008944:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221982.009076:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08428fc780 going to sleep for 11 seconds 00000100:00100000:3.0:1782221982.016896:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081670016 00000100:00100000:3.0:1782221982.016912:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081670016 00000100:00100000:3.0:1782221982.016972:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1782221982.016981:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:6523:x1868795081670016:12345-0@lo:101: 00010000:00010000:3.0:1782221982.016998:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782221982.017017:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0841459800/0xe2b7cc26e6810f8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6810f84 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221982.017043:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0841459800/0xe2b7cc26e6810f8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6810f84 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221982.017070:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0841459800/0xe2b7cc26e6810f8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810f84 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221982.017080:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0841459800, rc 0) 00000100:00100000:3.0:1782221982.017156:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:6523:x1868795081670016:12345-0@lo:101: Request processed in 176us (8211us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221982.017162:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1782221982.017222:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b16680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081670016:0@lo:101: 00010000:00010000:3.0:1782221982.017256:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f087fb83000/0xe2b7cc26e6810f84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810f8b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221982.017264:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f087fb83000/0xe2b7cc26e6810f84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6810f8b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782221982.017336:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081670144:0@lo:501: 00000100:00100000:3.0:1782221982.017378:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221982.017404:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08492a1900 going to sleep for 11 seconds 00000100:00100000:3.0:1782221982.017416:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081670144 00000100:00100000:3.0:1782221982.017419:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081670144 00000100:00100000:3.0:1782221982.017436:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1782221982.017441:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:6523:x1868795081670144:12345-0@lo:501: 00000100:00100000:3.0:1782221982.017952:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:6523:x1868795081670144:12345-0@lo:501: Request processed in 508us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221982.017959:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1782221982.020935:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081670144:0@lo:501: 00000100:00100000:2.0:1782221982.020995:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b17800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081670272:0@lo:503: 00000100:00100000:2.0:1782221982.021066:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221982.021110:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08428fc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782221982.021156:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081670272 00000100:00100000:0.0:1782221982.021163:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081670272 00000100:00100000:0.0:1782221982.021210:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1782221982.021218:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:6523:x1868795081670272:12345-0@lo:503: 00000100:00100000:0.0:1782221982.021375:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:6523:x1868795081670272:12345-0@lo:503: Request processed in 157us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221982.021383:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782221982.021391:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b17800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081670272:0@lo:503: 00000100:00100000:0.0:1782221982.021981:0:7996:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849bad180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7996:1868795081670400:0@lo:502: 00000100:00100000:0.0:1782221982.022020:0:7996:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221982.022058:0:7996:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b778840 going to sleep for 11 seconds 00000100:00100000:1.0:1782221982.022331:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081670400 00000100:00100000:1.0:1782221982.022338:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081670400 00000100:00100000:1.0:1782221982.022379:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782221982.022388:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:7996:x1868795081670400:12345-0@lo:502: 00000100:00100000:1.0:1782221982.022482:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:7996:x1868795081670400:12345-0@lo:502: Request processed in 95us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221982.022488:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1782221982.022580:0:7996:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849bad180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7996:1868795081670400:0@lo:502: 00000020:01000000:1.0:1782221982.022638:0:7996:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782221982.022649:0:7996:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782221982.022651:0:7996:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1782221982.022662:0:7996:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f08490d0000 00000020:00000080:1.0:1782221982.022665:0:7996:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1782221982.022688:0:7996:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b786a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7996:1868795081670528:0@lo:502: 00000100:00100000:1.0:1782221982.022722:0:7996:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221982.022884:0:7996:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875bfccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782221982.032261:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081670528 00000100:00100000:0.0:1782221982.032273:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081670528 00000100:00100000:1.0:1782221982.032709:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1782221982.032721:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:7996:x1868795081670528:12345-0@lo:502: 00000100:00100000:1.0:1782221982.033986:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:7996:x1868795081670528:12345-0@lo:502: Request processed in 1260us (11256us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221982.033996:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1782221982.034317:0:7996:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b786a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:7996:1868795081670528:0@lo:502: 00000020:01000000:3.0:1782221982.034364:0:7996:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782221982.034380:0:7996:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782221982.034382:0:7996:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1782221982.034386:0:7996:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1782221982.035327:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1782221982.035365:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782221982.035377:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb83000/0xe2b7cc26e6810f84 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810f8b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221982.035389:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f087fb83000/0xe2b7cc26e6810f84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810f8b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221982.255362:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782221982.701653:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782221982.701679:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081670656:0@lo:41: 00000100:00100000:0.0:1782221982.701748:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221982.701794:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081670656 00000100:00100000:0.0:1782221982.701801:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081670656 00000100:00100000:0.0:1782221982.701845:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782221982.701853:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081670656:12345-0@lo:41: 00000004:00000024:0.0:1782221982.701885:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1782221982.701927:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081670656:12345-0@lo:41: Request processed in 74us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221982.701934:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782221982.701976:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081670656:0@lo:41: 00000100:00100000:3.0:1782221982.702336:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782221982.702356:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081670784:0@lo:400: 00000100:00100000:3.0:1782221982.702389:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221982.702418:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081670912:0@lo:400: 00000100:00100000:3.0:1782221982.702441:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221982.702458:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782221982.702463:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1868795081671040:0@lo:400: 00000100:00100000:3.0:1782221982.702484:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221982.702519:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081670784 00000100:00100000:3.0:1782221982.702523:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081670784 00000100:00100000:3.0:1782221982.702549:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081671040 00000100:00100000:3.0:1782221982.702551:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081671040 00000100:00100000:3.0:1782221982.702563:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782221982.702569:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0875aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081670784:12345-0@lo:400: 00000100:00100000:3.0:1782221982.702604:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0875aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081670784:12345-0@lo:400: Request processed in 34us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221982.702610:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782221982.702623:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782221982.702629:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0875aadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1868795081671040:12345-0@lo:400: 00000100:00100000:3.0:1782221982.702657:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0875aadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1868795081671040:12345-0@lo:400: Request processed in 29us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221982.702662:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782221982.702677:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081670912 00000100:00100000:3.0:1782221982.702680:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081670912 00000100:00100000:3.0:1782221982.702715:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782221982.702721:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0875aafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081670912:12345-0@lo:400: 00000100:00100000:3.0:1782221982.702763:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0875aafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081670912:12345-0@lo:400: Request processed in 41us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221982.702772:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1782221982.702805:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0875aac700 x1868795081670784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782221998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782221982.702816:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081670784:0@lo:400: 00010000:00080000:3.0:1782221982.702837:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0875aadf80 x1868795081671040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782221998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782221982.702845:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1868795081671040:0@lo:400: 00000100:00100000:3.0:1782221982.702852:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081670912:0@lo:400: 00000100:00100000:2.0:1782221982.703924:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782221982.703940:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081671168:0@lo:41: 00000100:00100000:2.0:1782221982.703983:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221982.704012:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081671168 00000100:00100000:2.0:1782221982.704018:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081671168 00000100:00100000:2.0:1782221982.704045:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782221982.704051:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081671168:12345-0@lo:41: 00000004:00000024:2.0:1782221982.704075:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1782221982.704107:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081671168:12345-0@lo:41: Request processed in 55us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221982.704113:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782221982.704144:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081671168:0@lo:41: 00010000:00010000:3.0:1782221983.276166:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782221984.299863:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782221985.334391:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782221986.348846:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782221987.383838:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782221987.818803:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081671680:0@lo:400: 00000100:00100000:3.0:1782221987.818937:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221987.819008:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782221987.819014:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081671296:0@lo:400: 00000100:00100000:3.0:1782221987.819043:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221987.819062:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1868795081671808:0@lo:400: 00000100:00100000:3.0:1782221987.819083:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221987.819107:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1868795081671424:0@lo:400: 00000100:00100000:3.0:1782221987.819128:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221987.819142:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782221987.819160:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081671552:0@lo:400: 00000100:00100000:3.0:1782221987.819189:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221987.819218:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081671680 00000100:00100000:3.0:1782221987.819226:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081671680 00000100:00100000:3.0:1782221987.819296:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081671552 00000100:00100000:3.0:1782221987.819300:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081671552 00000100:00100000:3.0:1782221987.819334:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782221987.819344:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081671680:12345-0@lo:400: 00000100:00100000:3.0:1782221987.819412:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081671680:12345-0@lo:400: Request processed in 69us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221987.819420:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782221987.819439:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782221987.819445:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081671552:12345-0@lo:400: 00000100:00100000:3.0:1782221987.819477:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081671552:12345-0@lo:400: Request processed in 33us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221987.819483:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782221987.819501:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081671808 00000100:00100000:3.0:1782221987.819505:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081671808 00000100:00100000:3.0:1782221987.819528:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081671424 00000100:00100000:3.0:1782221987.819532:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081671424 00000100:00100000:3.0:1782221987.819544:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782221987.819550:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1868795081671808:12345-0@lo:400: 00000100:00100000:3.0:1782221987.819578:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1868795081671808:12345-0@lo:400: Request processed in 28us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221987.819583:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782221987.819593:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782221987.819597:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1868795081671424:12345-0@lo:400: 00000100:00100000:3.0:1782221987.819617:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1868795081671424:12345-0@lo:400: Request processed in 19us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221987.819628:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782221987.819679:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081671552:0@lo:400: 00010000:00080000:3.0:1782221987.819694:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0875aadf80 x1868795081671424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782221987.819705:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1868795081671424:0@lo:400: 00010000:00080000:3.0:1782221987.819738:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0875aad500 x1868795081671808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782221987.819746:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1868795081671808:0@lo:400: 00000100:00100000:3.0:1782221987.819754:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081671680:0@lo:400: 00000100:00100000:0.0:1782221987.820636:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081671936:0@lo:41: 00000100:00100000:0.0:1782221987.820696:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221987.820848:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081671936 00000100:00100000:3.0:1782221987.820857:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081671936 00000100:00100000:3.0:1782221987.820890:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782221987.820898:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849bad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081671936:12345-0@lo:41: 00000004:00000024:3.0:1782221987.820948:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1782221987.821010:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849bad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081671936:12345-0@lo:41: Request processed in 111us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221987.821018:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782221987.821941:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081671936:0@lo:41: 00000100:00100000:2.0:1782221987.827360:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081671296 00000100:00100000:2.0:1782221987.827382:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081671296 00000100:00100000:2.0:1782221987.827457:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1782221987.827470:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:3653:x1868795081671296:12345-0@lo:400: 00000100:00100000:2.0:1782221987.827593:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:3653:x1868795081671296:12345-0@lo:400: Request processed in 125us (8547us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221987.827602:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1782221987.827683:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081671296:0@lo:400: 00000100:00100000:3.0:1782221987.830133:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782221987.830175:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b784a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081672064:0@lo:41: 00000100:00100000:3.0:1782221987.830283:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221987.830648:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081672064 00000100:00100000:1.0:1782221987.830658:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081672064 00000100:00100000:1.0:1782221987.830724:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1782221987.830815:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081672064:12345-0@lo:41: 00000004:00000024:1.0:1782221987.830864:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1782221987.831049:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b784a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081672064:0@lo:41: 00000100:00100000:1.0:1782221987.831105:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081672064:12345-0@lo:41: Request processed in 291us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221987.831114:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1782221988.395825:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782221989.420984:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1782221990.212735:0:8434:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1782221990.212739:0:8434:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1782221990.212740:0:8434:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1782221990.212886:0:8434:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8f087fb98800 00000020:01000004:2.0:1782221990.212901:0:8434:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1782221990.212914:0:8434:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1782221990.212927:0:8434:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8f087fb90000) 00000020:00000080:2.0:1782221990.212941:0:8434:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1782221990.257688:0:8434:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1782221990.257749:0:8434:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:0.0:1782221990.282090:0:8434:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1782221990.282575:0:8434:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1782221990.282588:0:8434:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1782221990.282600:0:8434:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe2b7cc26e6810f99 00000020:01000004:0.0:1782221990.282606:0:8434:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1782221990.282628:0:8434:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.127@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1782221990.282632:0:8434:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1782221990.282638:0:8434:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1782221990.282643:0:8434:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1782221990.282655:0:8434:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8f087f93cd40) 00000020:00000080:0.0:1782221990.282665:0:8434:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:0.0:1782221990.287570:0:8434:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782221990.288045:0:8434:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1782221990.288052:0:8434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1782221990.292417:0:8434:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1782221990.292431:0:8434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1782221990.294558:0:8434:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1782221990.294568:0:8434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1782221990.305002:0:8434:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782221990.305257:0:8434:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1782221990.305263:0:8434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1782221990.306570:0:8434:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1782221990.306579:0:8434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1782221990.353947:0:8434:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782221990.354179:0:8434:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1782221990.354186:0:8434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1782221990.362108:0:8434:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1782221990.362122:0:8434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1782221990.367983:0:8434:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1782221990.367999:0:8434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1782221990.372667:0:8434:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782221990.373021:0:8434:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1782221990.373027:0:8434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1782221990.378005:0:8434:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1782221990.378021:0:8434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:1.0:1782221990.451362:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782221990.473440:0:8434:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782221990.473843:0:8434:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1782221990.473851:0:8434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1782221990.477939:0:8434:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1782221990.477953:0:8434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1782221990.478810:0:8434:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1782221990.478838:0:8434:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1782221990.478844:0:8434:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.127@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1782221990.513554:0:8434:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.127@tcp ctxt 0 is initialized 00000020:01000004:2.0:1782221990.513600:0:8434:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.127@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1782221990.513604:0:8434:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1782221990.513605:0:8434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782221990.513607:0:8434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782221990.513608:0:8434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782221990.513609:0:8434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782221990.513610:0:8434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782221990.513612:0:8434:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782221990.513613:0:8434:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782221990.513615:0:8434:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782221990.513617:0:8434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782221990.513618:0:8434:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782221990.513625:0:8434:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1782221990.513627:0:8434:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782221990.513629:0:8434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782221990.513629:0:8434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782221990.513630:0:8434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782221990.513631:0:8434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782221990.513632:0:8434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782221990.513633:0:8434:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782221990.513634:0:8434:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782221990.513635:0:8434:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782221990.513635:0:8434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782221990.513636:0:8434:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782221990.513662:0:8434:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1782221990.513679:0:8434:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8434:1868795081672192:0@lo:253: 00000100:00100000:2.0:1782221990.517836:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221990.517891:0:8434:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b7d9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782221990.518032:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081672192 00000100:00100000:0.0:1782221990.518041:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081672192 00000100:00100000:0.0:1782221990.518096:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1782221990.518105:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:8434:x1868795081672192:12345-0@lo:253: 20000000:01000000:0.0:1782221990.518156:0:6519:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1782221990.518161:0:6519:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1782221990.518166:0:6519:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1782221990.518169:0:6519:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1782221990.518473:0:6519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782221990.518640:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1782221990.518656:0:6519:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1782221990.518673:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1782221990.518678:0:6519:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1782221990.518689:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1782221990.518703:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1782221990.518800:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1782221990.518815:0:6519:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.127@tcp 20000000:01000000:0.0:1782221990.518818:0:6519:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.127@tcp (null) (null) (null) 00000040:00080000:0.0:1782221990.518831:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1782221990.518837:0:6519:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1782221990.518849:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1782221990.518854:0:6519:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.127@tcp (null) (null) 00000040:00080000:0.0:1782221990.518865:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1782221990.518871:0:6519:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1782221990.518884:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1782221990.518899:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1782221990.518965:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:0.0:1782221990.518976:0:6519:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.127@tcp 20000000:01000000:0.0:1782221990.518977:0:6519:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.127@tcp (null) (null) (null) 00000040:00080000:0.0:1782221990.518988:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:0.0:1782221990.518993:0:6519:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1782221990.519003:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:0.0:1782221990.519007:0:6519:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.127@tcp (null) (null) 00000040:00080000:0.0:1782221990.519019:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:0.0:1782221990.519024:0:6519:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1782221990.519034:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:0.0:1782221990.519048:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1782221990.519441:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1782221990.519456:0:6519:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.127@tcp 20000000:01000000:0.0:1782221990.519458:0:6519:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.127@tcp (null) (null) (null) 00000040:00080000:0.0:1782221990.519471:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1782221990.519477:0:6519:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1782221990.519490:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1782221990.519495:0:6519:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.127@tcp (null) (null) 00000040:00080000:0.0:1782221990.519507:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1782221990.519523:0:6519:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1782221990.519538:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1782221990.519553:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:0.0:1782221990.519566:0:6519:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1782221990.519568:0:6519:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1782221990.519572:0:6519:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1782221990.519628:0:6519:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1782221990.519631:0:6519:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1782221990.519877:0:8453:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1782221990.519896:0:8453:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1782221990.519928:0:8453:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1782221990.520012:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:0.0:1782221990.520031:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:0.0:1782221990.520047:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:0.0:1782221990.520055:0:6519:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1782221990.520057:0:6519:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1782221990.520225:0:8454:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:0.0:1782221990.520274:0:8454:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:0.0:1782221990.520302:0:8454:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:0.0:1782221990.520359:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:0.0:1782221990.520376:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:0.0:1782221990.520390:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:0.0:1782221990.520398:0:6519:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1782221990.520400:0:6519:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1782221990.520511:0:8455:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:0.0:1782221990.520530:0:8455:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:0.0:1782221990.520544:0:8455:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1782221990.520596:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1782221990.520612:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1782221990.520625:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1782221990.520632:0:6519:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1782221990.520633:0:6519:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1782221990.520768:0:8456:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1782221990.520826:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1782221990.520845:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1782221990.520859:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:0.0:1782221990.520871:0:6519:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1782221990.520892:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f0840030200/0xe2b7cc26e6810fa7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221990.520909:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0841458c00/0xe2b7cc26e6810e49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810e42 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221990.520916:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f08427de000/0xe2b7cc26e6810e65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810e57 expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221990.520923:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f08427dea00/0xe2b7cc26e6810e8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810e88 expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221990.520929:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f086732ea00/0xe2b7cc26e6810eb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810eab expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221990.520936:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f087fb82800/0xe2b7cc26e6810f29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810f22 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221990.520944:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f0840030200/0xe2b7cc26e6810fa7 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221990.520983:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f087fb82800/0xe2b7cc26e6810f29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e6810f22 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221990.520998:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f087fb82800/0xe2b7cc26e6810f29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e6810f22 expref: 18 pid: 6520 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782221990.521012:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849bac380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6519:1868795081672320:0@lo:104: 00000100:00100000:0.0:1782221990.521077:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782221990.521113:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f086732ea00/0xe2b7cc26e6810eb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e6810eab expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221990.521121:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f086732ea00/0xe2b7cc26e6810eb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e6810eab expref: 18 pid: 6520 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782221990.521130:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849bafb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6519:1868795081672448:0@lo:104: 00000100:00100000:0.0:1782221990.521161:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782221990.521186:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f08427dea00/0xe2b7cc26e6810e8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e6810e88 expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221990.521194:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f08427dea00/0xe2b7cc26e6810e8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e6810e88 expref: 18 pid: 6519 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782221990.521203:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6519:1868795081672576:0@lo:104: 00000100:00100000:0.0:1782221990.521222:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782221990.521265:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f08427de000/0xe2b7cc26e6810e65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e6810e57 expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221990.521273:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f08427de000/0xe2b7cc26e6810e65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e6810e57 expref: 18 pid: 6519 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782221990.521281:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6519:1868795081672704:0@lo:104: 00000100:00100000:2.0:1782221990.521554:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081672320 00000100:00100000:2.0:1782221990.521561:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081672320 00000100:00100000:2.0:1782221990.521595:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081672448 00000100:00100000:2.0:1782221990.521598:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081672448 00000100:00100000:2.0:1782221990.521620:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081672576 00000100:00100000:2.0:1782221990.521625:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081672576 00000100:00100000:2.0:1782221990.521637:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782221990.521645:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849baf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+5:6519:x1868795081672320:12345-0@lo:104: 00010000:00010000:2.0:1782221990.521656:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f087fb82600/0xe2b7cc26e6810f22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810f29 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.521705:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782221990.521711:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849baf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+5:6519:x1868795081672320:12345-0@lo:104: Request processed in 67us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221990.521717:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782221990.521733:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782221990.521738:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+4:6519:x1868795081672448:12345-0@lo:104: 00010000:00010000:2.0:1782221990.521751:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f0840030800/0xe2b7cc26e6810eab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810eb2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.521851:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782221990.521856:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+4:6519:x1868795081672448:12345-0@lo:104: Request processed in 119us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221990.521862:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782221990.521875:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782221990.521880:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+3:6519:x1868795081672576:12345-0@lo:104: 00010000:00010000:2.0:1782221990.521888:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f086732e400/0xe2b7cc26e6810e88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810e8f expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.521917:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1782221990.521922:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+3:6519:x1868795081672576:12345-0@lo:104: Request processed in 42us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221990.521926:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1782221990.521941:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1782221990.521946:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f087fb82600/0xe2b7cc26e6810f22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810f29 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.521955:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb82600 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:2.0:1782221990.521958:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f087fb82600/0xe2b7cc26e6810f22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e6810f29 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.521966:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f087fb82600/0xe2b7cc26e6810f22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e6810f29 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782221990.521974:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f087fb82600/0xe2b7cc26e6810f22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e6810f29 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782221990.521986:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782221990.522013:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f087fb82600/0xe2b7cc26e6810f22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810f29 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.522020:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782221990.522037:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f087fb82600/0xe2b7cc26e6810f22 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810f29 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.522045:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f087fb82600/0xe2b7cc26e6810f22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810f29 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.522057:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782221990.522060:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f0840030800/0xe2b7cc26e6810eab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810eb2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.522066:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0840030800 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:2.0:1782221990.522069:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f0840030800/0xe2b7cc26e6810eab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e6810eb2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.522077:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f0840030800/0xe2b7cc26e6810eab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e6810eb2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782221990.522083:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f0840030800/0xe2b7cc26e6810eab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e6810eb2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782221990.522088:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782221990.522098:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f0840030800/0xe2b7cc26e6810eab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810eb2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.522103:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782221990.522114:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f0840030800/0xe2b7cc26e6810eab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810eb2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.522119:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f0840030800/0xe2b7cc26e6810eab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810eb2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.522129:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782221990.522132:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f086732e400/0xe2b7cc26e6810e88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810e8f expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.522138:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f086732e400 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:2.0:1782221990.522141:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f086732e400/0xe2b7cc26e6810e88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e6810e8f expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.522148:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f086732e400/0xe2b7cc26e6810e88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e6810e8f expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782221990.522154:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f086732e400/0xe2b7cc26e6810e88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e6810e8f expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782221990.522159:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782221990.522171:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f086732e400/0xe2b7cc26e6810e88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810e8f expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.522177:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782221990.522198:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f086732e400/0xe2b7cc26e6810e88 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810e8f expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.522205:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f086732e400/0xe2b7cc26e6810e88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810e8f expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.522214:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782221990.522221:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782221990.522222:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782221990.522228:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782221990.522269:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081672832:0@lo:103: 00000100:00100000:2.0:1782221990.522312:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221990.522344:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782221990.522350:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081672960:0@lo:103: 00000100:00100000:2.0:1782221990.522370:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221990.522395:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782221990.522402:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081673088:0@lo:103: 00000100:00100000:2.0:1782221990.522424:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782221990.522710:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782221990.522721:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081672832 00000100:00100000:1.0:1782221990.522726:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081672832 00010000:00010000:1.0:1782221990.522750:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f087fb82800/0xe2b7cc26e6810f29 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810f22 expref: 19 pid: 6520 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782221990.522779:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081672960 00000100:00100000:1.0:1782221990.522782:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081672960 00010000:00010000:1.0:1782221990.522795:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f086732ea00/0xe2b7cc26e6810eb2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810eab expref: 20 pid: 6520 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782221990.522805:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081673088 00000100:00100000:1.0:1782221990.522807:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081673088 00010000:00010000:1.0:1782221990.522817:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f08427dea00/0xe2b7cc26e6810e8f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810e88 expref: 21 pid: 6519 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782221990.522829:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782221990.522843:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:3653:x1868795081672832:12345-0@lo:103: 00010000:00010000:1.0:1782221990.522855:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782221990.522861:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f087fb82800/0xe2b7cc26e6810f29 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810f22 expref: 21 pid: 6520 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.522872:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f087fb82800/0xe2b7cc26e6810f29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e6810f22 expref: 21 pid: 6520 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.522887:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782221990.522920:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:3653:x1868795081672832:12345-0@lo:103: Request processed in 78us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221990.522927:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782221990.522942:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782221990.522948:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:3653:x1868795081672960:12345-0@lo:103: 00010000:00010000:1.0:1782221990.522956:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782221990.522961:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f086732ea00/0xe2b7cc26e6810eb2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810eab expref: 20 pid: 6520 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.522968:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f086732ea00/0xe2b7cc26e6810eb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e6810eab expref: 20 pid: 6520 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.522977:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782221990.522996:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:3653:x1868795081672960:12345-0@lo:103: Request processed in 49us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221990.523001:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782221990.523011:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782221990.523016:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+19:3656:x1868795081673088:12345-0@lo:103: 00010000:00010000:1.0:1782221990.523023:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782221990.523033:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f08427dea00/0xe2b7cc26e6810e8f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810e88 expref: 19 pid: 6519 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.523041:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f08427dea00/0xe2b7cc26e6810e8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e6810e88 expref: 19 pid: 6519 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.523050:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782221990.523539:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081673088:0@lo:103: 00000100:00100000:1.0:1782221990.523579:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+19:3656:x1868795081673088:12345-0@lo:103: Request processed in 421us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221990.523587:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782221990.523614:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081672960:0@lo:103: 00000100:00100000:1.0:1782221990.523621:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081672832:0@lo:103: 00000100:00100000:1.0:1782221990.523894:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782221990.523939:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0841458c00/0xe2b7cc26e6810e49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e6810e42 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.523951:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0841458c00/0xe2b7cc26e6810e49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e6810e42 expref: 18 pid: 6520 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782221990.523962:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b785f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6519:1868795081673216:0@lo:104: 00000100:00100000:1.0:1782221990.523983:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221990.524005:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875bfc0c0 going to sleep for 11 seconds 00010000:00010000:1.0:1782221990.524019:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f087fb82800/0xe2b7cc26e6810f29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e6810f22 expref: 18 pid: 6520 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782221990.524029:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849bac380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6519:1868795081672320:0@lo:104: 00010000:00010000:1.0:1782221990.524038:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f086732ea00/0xe2b7cc26e6810eb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e6810eab expref: 17 pid: 6520 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782221990.524058:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849bafb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6519:1868795081672448:0@lo:104: 00010000:00010000:1.0:1782221990.524070:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f08427dea00/0xe2b7cc26e6810e8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e6810e88 expref: 16 pid: 6519 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782221990.524078:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6519:1868795081672576:0@lo:104: 00000100:00100000:2.0:1782221990.524137:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081672704 00000100:00100000:2.0:1782221990.524142:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081672704 00000100:00100000:2.0:1782221990.524164:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081673216 00000100:00100000:2.0:1782221990.524167:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081673216 00000100:00100000:2.0:1782221990.524177:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782221990.524183:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b787b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+4:6519:x1868795081672704:12345-0@lo:104: 00010000:00010000:2.0:1782221990.524193:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f086732fc00/0xe2b7cc26e6810e57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810e65 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.524281:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782221990.524295:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b787b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+4:6519:x1868795081672704:12345-0@lo:104: Request processed in 112us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221990.524302:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782221990.524314:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782221990.524320:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b785880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+3:6519:x1868795081673216:12345-0@lo:104: 00010000:00010000:2.0:1782221990.524327:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f08427dee00/0xe2b7cc26e6810e42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810e49 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.524363:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782221990.524368:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b785880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+3:6519:x1868795081673216:12345-0@lo:104: Request processed in 49us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221990.524375:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1782221990.524389:0:7468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782221990.524394:0:7468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f086732fc00/0xe2b7cc26e6810e57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810e65 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.524401:0:7468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f086732fc00 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:2.0:1782221990.524405:0:7468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f086732fc00/0xe2b7cc26e6810e57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e6810e65 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.524413:0:7468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f086732fc00/0xe2b7cc26e6810e57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e6810e65 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782221990.524421:0:7468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f086732fc00/0xe2b7cc26e6810e57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e6810e65 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782221990.524428:0:7468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782221990.524459:0:7468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f086732fc00/0xe2b7cc26e6810e57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810e65 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.524466:0:7468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782221990.524478:0:7468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f086732fc00/0xe2b7cc26e6810e57 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810e65 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.524485:0:7468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f086732fc00/0xe2b7cc26e6810e57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810e65 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.524505:0:7468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782221990.524509:0:7468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f08427dee00/0xe2b7cc26e6810e42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810e49 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.524514:0:7468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08427dee00 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:2.0:1782221990.524516:0:7468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f08427dee00/0xe2b7cc26e6810e42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e6810e49 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.524523:0:7468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f08427dee00/0xe2b7cc26e6810e42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e6810e49 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782221990.524529:0:7468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f08427dee00/0xe2b7cc26e6810e42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e6810e49 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782221990.524534:0:7468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782221990.524545:0:7468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f08427dee00/0xe2b7cc26e6810e42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810e49 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.524551:0:7468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782221990.524561:0:7468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f08427dee00/0xe2b7cc26e6810e42 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810e49 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.524567:0:7468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f08427dee00/0xe2b7cc26e6810e42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810e49 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.524580:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782221990.524582:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782221990.524583:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782221990.524589:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782221990.524604:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3654:1868795081673472:0@lo:103: 00000100:00100000:2.0:1782221990.524629:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221990.524663:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081673472 00000100:00100000:2.0:1782221990.524667:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081673472 00010000:00010000:2.0:1782221990.524680:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0841458c00/0xe2b7cc26e6810e49 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810e42 expref: 16 pid: 6520 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221990.524698:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782221990.524704:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:3654:x1868795081673472:12345-0@lo:103: 00010000:00010000:2.0:1782221990.524713:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782221990.524717:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0841458c00/0xe2b7cc26e6810e49 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810e42 expref: 16 pid: 6520 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.524726:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0841458c00/0xe2b7cc26e6810e49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e6810e42 expref: 16 pid: 6520 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.524738:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782221990.525010:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:3654:x1868795081673472:12345-0@lo:103: Request processed in 303us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221990.525017:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782221990.525048:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3654:1868795081673472:0@lo:103: 00000100:00100000:2.0:1782221990.525064:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081673344:0@lo:103: 00000100:00100000:2.0:1782221990.525089:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782221990.525112:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782221990.525400:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081673344 00000100:00100000:1.0:1782221990.525406:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081673344 00010000:00010000:1.0:1782221990.525424:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f08427de000/0xe2b7cc26e6810e65 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810e57 expref: 16 pid: 6519 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782221990.525509:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782221990.525518:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08429aa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:3656:x1868795081673344:12345-0@lo:103: 00010000:00010000:1.0:1782221990.525527:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782221990.525532:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f08427de000/0xe2b7cc26e6810e65 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810e57 expref: 16 pid: 6519 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.525541:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f08427de000/0xe2b7cc26e6810e65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e6810e57 expref: 16 pid: 6519 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.525553:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f0840030200/0xe2b7cc26e6810fa7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.525562:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0840030200/0xe2b7cc26e6810fa7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.525576:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f0840030200/0xe2b7cc26e6810fa7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.525583:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f0840030200/0xe2b7cc26e6810fa7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.525597:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f0840030200/0xe2b7cc26e6810fa7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.525604:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f0840030200/0xe2b7cc26e6810fa7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.525609:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0840030200 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:1.0:1782221990.525613:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f0840030200/0xe2b7cc26e6810fa7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.525620:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f0840030200/0xe2b7cc26e6810fa7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.525628:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f0840030200/0xe2b7cc26e6810fa7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.525636:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782221990.525679:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08429aa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:3656:x1868795081673344:12345-0@lo:103: Request processed in 163us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221990.525686:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1782221990.525745:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f08427de000/0xe2b7cc26e6810e65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e6810e57 expref: 15 pid: 6519 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782221990.525758:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6519:1868795081672704:0@lo:104: 00000100:00100000:0.0:1782221990.525877:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081673344:0@lo:103: 00010000:00010000:1.0:1782221990.525924:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0841458c00/0xe2b7cc26e6810e49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e6810e42 expref: 14 pid: 6520 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782221990.525933:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b785f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6519:1868795081673216:0@lo:104: 00010000:00010000:1.0:1782221990.525955:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f0840030200/0xe2b7cc26e6810fa7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.525970:0:6519:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f0840030200/0xe2b7cc26e6810fa7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.525975:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f0840030200/0xe2b7cc26e6810fa7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.525981:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0840030200/0xe2b7cc26e6810fa7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782221990.525994:0:6519:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1782221990.529498:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+13:8434:x1868795081672192:12345-0@lo:253: Request processed in 11385us (11661us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221990.529512:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1782221990.529570:0:8434:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8434:1868795081672192:0@lo:253: 10000000:01000000:2.0:1782221990.529586:0:8434:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1782221990.529589:0:8434:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782221990.529591:0:8434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782221990.529603:0:8434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782221990.529604:0:8434:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1782221990.529606:0:8434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782221990.529607:0:8434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782221990.529608:0:8434:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782221990.529610:0:8434:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1782221990.529612:0:8434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782221990.529613:0:8434:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1782221990.529634:0:8434:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f087fb98800 from lustre-OST0000 10000000:01000000:2.0:1782221990.529662:0:8434:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1782221990.529665:0:8434:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1782221990.529672:0:8434:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f087805cd40 local copy 10000000:01000000:2.0:1782221990.529676:0:8434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1782221990.529710:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb82600/0xe2b7cc26e6810fae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.529720:0:8434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.127@tcp lock: ffff8f087fb82600/0xe2b7cc26e6810fae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.529729:0:8434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f087fb82600/0xe2b7cc26e6810fae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221990.529746:0:8434:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8434:1868795081673600:0@lo:101: 00000100:00100000:2.0:1782221990.529780:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221990.529816:0:8434:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08429b0900 going to sleep for 11 seconds 00000100:00100000:0.0:1782221990.529841:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081673600 00000100:00100000:0.0:1782221990.529848:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081673600 00000100:00100000:0.0:1782221990.529893:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1782221990.529902:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+13:8434:x1868795081673600:12345-0@lo:101: 00010000:00010000:0.0:1782221990.529920:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782221990.529932:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0840030c00/0xe2b7cc26e6810fb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6810fae expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221990.529954:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0840030c00/0xe2b7cc26e6810fb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6810fae expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221990.529965:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0840030c00/0xe2b7cc26e6810fb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810fae expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221990.529973:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0840030c00, rc 0) 00000100:00100000:0.0:1782221990.530014:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+14:8434:x1868795081673600:12345-0@lo:101: Request processed in 114us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221990.530020:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1782221990.530082:0:8434:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8434:1868795081673600:0@lo:101: 00010000:00010000:3.0:1782221990.530095:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f087fb82600/0xe2b7cc26e6810fae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xe2b7cc26e6810fb5 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221990.530104:0:8434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f087fb82600/0xe2b7cc26e6810fae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe2b7cc26e6810fb5 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782221990.530213:0:8434:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8434:1868795081673728:0@lo:501: 00000100:00100000:3.0:1782221990.530264:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221990.530302:0:8434:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b72a240 going to sleep for 11 seconds 00000100:00100000:1.0:1782221990.530505:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081673728 00000100:00100000:1.0:1782221990.530510:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081673728 00000100:00100000:1.0:1782221990.530543:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1782221990.530551:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+14:8434:x1868795081673728:12345-0@lo:501: 00000100:00100000:1.0:1782221990.530613:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+14:8434:x1868795081673728:12345-0@lo:501: Request processed in 63us (349us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782221990.530620:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1782221990.530750:0:8434:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8434:1868795081673728:0@lo:501: 10000000:01000000:3.0:1782221990.530839:0:8434:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1782221990.530857:0:8434:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1782221990.530863:0:8434:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb82600/0xe2b7cc26e6810fae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe2b7cc26e6810fb5 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221990.530871:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb82600/0xe2b7cc26e6810fae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe2b7cc26e6810fb5 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221990.530877:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.127@tcp lock: ffff8f087fb82600/0xe2b7cc26e6810fae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe2b7cc26e6810fb5 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221990.530897:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1782221990.530918:0:8434:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f087fb98800 10000000:01000000:3.0:1782221990.530922:0:8434:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1782221990.530927:0:8434:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1782221990.530937:0:8434:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782221990.530941:0:8434:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1782221990.530943:0:8434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1782221990.530963:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0841459400/0xe2b7cc26e6810fbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221990.530970:0:8434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f0841459400/0xe2b7cc26e6810fbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221990.530977:0:8434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0841459400/0xe2b7cc26e6810fbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782221990.530991:0:8434:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8434:1868795081673856:0@lo:101: 00000100:00100000:3.0:1782221990.531019:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782221990.531076:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782221990.531081:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f087fb82600/0xe2b7cc26e6810fae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe2b7cc26e6810fb5 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.531088:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb82600 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:1.0:1782221990.531091:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f087fb82600/0xe2b7cc26e6810fae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe2b7cc26e6810fb5 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.531109:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f087fb82600/0xe2b7cc26e6810fae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xe2b7cc26e6810fb5 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782221990.531116:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f087fb82600/0xe2b7cc26e6810fae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xe2b7cc26e6810fb5 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782221990.531121:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782221990.531138:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f087fb82600/0xe2b7cc26e6810fae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe2b7cc26e6810fb5 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.531144:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782221990.531169:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f087fb82600/0xe2b7cc26e6810fae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe2b7cc26e6810fb5 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.531175:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f087fb82600/0xe2b7cc26e6810fae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe2b7cc26e6810fb5 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.531188:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782221990.531190:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782221990.531192:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782221990.531209:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782221990.531220:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b785f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081673984:0@lo:103: 00000100:00100000:3.0:1782221990.531967:0:8434:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b72ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1782221990.532461:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221990.532554:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081673984 00000100:00100000:2.0:1782221990.532562:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081673984 00000100:00100000:2.0:1782221990.532616:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782221990.532626:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b786680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+14:3653:x1868795081673984:12345-0@lo:103: 00010000:00010000:2.0:1782221990.532639:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782221990.532655:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0840030c00/0xe2b7cc26e6810fb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2b7cc26e6810fae expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.532684:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782221990.532734:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b786680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+13:3653:x1868795081673984:12345-0@lo:103: Request processed in 110us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221990.532741:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782221990.532939:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b785f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081673984:0@lo:103: 00000100:00100000:0.0:1782221990.533734:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081673856 00000100:00100000:0.0:1782221990.533741:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081673856 00000100:00100000:0.0:1782221990.533933:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1782221990.533942:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+13:8434:x1868795081673856:12345-0@lo:101: 00010000:00010000:0.0:1782221990.533956:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782221990.533973:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0840030200/0xe2b7cc26e6810fc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6810fbc expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221990.533993:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0840030200/0xe2b7cc26e6810fc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6810fbc expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221990.534003:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0840030200/0xe2b7cc26e6810fc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810fbc expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221990.534010:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0840030200, rc 0) 00000100:00100000:0.0:1782221990.534078:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+14:8434:x1868795081673856:12345-0@lo:101: Request processed in 137us (3058us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221990.534084:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1782221990.534166:0:8434:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8434:1868795081673856:0@lo:101: 00010000:00010000:3.0:1782221990.534183:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0841459400/0xe2b7cc26e6810fbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810fc3 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221990.534192:0:8434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0841459400/0xe2b7cc26e6810fbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6810fc3 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782221990.534347:0:8434:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8434:1868795081674112:0@lo:501: 00000100:00100000:3.0:1782221990.534381:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221990.534696:0:8434:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b72ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1782221990.534773:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081674112 00000100:00100000:1.0:1782221990.534778:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081674112 00000100:00100000:1.0:1782221990.534804:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1782221990.534811:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+14:8434:x1868795081674112:12345-0@lo:501: 00000100:00100000:1.0:1782221990.534928:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+14:8434:x1868795081674112:12345-0@lo:501: Request processed in 116us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221990.534946:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1782221990.535073:0:8434:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8434:1868795081674112:0@lo:501: 00000100:00100000:3.0:1782221990.535101:0:8434:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8434:1868795081674240:0@lo:503: 00000100:00100000:3.0:1782221990.535143:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221990.535162:0:8434:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b72ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1782221990.536368:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081674240 00000100:00100000:1.0:1782221990.536377:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081674240 00000100:00100000:1.0:1782221990.536415:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1782221990.536423:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+14:8434:x1868795081674240:12345-0@lo:503: 00000100:00100000:1.0:1782221990.536548:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+14:8434:x1868795081674240:12345-0@lo:503: Request processed in 125us (1403us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221990.536556:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1782221990.536664:0:8434:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8434:1868795081674240:0@lo:503: 00000040:00080000:3.0:1782221990.536943:0:8434:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782221990.537020:0:8434:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8434:1868795081674368:0@lo:502: 00000100:00100000:3.0:1782221990.537063:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221990.537097:0:8434:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b72ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1782221990.537561:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081674368 00000100:00100000:1.0:1782221990.537568:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081674368 00000100:00100000:1.0:1782221990.537594:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1782221990.537601:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+14:8434:x1868795081674368:12345-0@lo:502: 00000100:00100000:1.0:1782221990.537690:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+14:8434:x1868795081674368:12345-0@lo:502: Request processed in 88us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221990.537697:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1782221990.538045:0:8434:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8434:1868795081674368:0@lo:502: 00000040:00080000:3.0:1782221990.538427:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1782221990.538456:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1782221990.538471:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1782221990.538483:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1782221990.538496:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1782221990.538510:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1782221990.538534:0:8434:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8434:1868795081674496:0@lo:502: 00000100:00100000:3.0:1782221990.538574:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221990.538602:0:8434:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b72ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1782221990.538683:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081674496 00000100:00100000:1.0:1782221990.538688:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081674496 00000100:00100000:1.0:1782221990.538711:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1782221990.538718:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+14:8434:x1868795081674496:12345-0@lo:502: 00000100:00100000:1.0:1782221990.538927:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+14:8434:x1868795081674496:12345-0@lo:502: Request processed in 209us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221990.538934:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1782221990.539009:0:8434:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8434:1868795081674496:0@lo:502: 00000040:00080000:3.0:1782221990.539047:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1782221990.539055:0:8434:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1782221990.539676:0:8457:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1782221990.539684:0:8457:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1782221990.539690:0:8457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782221990.539693:0:8457:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1782221990.539699:0:8457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782221990.539713:0:8457:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8f087f9399c0) 00000020:00000080:0.0:1782221990.539733:0:8457:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:0.0:1782221990.539738:0:8457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1782221990.539883:0:8457:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f087fb98800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1782221990.539891:0:8457:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1782221990.539897:0:8457:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe2b7cc26e6810fd1 00010000:00010000:0.0:1782221990.545626:0:8457:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:0.0:1782221990.545971:0:8457:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1782221990.551179:0:8457:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1782221990.551558:0:8457:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1782221990.559729:0:8457:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1782221990.560183:0:8457:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1782221990.573769:0:8457:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1782221990.581569:0:8457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1782221990.581583:0:8457:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782221990.581588:0:8457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782221990.581590:0:8457:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1782221990.581595:0:8457:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782221990.581599:0:8457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782221990.581601:0:8457:0:(obd_config.c:1561:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782221990.581604:0:8457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782221990.581605:0:8457:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1782221990.581632:0:8457:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782221990.581635:0:8457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782221990.581642:0:8457:0:(obd_config.c:1561:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:0.0:1782221990.581646:0:8457:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1782221990.583298:0:8434:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1782221990.583335:0:8434:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1782221990.583358:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0841459400/0xe2b7cc26e6810fbc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810fc3 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221990.583371:0:8434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f0841459400/0xe2b7cc26e6810fbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810fc3 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782221990.583389:0:8434:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f087fb98800 from 1 10000000:01000000:3.0:1782221990.583391:0:8434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782221990.583426:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0841458a00/0xe2b7cc26e6810fd8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221990.583434:0:8434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f0841458a00/0xe2b7cc26e6810fd8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221990.583445:0:8434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0841458a00/0xe2b7cc26e6810fd8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782221990.583468:0:8434:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8434:1868795081674624:0@lo:101: 00000100:00100000:3.0:1782221990.583533:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221990.583573:0:8434:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b72ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1782221990.584883:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081674624 00000100:00100000:0.0:1782221990.584894:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081674624 00000100:00100000:0.0:1782221990.584938:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1782221990.584947:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+14:8434:x1868795081674624:12345-0@lo:101: 00010000:00010000:0.0:1782221990.584962:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782221990.584977:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0840030800/0xe2b7cc26e6810fdf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6810fd8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221990.585003:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0840030800/0xe2b7cc26e6810fdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6810fd8 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221990.585014:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0840030800/0xe2b7cc26e6810fdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810fd8 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221990.585022:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0840030800, rc 0) 00000100:00100000:0.0:1782221990.585084:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:8434:x1868795081674624:12345-0@lo:101: Request processed in 138us (1552us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221990.585092:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1782221990.585738:0:8434:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8434:1868795081674624:0@lo:101: 00010000:00010000:3.0:1782221990.585757:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0841458a00/0xe2b7cc26e6810fd8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810fdf expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221990.586212:0:8434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0841458a00/0xe2b7cc26e6810fd8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6810fdf expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782221990.586364:0:8434:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8434:1868795081674752:0@lo:501: 00000100:00100000:3.0:1782221990.586411:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221990.586534:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081674752 00000100:00100000:0.0:1782221990.586540:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081674752 00000100:00100000:0.0:1782221990.586574:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1782221990.586582:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:8434:x1868795081674752:12345-0@lo:501: 00000100:00100000:3.0:1782221990.586691:0:8434:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b72ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1782221990.589338:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:8434:x1868795081674752:12345-0@lo:501: Request processed in 2748us (2917us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221990.589352:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1782221990.589488:0:8434:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8434:1868795081674752:0@lo:501: 00000100:00100000:3.0:1782221990.589538:0:8434:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8434:1868795081674880:0@lo:503: 00000100:00100000:3.0:1782221990.589597:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221990.589638:0:8434:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b72ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1782221990.590122:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081674880 00000100:00100000:1.0:1782221990.590135:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081674880 00000100:00100000:1.0:1782221990.590178:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1782221990.590186:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:8434:x1868795081674880:12345-0@lo:503: 00000100:00100000:1.0:1782221990.590335:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:8434:x1868795081674880:12345-0@lo:503: Request processed in 149us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221990.590342:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1782221990.590435:0:8434:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8434:1868795081674880:0@lo:503: 00000040:00080000:3.0:1782221990.590660:0:8434:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782221990.590721:0:8434:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8434:1868795081675008:0@lo:502: 00000100:00100000:3.0:1782221990.590756:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221990.590796:0:8434:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b72ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1782221990.590889:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081675008 00000100:00100000:1.0:1782221990.590893:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081675008 00000100:00100000:1.0:1782221990.590924:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1782221990.590931:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:8434:x1868795081675008:12345-0@lo:502: 00000100:00100000:1.0:1782221990.591003:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:8434:x1868795081675008:12345-0@lo:502: Request processed in 71us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221990.591008:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1782221990.591114:0:8434:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8434:1868795081675008:0@lo:502: 00000040:00080000:3.0:1782221990.591332:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1782221990.591359:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1782221990.591390:0:8434:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8434:1868795081675136:0@lo:502: 00000100:00100000:3.0:1782221990.591425:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221990.591437:0:8434:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b72ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1782221990.591524:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081675136 00000100:00100000:1.0:1782221990.591529:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081675136 00000100:00100000:1.0:1782221990.591558:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1782221990.591565:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:8434:x1868795081675136:12345-0@lo:502: 00000100:00100000:1.0:1782221990.591636:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:8434:x1868795081675136:12345-0@lo:502: Request processed in 71us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221990.591642:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1782221990.591846:0:8434:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8434:1868795081675136:0@lo:502: 00000040:00080000:3.0:1782221990.591879:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1782221990.591886:0:8434:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1782221990.592335:0:8461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782221990.592345:0:8461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782221990.592347:0:8461:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1782221990.592353:0:8461:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f087fb98800 00000020:00000080:1.0:1782221990.592356:0:8461:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782221990.592366:0:8461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782221990.592369:0:8461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782221990.592370:0:8461:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1782221990.592373:0:8461:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1782221990.592663:0:8434:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1782221990.592685:0:8434:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782221990.592706:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0841458a00/0xe2b7cc26e6810fd8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810fdf expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221990.592717:0:8434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f0841458a00/0xe2b7cc26e6810fd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810fdf expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782221990.592757:0:8434:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1782221990.592769:0:8434:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f087fb98800 10000000:01000000:3.0:1782221990.592772:0:8434:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f087fb98800 10000000:01000000:3.0:1782221990.592780:0:8434:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782221990.592786:0:8434:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8f087fb98800 from 1 10000000:01000000:3.0:1782221990.592788:0:8434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782221990.592812:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0841459e00/0xe2b7cc26e6810fe6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221990.592820:0:8434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f0841459e00/0xe2b7cc26e6810fe6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221990.592828:0:8434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0841459e00/0xe2b7cc26e6810fe6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782221990.592842:0:8434:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8434:1868795081675264:0@lo:101: 00000100:00100000:3.0:1782221990.592878:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221990.592911:0:8434:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b72af00 going to sleep for 11 seconds 00000100:00100000:1.0:1782221990.593017:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081675264 00000100:00100000:1.0:1782221990.593023:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081675264 00000100:00100000:1.0:1782221990.593060:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1782221990.593068:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:8434:x1868795081675264:12345-0@lo:101: 00010000:00010000:1.0:1782221990.593078:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782221990.593089:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0875803c00/0xe2b7cc26e6810fed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6810fe6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.593108:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0875803c00/0xe2b7cc26e6810fed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6810fe6 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.593117:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0875803c00/0xe2b7cc26e6810fed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810fe6 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.593125:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0875803c00, rc 0) 00000100:00100000:1.0:1782221990.593163:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:8434:x1868795081675264:12345-0@lo:101: Request processed in 95us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221990.593169:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1782221990.593264:0:8434:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8434:1868795081675264:0@lo:101: 00010000:00010000:3.0:1782221990.593278:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0841459e00/0xe2b7cc26e6810fe6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810fed expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221990.593295:0:8434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0841459e00/0xe2b7cc26e6810fe6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6810fed expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782221990.593364:0:8434:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8434:1868795081675392:0@lo:501: 00000100:00100000:3.0:1782221990.593389:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221990.593411:0:8434:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b72af00 going to sleep for 11 seconds 00000100:00100000:2.0:1782221990.593514:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081675392 00000100:00100000:2.0:1782221990.593518:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081675392 00000100:00100000:2.0:1782221990.593590:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1782221990.593598:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:8434:x1868795081675392:12345-0@lo:501: 00000100:00100000:2.0:1782221990.593696:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:8434:x1868795081675392:12345-0@lo:501: Request processed in 99us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221990.593703:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1782221990.593721:0:8434:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8434:1868795081675392:0@lo:501: 00000100:00100000:0.0:1782221990.593749:0:8434:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8434:1868795081675520:0@lo:503: 00000100:00100000:0.0:1782221990.593800:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221990.593822:0:8434:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087fb75000 going to sleep for 11 seconds 00000100:00100000:1.0:1782221990.593868:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081675520 00000100:00100000:1.0:1782221990.593872:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081675520 00000100:00100000:1.0:1782221990.593904:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1782221990.593911:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:8434:x1868795081675520:12345-0@lo:503: 00000100:00100000:1.0:1782221990.593997:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:8434:x1868795081675520:12345-0@lo:503: Request processed in 86us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221990.594004:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1782221990.594130:0:8434:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8434:1868795081675520:0@lo:503: 00000040:00080000:0.0:1782221990.594411:0:8434:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782221990.594471:0:8434:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8434:1868795081675648:0@lo:502: 00000100:00100000:0.0:1782221990.594506:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221990.594525:0:8434:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087fb75000 going to sleep for 11 seconds 00000100:00100000:1.0:1782221990.594582:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081675648 00000100:00100000:1.0:1782221990.594586:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081675648 00000100:00100000:1.0:1782221990.594612:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1782221990.594618:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:8434:x1868795081675648:12345-0@lo:502: 00000100:00100000:1.0:1782221990.594710:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:8434:x1868795081675648:12345-0@lo:502: Request processed in 92us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221990.594717:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1782221990.595011:0:8434:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8434:1868795081675648:0@lo:502: 00000040:00080000:0.0:1782221990.595209:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1782221990.595280:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1782221990.595307:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1782221990.595321:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1782221990.595335:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1782221990.595347:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1782221990.595359:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1782221990.595372:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1782221990.595385:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1782221990.595398:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1782221990.595424:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1782221990.595439:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1782221990.595451:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1782221990.595463:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1782221990.595475:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1782221990.595487:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1782221990.595500:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1782221990.595513:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1782221990.595523:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1782221990.595535:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1782221990.595547:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1782221990.595560:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1782221990.595572:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1782221990.595583:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1782221990.595622:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1782221990.595638:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1782221990.595664:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1782221990.595681:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1782221990.595695:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1782221990.595709:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1782221990.595723:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1782221990.595738:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1782221990.595752:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1782221990.595998:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1782221990.596016:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1782221990.596030:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1782221990.596041:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:1.0:1782221990.596074:0:8434:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b784000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8434:1868795081675776:0@lo:502: 00000100:00100000:1.0:1782221990.596130:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221990.596171:0:8434:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0844d88d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782221990.596230:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081675776 00000100:00100000:2.0:1782221990.596260:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081675776 00000100:00100000:2.0:1782221990.596308:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1782221990.596316:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:8434:x1868795081675776:12345-0@lo:502: 00000100:00100000:2.0:1782221990.596416:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:8434:x1868795081675776:12345-0@lo:502: Request processed in 101us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221990.596423:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1782221990.596516:0:8434:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b784000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8434:1868795081675776:0@lo:502: 00000040:00080000:1.0:1782221990.596556:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1782221990.596564:0:8434:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1782221990.597889:0:8462:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1782221990.597917:0:8462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8f07460f19c0) 00000020:00000080:3.0:1782221990.597939:0:8462:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1782221990.598107:0:8462:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f087fb98800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1782221990.598117:0:8462:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f087fb98800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1782221990.598119:0:8462:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8f087fb98800 3 00010000:00080000:3.0:1782221990.598146:0:8462:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f0745631000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.127@tcp at head 00010000:00010000:3.0:1782221990.604714:0:8462:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:3.0:1782221990.604819:0:8462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1782221990.604867:0:8462:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1782221990.604881:0:8462:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xe2b7cc26e6810ffb 00000100:00080000:3.0:1782221990.604891:0:8462:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782221990.604896:0:8462:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8f0745631000 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:3.0:1782221990.604931:0:8462:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f087fdb2a00 x1868795081675904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782221990.604964:0:8462:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1782221990.605058:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081676160:0@lo:400: 00000100:00100000:0.0:1782221990.605067:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3652:1868795081675904:0@lo:38: 00000100:00100000:1.0:1782221990.605152:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1868795081676032:0@lo:400: 00000100:00100000:2.0:1782221990.605201:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1868795081676416:0@lo:400: 00000100:00100000:3.0:1782221990.605797:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221990.605850:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081676288:0@lo:400: 00000100:00100000:3.0:1782221990.605878:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221990.605910:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081676160 00000100:00100000:3.0:1782221990.605916:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081676160 00000100:00100000:3.0:1782221990.605948:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081676288 00000100:00100000:3.0:1782221990.605951:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081676288 00000100:00100000:3.0:1782221990.605965:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782221990.605972:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081676160:12345-0@lo:400: 00000100:00100000:3.0:1782221990.606023:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081676160:12345-0@lo:400: Request processed in 50us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221990.606030:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782221990.606044:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782221990.606049:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081676288:12345-0@lo:400: 00000100:00100000:3.0:1782221990.606110:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081676288:12345-0@lo:400: Request processed in 60us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221990.606116:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782221990.606147:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081676288:0@lo:400: 00000100:00100000:3.0:1782221990.606171:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081676160:0@lo:400: 00000100:00100000:0.0:1782221990.607078:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221990.607104:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081675904 00000100:00100000:3.0:1782221990.607109:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081675904 00000100:00100000:3.0:1782221990.607133:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782221990.607139:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3652:x1868795081675904:12345-0@lo:38: 00010000:00080000:3.0:1782221990.607162:0:6527:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:3.0:1782221990.607194:0:6527:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xe2b7cc26e6811002 00000004:00100000:3.0:1782221990.607208:0:6527:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1782221990.607226:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1782221990.607265:0:6527:0:(import.c:65:import_set_state_nolock()) ffff8f0875d51800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782221990.607276:0:6526:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1782221990.607292:0:6526:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1782221990.607338:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1868795081675904:12345-0@lo:38: Request processed in 198us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221990.607345:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782221990.607357:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081676032 00000100:00100000:3.0:1782221990.607360:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081676032 00000100:00100000:3.0:1782221990.607377:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782221990.607382:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1868795081676032:12345-0@lo:400: 00000100:00100000:3.0:1782221990.607417:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1868795081676032:12345-0@lo:400: Request processed in 35us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221990.607424:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1782221990.607434:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f087fdb1180 x1868795081676032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782221990.607446:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1868795081676032:0@lo:400: 00010000:00080000:0.0:1782221990.609108:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f087fdb2a00 x1868795081675904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782222000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782221990.609121:0:3652:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782221990.609129:0:3652:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1782221990.609138:0:3652:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1782221990.609144:0:3652:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1782221990.609147:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f0745631000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1782221990.609154:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3652:1868795081675904:0@lo:38: 00000100:00100000:2.0:1782221990.610293:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221990.610418:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081676416 00000100:00100000:1.0:1782221990.610427:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081676416 00000100:00100000:1.0:1782221990.610476:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782221990.610485:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1868795081676416:12345-0@lo:400: 00000100:00100000:1.0:1782221990.610545:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1868795081676416:12345-0@lo:400: Request processed in 60us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221990.610551:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1782221990.610606:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f087fdb1500 x1868795081676416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782221990.610617:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1868795081676416:0@lo:400: 00000020:01000004:2.0:1782221990.611439:0:8462:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1782221990.611454:0:8462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8f087fb93380) 00000020:00000080:2.0:1782221990.611475:0:8462:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1782221990.614394:0:8462:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f087fb98800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1782221990.614402:0:8462:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f087fb98800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1782221990.614406:0:8462:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8f087fb98800 3 00010000:00080000:2.0:1782221990.614455:0:8462:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f07415bf000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.127@tcp at head 00010000:00010000:2.0:1782221990.619175:0:8462:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:2.0:1782221990.619398:0:8462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1782221990.619447:0:8462:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1782221990.619460:0:8462:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xe2b7cc26e6811010 00000100:00080000:2.0:1782221990.619470:0:8462:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782221990.619476:0:8462:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8f07415bf000 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:2.0:1782221990.619514:0:8462:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0849b14e00 x1868795081676544/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782221990.619574:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3652:1868795081676544:0@lo:38: 00000100:00100000:1.0:1782221990.619640:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782221990.619693:0:8462:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1782221990.622535:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081676544 00000100:00100000:3.0:1782221990.622551:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081676544 00000100:00100000:3.0:1782221990.622601:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782221990.622617:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b784e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3652:x1868795081676544:12345-0@lo:38: 00010000:00080000:3.0:1782221990.622648:0:6526:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:3.0:1782221990.622689:0:6526:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xe2b7cc26e6811017 00000004:00100000:3.0:1782221990.622708:0:6526:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1782221990.622757:0:6526:0:(import.c:65:import_set_state_nolock()) ffff8f07463b0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782221990.622924:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b784e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1868795081676544:12345-0@lo:38: Request processed in 307us (3282us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221990.622932:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1782221990.623130:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0849b14e00 x1868795081676544/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782222000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782221990.623141:0:3652:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782221990.623149:0:3652:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1782221990.623156:0:3652:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1782221990.623160:0:3652:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1782221990.623162:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f07415bf000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1782221990.623168:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3652:1868795081676544:0@lo:38: 00000040:00080000:3.0:1782221990.623717:0:8462:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1782221990.625251:0:8434:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1782221990.625298:0:8434:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782221990.625318:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0841459e00/0xe2b7cc26e6810fe6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810fed expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221990.625329:0:8434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f0841459e00/0xe2b7cc26e6810fe6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810fed expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1782221990.625376:0:8434:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1782221990.625379:0:8434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782221990.625380:0:8434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782221990.625381:0:8434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782221990.625382:0:8434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782221990.625384:0:8434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782221990.625385:0:8434:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782221990.625387:0:8434:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782221990.625388:0:8434:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782221990.625389:0:8434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782221990.625391:0:8434:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782221990.625394:0:8434:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1782221990.625396:0:8434:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782221990.625398:0:8434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782221990.625399:0:8434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782221990.625400:0:8434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782221990.625401:0:8434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782221990.625402:0:8434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782221990.625403:0:8434:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782221990.625404:0:8434:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782221990.625405:0:8434:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782221990.625407:0:8434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782221990.625408:0:8434:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782221990.625432:0:8434:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1782221990.625449:0:8434:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8434:1868795081676672:0@lo:253: 00000100:00100000:0.0:1782221990.625504:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221990.625540:0:8434:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087fb756c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782221990.625675:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081676672 00000100:00100000:1.0:1782221990.625682:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081676672 00000100:00100000:1.0:1782221990.625727:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1782221990.625736:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:8434:x1868795081676672:12345-0@lo:253: 20000000:01000000:1.0:1782221990.625767:0:6521:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1782221990.625781:0:6521:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1782221990.632973:0:6521:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1782221990.632993:0:6521:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1782221990.633731:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:8434:x1868795081676672:12345-0@lo:253: Request processed in 7990us (8220us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221990.633742:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 20000000:01000000:2.0:1782221990.633850:0:6542:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1782221990.633855:0:6542:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1782221990.633876:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e681101e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.633891:0:6542:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f08427de600/0xe2b7cc26e6810f61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810f5a expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.633899:0:6542:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0841458600/0xe2b7cc26e6810f7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810f76 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.633906:0:6542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e681101e lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782221990.633913:0:8434:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8434:1868795081676672:0@lo:253: 10000000:01000000:0.0:1782221990.633936:0:8434:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1782221990.633938:0:8434:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782221990.633940:0:8434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00010000:00010000:2.0:1782221990.633941:0:6542:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0841458600/0xe2b7cc26e6810f7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e6810f76 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1782221990.633941:0:8434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782221990.633943:0:8434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782221990.633944:0:8434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782221990.633945:0:8434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782221990.633947:0:8434:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782221990.633949:0:8434:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782221990.633950:0:8434:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782221990.633951:0:8434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782221990.633953:0:8434:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:2.0:1782221990.633954:0:6542:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0841458600/0xe2b7cc26e6810f7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e6810f76 expref: 15 pid: 6521 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221990.633966:0:6542:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b14000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6542:1868795081676800:0@lo:104: 00000020:02000000:0.0:1782221990.633976:0:8434:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1782221990.634009:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782221990.634060:0:6542:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f08427de600/0xe2b7cc26e6810f61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e6810f5a expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.634069:0:6542:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f08427de600/0xe2b7cc26e6810f61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e6810f5a expref: 15 pid: 6520 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221990.634077:0:6542:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b16a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6542:1868795081676928:0@lo:104: 00000100:00100000:2.0:1782221990.634095:0:6542:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08429b0900 going to sleep for 11 seconds 00000100:00100000:3.0:1782221990.634580:0:6509:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782221990.634601:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221990.634628:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081676800 00000100:00100000:3.0:1782221990.634634:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081676800 00000100:00100000:3.0:1782221990.634664:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081676928 00000100:00100000:3.0:1782221990.634667:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081676928 00000100:00100000:1.0:1782221990.634671:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782221990.634681:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fcbf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+4:6542:x1868795081676800:12345-0@lo:104: 00010000:00010000:1.0:1782221990.634693:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f08427df800/0xe2b7cc26e6810f76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810f7d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.634755:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782221990.634762:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fcbf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+4:6542:x1868795081676800:12345-0@lo:104: Request processed in 82us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221990.634769:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782221990.634804:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782221990.634811:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+3:6542:x1868795081676928:12345-0@lo:104: 00010000:00010000:1.0:1782221990.634826:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f087fb82e00/0xe2b7cc26e6810f5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810f61 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.634860:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782221990.634865:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+3:6542:x1868795081676928:12345-0@lo:104: Request processed in 55us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221990.634871:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1782221990.634886:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782221990.634891:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f08427df800/0xe2b7cc26e6810f76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810f7d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.634898:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08427df800 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:1.0:1782221990.634902:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f08427df800/0xe2b7cc26e6810f76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e6810f7d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.634910:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f08427df800/0xe2b7cc26e6810f76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e6810f7d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782221990.634917:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f08427df800/0xe2b7cc26e6810f76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e6810f7d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782221990.634924:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1782221990.634951:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f08427df800/0xe2b7cc26e6810f76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810f7d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.634957:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782221990.634975:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f08427df800/0xe2b7cc26e6810f76 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810f7d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.634982:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f08427df800/0xe2b7cc26e6810f76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810f7d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.635002:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782221990.635005:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f087fb82e00/0xe2b7cc26e6810f5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810f61 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.635011:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb82e00 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:1.0:1782221990.635014:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f087fb82e00/0xe2b7cc26e6810f5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e6810f61 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.635021:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f087fb82e00/0xe2b7cc26e6810f5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e6810f61 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782221990.635027:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f087fb82e00/0xe2b7cc26e6810f5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e6810f61 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782221990.635032:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1782221990.635047:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f087fb82e00/0xe2b7cc26e6810f5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810f61 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.635053:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782221990.635058:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f087fb82e00/0xe2b7cc26e6810f5a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810f61 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.635064:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f087fb82e00/0xe2b7cc26e6810f5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810f61 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.635076:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782221990.635078:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782221990.635080:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782221990.635098:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b787b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081677056:0@lo:103: 00000100:00100000:1.0:1782221990.635133:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221990.635160:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782221990.635166:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b785880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081677184:0@lo:103: 00000100:00100000:1.0:1782221990.635186:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221990.635225:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081677056 00000100:00100000:1.0:1782221990.635229:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081677056 00010000:00010000:1.0:1782221990.635266:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0841458600/0xe2b7cc26e6810f7d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810f76 expref: 16 pid: 6521 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782221990.635311:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081677184 00000100:00100000:1.0:1782221990.635315:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081677184 00010000:00010000:1.0:1782221990.635327:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f08427de600/0xe2b7cc26e6810f61 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810f5a expref: 17 pid: 6520 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782221990.635339:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782221990.635345:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b785f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:3655:x1868795081677056:12345-0@lo:103: 00010000:00010000:1.0:1782221990.635355:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782221990.635360:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0841458600/0xe2b7cc26e6810f7d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810f76 expref: 17 pid: 6521 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.635370:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0841458600/0xe2b7cc26e6810f7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e6810f76 expref: 17 pid: 6521 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.635384:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782221990.635411:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b785f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:3655:x1868795081677056:12345-0@lo:103: Request processed in 66us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221990.635417:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782221990.635432:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782221990.635448:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b784a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:3655:x1868795081677184:12345-0@lo:103: 00010000:00010000:1.0:1782221990.635464:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782221990.635469:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f08427de600/0xe2b7cc26e6810f61 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810f5a expref: 16 pid: 6520 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.635478:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f08427de600/0xe2b7cc26e6810f61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e6810f5a expref: 16 pid: 6520 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.635491:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e681101e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.635499:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e681101e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782221990.635511:0:6512:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010741737s 00010000:00010000:1.0:1782221990.635516:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e681101e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.635523:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e681101e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.635530:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e681101e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.635537:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e681101e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.635543:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83200 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:1.0:1782221990.635547:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e681101e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.635554:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e681101e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.635569:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e681101e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221990.635579:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782221990.635602:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b784a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:3655:x1868795081677184:12345-0@lo:103: Request processed in 164us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221990.635609:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782221990.635644:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b785880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081677184:0@lo:103: 00000100:00100000:1.0:1782221990.635653:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b787b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081677056:0@lo:103: 00010000:00010000:2.0:1782221990.636340:0:6542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0841458600/0xe2b7cc26e6810f7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e6810f76 expref: 15 pid: 6521 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221990.636354:0:6542:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b14000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6542:1868795081676800:0@lo:104: 00010000:00010000:2.0:1782221990.636365:0:6542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f08427de600/0xe2b7cc26e6810f61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e6810f5a expref: 14 pid: 6520 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221990.636374:0:6542:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b16a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6542:1868795081676928:0@lo:104: 00010000:00010000:2.0:1782221990.636391:0:6542:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e681101e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.636401:0:6542:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e681101e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.636407:0:6542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e681101e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221990.636414:0:6542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e681101e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221990.636530:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1782221990.645077:0:8434:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1782221990.645543:0:8434:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1782221990.645753:0:8434:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1782221990.645907:0:8434:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1782221990.646117:0:8434:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1782221990.647053:0:8434:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1782221990.651623:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1782221990.665618:0:8434:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1782221990.665628:0:8434:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1782221990.665663:0:8434:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1782221990.665709:0:8434:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.127@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1782221990.665727:0:8434:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1782221990.665748:0:8434:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1782221990.666904:0:8434:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782221990.667071:0:8434:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1782221991.467531:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1782221991.542574:0:8520:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782221991.542799:0:8520:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1782221992.491416:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782221992.941123:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081677312:0@lo:41: 00000100:00100000:0.0:1782221992.941201:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221992.941398:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081677312 00000100:00100000:3.0:1782221992.941406:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081677312 00000100:00100000:3.0:1782221992.941470:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782221992.941480:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081677312:12345-0@lo:41: 00000004:00000024:3.0:1782221992.941528:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:3.0:1782221992.941593:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081677312:12345-0@lo:41: Request processed in 114us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221992.941600:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782221992.941902:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b787b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081677440:0@lo:41: 00000100:00100000:1.0:1782221992.941934:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221992.942028:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081677440 00000100:00100000:0.0:1782221992.942033:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081677440 00000100:00100000:0.0:1782221992.942068:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782221992.942075:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081677440:12345-0@lo:41: 00000004:00000024:0.0:1782221992.942096:0:7480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1782221992.942147:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081677440:12345-0@lo:41: Request processed in 71us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221992.942154:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782221992.942195:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b787b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081677440:0@lo:41: 00000100:00100000:0.0:1782221992.942229:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081677312:0@lo:41: 00010000:00010000:1.0:1782221993.515510:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782221994.539768:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782221995.562385:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782221996.010523:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1868795081677696:0@lo:400: 00000100:00100000:0.0:1782221996.010601:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221996.010654:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1868795081678208:0@lo:400: 00000100:00100000:0.0:1782221996.010689:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221996.010717:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1782221996.010723:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081677568:0@lo:400: 00000100:00100000:0.0:1782221996.010751:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221996.010770:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1868795081678080:0@lo:400: 00000100:00100000:0.0:1782221996.010789:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221996.010813:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081677824:0@lo:400: 00000100:00100000:0.0:1782221996.010836:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221996.010852:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1868795081678336:0@lo:400: 00000100:00100000:0.0:1782221996.010869:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221996.010883:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782221996.010888:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081677952:0@lo:400: 00000100:00100000:0.0:1782221996.010906:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221996.010945:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081677696 00000100:00100000:0.0:1782221996.010952:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081677696 00000100:00100000:0.0:1782221996.010983:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081678208 00000100:00100000:0.0:1782221996.010986:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081678208 00000100:00100000:0.0:1782221996.011005:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081678080 00000100:00100000:0.0:1782221996.011008:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081678080 00000100:00100000:0.0:1782221996.011017:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081678336 00000100:00100000:0.0:1782221996.011020:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081678336 00000100:00100000:0.0:1782221996.011034:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782221996.011041:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1868795081677696:12345-0@lo:400: 00000100:00100000:0.0:1782221996.011090:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1868795081677696:12345-0@lo:400: Request processed in 48us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221996.011097:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782221996.011112:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782221996.011118:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1868795081678208:12345-0@lo:400: 00000100:00100000:0.0:1782221996.011152:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1868795081678208:12345-0@lo:400: Request processed in 34us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221996.011158:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782221996.011169:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782221996.011175:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1868795081678080:12345-0@lo:400: 00000100:00100000:0.0:1782221996.011197:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1868795081678080:12345-0@lo:400: Request processed in 23us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221996.011202:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782221996.011211:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782221996.011217:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1868795081678336:12345-0@lo:400: 00000100:00100000:0.0:1782221996.011273:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1868795081678336:12345-0@lo:400: Request processed in 55us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221996.011279:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782221996.011297:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081677568 00000100:00100000:0.0:1782221996.011301:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081677568 00000100:00100000:0.0:1782221996.011325:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1782221996.011331:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+14:3656:x1868795081677568:12345-0@lo:400: 00000100:00100000:0.0:1782221996.011359:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+14:3656:x1868795081677568:12345-0@lo:400: Request processed in 29us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221996.011366:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1782221996.011395:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081677824 00000100:00100000:0.0:1782221996.011398:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081677824 00000100:00100000:0.0:1782221996.011417:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081677952 00000100:00100000:0.0:1782221996.011420:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081677952 00000100:00100000:0.0:1782221996.011432:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782221996.011437:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081677824:12345-0@lo:400: 00000100:00100000:0.0:1782221996.011466:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081677824:12345-0@lo:400: Request processed in 29us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221996.011478:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782221996.011489:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782221996.011495:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081677952:12345-0@lo:400: 00000100:00100000:0.0:1782221996.011521:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081677952:12345-0@lo:400: Request processed in 26us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221996.011527:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782221996.011570:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081677952:0@lo:400: 00000100:00100000:0.0:1782221996.011581:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081677824:0@lo:400: 00010000:00080000:0.0:1782221996.011592:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f074561fb80 x1868795081678336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782221996.011601:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1868795081678336:0@lo:400: 00000100:00100000:0.0:1782221996.011626:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081677568:0@lo:400: 00010000:00080000:0.0:1782221996.011635:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f074561d880 x1868795081678080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782221996.011644:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1868795081678080:0@lo:400: 00010000:00080000:0.0:1782221996.011652:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f074561e300 x1868795081677696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782221996.011659:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1868795081677696:0@lo:400: 00010000:00080000:0.0:1782221996.011668:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f074561df80 x1868795081678208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782221996.011675:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1868795081678208:0@lo:400: 00000100:00080000:3.0:1782221996.011966:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782221996.011972:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782221996.588439:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782221996.874176:0:8809:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1782221997.611397:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1782221997.883053:0:8861:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782221997.884885:0:8861:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1782221998.058344:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782221998.058353:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8f0849b46800 from 30 10000000:01000000:1.0:1782221998.058359:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782221998.058405:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875802400/0xe2b7cc26e6811025 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221998.058418:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f0875802400/0xe2b7cc26e6811025 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221998.058429:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0875802400/0xe2b7cc26e6811025 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782221998.058466:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b786a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081678464:0@lo:101: 00000100:00100000:1.0:1782221998.058536:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221998.058602:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875c2d540 going to sleep for 11 seconds 00000100:00100000:0.0:1782221998.058672:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081678464 00000100:00100000:0.0:1782221998.058679:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081678464 00000100:00100000:0.0:1782221998.058731:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1782221998.058740:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+14:6523:x1868795081678464:12345-0@lo:101: 00010000:00010000:0.0:1782221998.058754:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782221998.058768:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0840031600/0xe2b7cc26e681102c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6811025 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221998.058791:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0840031600/0xe2b7cc26e681102c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6811025 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221998.058800:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0840031600/0xe2b7cc26e681102c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6811025 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221998.058808:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0840031600, rc 0) 00000100:00100000:0.0:1782221998.058847:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:6523:x1868795081678464:12345-0@lo:101: Request processed in 109us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221998.058854:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1782221998.059006:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b786a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081678464:0@lo:101: 00010000:00010000:1.0:1782221998.059021:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0875802400/0xe2b7cc26e6811025 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681102c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221998.059030:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0875802400/0xe2b7cc26e6811025 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e681102c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782221998.059087:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b786a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081678592:0@lo:501: 00000100:00100000:1.0:1782221998.059114:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221998.059138:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875c2d540 going to sleep for 11 seconds 00000100:00100000:0.0:1782221998.059204:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081678592 00000100:00100000:0.0:1782221998.059209:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081678592 00000100:00100000:0.0:1782221998.059293:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1782221998.059302:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0850982850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:6523:x1868795081678592:12345-0@lo:501: 00000100:00100000:0.0:1782221998.059411:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0850982850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:6523:x1868795081678592:12345-0@lo:501: Request processed in 110us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221998.059418:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1782221998.059507:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081678720:0@lo:41: 00000100:00100000:0.0:1782221998.059549:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221998.059597:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081678720 00000100:00100000:0.0:1782221998.059601:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081678720 00000100:00100000:0.0:1782221998.059629:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782221998.059637:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081678720:12345-0@lo:41: 00000004:00000024:0.0:1782221998.059664:0:7480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1782221998.059701:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081678720:12345-0@lo:41: Request processed in 65us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221998.059707:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782221998.059738:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081678720:0@lo:41: 00000100:00100000:1.0:1782221998.060079:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782221998.060093:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b785c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081678848:0@lo:41: 00000100:00100000:1.0:1782221998.060123:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221998.060164:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b786a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081678592:0@lo:501: 00000100:00100000:1.0:1782221998.060196:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b786a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081678976:0@lo:503: 00000100:00100000:1.0:1782221998.060274:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221998.060297:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875c2d540 going to sleep for 11 seconds 00000100:00100000:1.0:1782221998.060310:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081678976 00000100:00100000:1.0:1782221998.060313:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081678976 00000100:00100000:1.0:1782221998.060343:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1782221998.060352:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:6523:x1868795081678976:12345-0@lo:503: 00000100:00100000:1.0:1782221998.060449:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:6523:x1868795081678976:12345-0@lo:503: Request processed in 99us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221998.060461:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1782221998.060503:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b786a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081678976:0@lo:503: 00000100:00100000:3.0:1782221998.064278:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081678848 00000100:00100000:3.0:1782221998.064310:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081678848 00000100:00100000:3.0:1782221998.064520:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782221998.064529:0:8873:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8873:1868795081679104:0@lo:502: 00000100:00100000:3.0:1782221998.064540:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b785180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081678848:12345-0@lo:41: 00000100:00100000:0.0:1782221998.064635:0:8873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:3.0:1782221998.064657:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1782221998.064681:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081679104 00000100:00100000:0.0:1782221998.064689:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081679104 00000100:00100000:0.0:1782221998.064728:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1782221998.064737:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0850980c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:8873:x1868795081679104:12345-0@lo:502: 00000100:00100000:3.0:1782221998.064865:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b785180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081678848:12345-0@lo:41: Request processed in 332us (4738us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221998.064876:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782221998.064896:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0850980c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:8873:x1868795081679104:12345-0@lo:502: Request processed in 156us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221998.064906:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1782221998.064976:0:8873:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f085292af00 going to sleep for 11 seconds 00000100:00100000:0.0:1782221998.064999:0:8873:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8873:1868795081679104:0@lo:502: 00000100:00100000:0.0:1782221998.065057:0:8873:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8873:1868795081679232:0@lo:502: 00000100:00100000:0.0:1782221998.065088:0:8873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221998.065113:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081679232 00000100:00100000:0.0:1782221998.065117:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081679232 00000100:00100000:0.0:1782221998.065139:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1782221998.065151:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0850981450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:8873:x1868795081679232:12345-0@lo:502: 00000100:00100000:3.0:1782221998.065467:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b785c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081678848:0@lo:41: 00000100:00100000:1.0:1782221998.066433:0:8873:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f085292af00 going to sleep for 11 seconds 00000100:00100000:0.0:1782221998.066775:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0850981450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:8873:x1868795081679232:12345-0@lo:502: Request processed in 1620us (1682us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221998.066785:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1782221998.066971:0:8873:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8873:1868795081679232:0@lo:502: 00000040:00080000:1.0:1782221998.067016:0:8873:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1782221998.068402:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1782221998.068434:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782221998.068448:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875802400/0xe2b7cc26e6811025 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681102c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221998.068460:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f0875802400/0xe2b7cc26e6811025 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681102c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782221998.068471:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1782221998.068474:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8f0849b46800 from 5 10000000:01000000:2.0:1782221998.068477:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782221998.068518:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb82c00/0xe2b7cc26e6811033 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221998.068526:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f087fb82c00/0xe2b7cc26e6811033 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221998.068552:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f087fb82c00/0xe2b7cc26e6811033 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221998.068586:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b16a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081679360:0@lo:101: 00000100:00100000:2.0:1782221998.068642:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221998.068681:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b778240 going to sleep for 11 seconds 00000100:00100000:2.0:1782221998.068702:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081679360 00000100:00100000:2.0:1782221998.068709:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081679360 00000100:00100000:2.0:1782221998.068751:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1782221998.068759:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0850980850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:6523:x1868795081679360:12345-0@lo:101: 00010000:00010000:2.0:1782221998.068773:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782221998.068786:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f087fb83e00/0xe2b7cc26e681103a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6811033 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221998.068808:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fb83e00/0xe2b7cc26e681103a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6811033 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221998.068818:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f087fb83e00/0xe2b7cc26e681103a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6811033 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221998.068827:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb83e00, rc 0) 00000100:00100000:2.0:1782221998.068861:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0850980850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:6523:x1868795081679360:12345-0@lo:101: Request processed in 102us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221998.068868:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1782221998.068911:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b16a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081679360:0@lo:101: 00010000:00010000:2.0:1782221998.068924:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f087fb82c00/0xe2b7cc26e6811033 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681103a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221998.068944:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f087fb82c00/0xe2b7cc26e6811033 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e681103a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221998.068987:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b16a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081679488:0@lo:256: 00000100:00100000:2.0:1782221998.069015:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221998.069028:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b778240 going to sleep for 11 seconds 00000100:00100000:2.0:1782221998.069039:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081679488 00000100:00100000:2.0:1782221998.069042:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081679488 00000100:00100000:2.0:1782221998.069063:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1782221998.069068:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0850980050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:6523:x1868795081679488:12345-0@lo:256: 20000000:01000000:2.0:1782221998.069082:0:6520:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1782221998.069097:0:6520:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1782221998.069100:0:6520:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1782221998.069170:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0850980050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:6523:x1868795081679488:12345-0@lo:256: Request processed in 101us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221998.069177:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1782221998.069206:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b16a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081679488:0@lo:256: 10000000:01000000:2.0:1782221998.069283:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1782221998.069290:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb82c00/0xe2b7cc26e6811033 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681103a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221998.069298:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f087fb82c00/0xe2b7cc26e6811033 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681103a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782221998.069305:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1782221998.069308:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:2.0:1782221998.069310:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1782221998.069330:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb83400/0xe2b7cc26e6811041 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221998.069336:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f087fb83400/0xe2b7cc26e6811041 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221998.069344:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f087fb83400/0xe2b7cc26e6811041 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221998.069355:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b16a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081679616:0@lo:101: 00000100:00100000:2.0:1782221998.069378:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221998.069396:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b778240 going to sleep for 11 seconds 00000100:00100000:2.0:1782221998.069407:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081679616 00000100:00100000:2.0:1782221998.069410:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081679616 00000100:00100000:2.0:1782221998.069431:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1782221998.069437:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0850982c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:6523:x1868795081679616:12345-0@lo:101: 00010000:00010000:2.0:1782221998.069444:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782221998.069453:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f087fb83a00/0xe2b7cc26e6811048 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6811041 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221998.069466:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fb83a00/0xe2b7cc26e6811048 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6811041 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221998.069475:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f087fb83a00/0xe2b7cc26e6811048 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6811041 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221998.069481:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb83a00, rc 0) 00000100:00100000:2.0:1782221998.069506:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0850982c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:6523:x1868795081679616:12345-0@lo:101: Request processed in 68us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221998.069512:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1782221998.069543:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b16a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081679616:0@lo:101: 00010000:00010000:2.0:1782221998.069553:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f087fb83400/0xe2b7cc26e6811041 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811048 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782221998.069560:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f087fb83400/0xe2b7cc26e6811041 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6811048 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782221998.069606:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b16a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081679744:0@lo:501: 00000100:00100000:2.0:1782221998.069628:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221998.069639:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b778240 going to sleep for 11 seconds 00000100:00100000:2.0:1782221998.069649:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081679744 00000100:00100000:2.0:1782221998.069652:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081679744 00000100:00100000:2.0:1782221998.069669:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1782221998.069674:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0850981050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:6523:x1868795081679744:12345-0@lo:501: 00000100:00100000:2.0:1782221998.069785:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0850981050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:6523:x1868795081679744:12345-0@lo:501: Request processed in 109us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221998.069792:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1782221998.069818:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b16a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081679744:0@lo:501: 00000100:00100000:2.0:1782221998.069840:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b16a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081679872:0@lo:503: 00000100:00100000:2.0:1782221998.069876:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221998.069888:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b778240 going to sleep for 11 seconds 00000100:00100000:2.0:1782221998.069898:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081679872 00000100:00100000:2.0:1782221998.069901:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081679872 00000100:00100000:2.0:1782221998.069920:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1782221998.069925:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085541c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:6523:x1868795081679872:12345-0@lo:503: 00000100:00100000:2.0:1782221998.069992:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085541c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:6523:x1868795081679872:12345-0@lo:503: Request processed in 66us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221998.070007:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1782221998.070041:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b16a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081679872:0@lo:503: 00000100:00100000:2.0:1782221998.084828:0:8874:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b16a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8874:1868795081680000:0@lo:502: 00000100:00100000:2.0:1782221998.084908:0:8874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221998.084946:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081680000 00000100:00100000:2.0:1782221998.084953:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081680000 00000100:00100000:2.0:1782221998.084999:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1782221998.085009:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085541e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:8874:x1868795081680000:12345-0@lo:502: 00000100:00100000:2.0:1782221998.085121:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085541e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:8874:x1868795081680000:12345-0@lo:502: Request processed in 114us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221998.085130:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1782221998.085184:0:8874:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b778240 going to sleep for 11 seconds 00000100:00100000:2.0:1782221998.085221:0:8874:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b16a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8874:1868795081680000:0@lo:502: 00000020:01000000:2.0:1782221998.085350:0:8874:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1782221998.085358:0:8874:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1782221998.085366:0:8874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782221998.085368:0:8874:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1782221998.085374:0:8874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1782221998.085378:0:8874:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.127@tcp to nid 0x20000c0a8cb7f (192.168.203.127@tcp) 00000020:01000000:2.0:1782221998.085399:0:8874:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1782221998.085401:0:8874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782221998.085417:0:8874:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8f087fb94d40) 00000020:00000080:2.0:1782221998.085439:0:8874:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1782221998.085445:0:8874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1782221998.085554:0:8874:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1782221998.085562:0:8874:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1782221998.085576:0:8874:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe2b7cc26e6811056 00010000:00080000:2.0:1782221998.086324:0:8874:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f0745633000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.127@tcp at head 00010000:00010000:2.0:1782221998.086553:0:8874:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1782221998.109101:0:8874:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1782221998.109124:0:8874:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1782221998.109368:0:8874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782221998.110743:0:8874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782221998.110842:0:8874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1782221998.110925:0:8874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1782221998.111372:0:8877:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782221998.111378:0:8877:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1782221998.113962:0:8874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1782221998.113978:0:8874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1782221998.114018:0:8874:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1782221998.114042:0:8874:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe2b7cc26e681105d 00000100:00080000:0.0:1782221998.114053:0:8874:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782221998.114059:0:8874:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8f0745633000 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:0.0:1782221998.114096:0:8874:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f074561d880 x1868795081680128/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782221998.114150:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1868795081680128:0@lo:8: 00000100:00100000:1.0:1782221998.114218:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221998.114332:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081680128 00000100:00100000:0.0:1782221998.114339:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081680128 00000100:00100000:0.0:1782221998.114368:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782221998.114376:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b786a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3652:x1868795081680128:12345-0@lo:8: 00010000:00080000:0.0:1782221998.114412:0:8440:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:0.0:1782221998.114441:0:8440:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe2b7cc26e6811064 00002000:00100000:0.0:1782221998.114476:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8f0746086000 ocd_connect_flags: 0xe044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1782221998.114480:0:8440:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1782221998.114485:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1782221998.114546:0:8440:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1782221998.114837:0:8440:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1782221998.114861:0:8440:0:(import.c:65:import_set_state_nolock()) ffff8f0746085800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782221998.118612:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b786a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3652:x1868795081680128:12345-0@lo:8: Request processed in 4225us (4383us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221998.118626:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1782221998.118675:0:8874:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1782221998.118786:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1868795081680640:0@lo:400: 00000100:00100000:0.0:1782221998.118837:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221998.118863:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782221998.118869:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1868795081680256:0@lo:400: 00000100:00100000:0.0:1782221998.118890:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221998.118914:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1868795081680384:0@lo:400: 00000100:00100000:0.0:1782221998.118938:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221998.118959:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782221998.118965:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1868795081680512:0@lo:400: 00000100:00100000:0.0:1782221998.118983:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221998.119011:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081680640 00000100:00100000:0.0:1782221998.119018:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081680640 00000100:00100000:0.0:1782221998.119063:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081680256 00000100:00100000:0.0:1782221998.119066:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081680256 00000100:00100000:0.0:1782221998.119076:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081680384 00000100:00100000:0.0:1782221998.119079:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081680384 00000100:00100000:0.0:1782221998.119088:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081680512 00000100:00100000:0.0:1782221998.119090:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081680512 00000100:00100000:0.0:1782221998.119103:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782221998.119110:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1868795081680640:12345-0@lo:400: 00000100:00100000:0.0:1782221998.119158:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1868795081680640:12345-0@lo:400: Request processed in 48us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221998.119165:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782221998.119176:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782221998.119182:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1868795081680256:12345-0@lo:400: 00000100:00100000:0.0:1782221998.119206:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1868795081680256:12345-0@lo:400: Request processed in 24us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221998.119221:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782221998.119267:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782221998.119275:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1868795081680384:12345-0@lo:400: 00000100:00100000:0.0:1782221998.119307:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1868795081680384:12345-0@lo:400: Request processed in 33us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221998.119313:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782221998.119324:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782221998.119329:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1868795081680512:12345-0@lo:400: 00000100:00100000:0.0:1782221998.119352:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1868795081680512:12345-0@lo:400: Request processed in 24us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221998.119358:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1782221998.119538:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f074561ed80 x1868795081680512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782221998.119553:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1868795081680512:0@lo:400: 00010000:00080000:0.0:1782221998.119563:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f074561fb80 x1868795081680384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782221998.119621:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1868795081680384:0@lo:400: 00010000:00080000:0.0:1782221998.119659:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f074561f100 x1868795081680256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782221998.119668:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1868795081680256:0@lo:400: 00010000:00080000:0.0:1782221998.119678:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f074561ce00 x1868795081680640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782221998.119687:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1868795081680640:0@lo:400: 00000100:00080000:3.0:1782221998.119756:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:0.0:1782221998.119775:0:8874:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782221998.119782:0:8874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782221998.119784:0:8874:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1782221998.119787:0:8874:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782221998.119792:0:8874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782221998.119793:0:8874:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782221998.119797:0:8874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782221998.119799:0:8874:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1782221998.119824:0:8874:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8874:1868795081680768:0@lo:502: 00000100:00100000:0.0:1782221998.119868:0:8874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221998.119893:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081680768 00000100:00100000:0.0:1782221998.119897:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081680768 00000100:00080000:3.0:1782221998.119915:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782221998.119929:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1782221998.119937:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085541d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:8874:x1868795081680768:12345-0@lo:502: 00000100:00100000:0.0:1782221998.120033:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085541d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:8874:x1868795081680768:12345-0@lo:502: Request processed in 96us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221998.120040:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1782221998.120084:0:8874:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f085292acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782221998.120096:0:8874:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8874:1868795081680768:0@lo:502: 00000020:01000000:0.0:1782221998.120117:0:8874:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782221998.120121:0:8874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782221998.120123:0:8874:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:0.0:1782221998.120126:0:8874:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:0.0:1782221998.120178:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:0.0:1782221998.120467:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1782221998.120478:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb83400/0xe2b7cc26e6811041 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811048 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221998.120489:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f087fb83400/0xe2b7cc26e6811041 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811048 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782221998.120507:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1782221998.120509:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8f08490d0000 from 30 10000000:01000000:0.0:1782221998.120512:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782221998.120538:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0840031e00/0xe2b7cc26e681106b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221998.120546:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f0840031e00/0xe2b7cc26e681106b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221998.120555:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0840031e00/0xe2b7cc26e681106b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782221998.120568:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081680896:0@lo:101: 00000100:00100000:0.0:1782221998.121511:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221998.121542:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f085292acc0 going to sleep for 11 seconds 00010000:00080000:1.0:1782221998.122504:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f074561d880 x1868795081680128/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782222008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782221998.122517:0:3652:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782221998.122526:0:3652:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1782221998.122536:0:3652:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xe040401443000026 00000100:00080000:1.0:1782221998.122541:0:3652:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1782221998.122545:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f0745633000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1782221998.122561:0:3652:0:(osp_dev.c:1650:osp_import_event()) got connected 00000100:00100000:1.0:1782221998.122568:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1868795081680128:0@lo:8: 00000100:00100000:1.0:1782221998.122703:0:8878:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b785c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8878:1868795081681024:0@lo:700: 00000100:00100000:1.0:1782221998.122754:0:8878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221998.122801:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081681024 00000100:00100000:1.0:1782221998.122807:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081681024 00000100:00100000:1.0:1782221998.122856:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782221998.122865:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b787b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8878:x1868795081681024:12345-0@lo:700: 00000100:00100000:1.0:1782221998.122902:0:8449:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849baf480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8449:1868795081681152:0@lo:700: 00000100:00100000:1.0:1782221998.122934:0:8449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221998.122953:0:8449:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875c2de40 going to sleep for 11 seconds 00000100:00100000:1.0:1782221998.122967:0:8878:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875c2df00 going to sleep for 11 seconds 00000004:00080000:0.0:1782221998.123035:0:8877:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1782221998.123112:0:8877:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 197151876361ns, next at 0ns, rc = 0 00080000:00080000:0.0:1782221998.123118:0:8877:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1782221998.123301:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081680896 00000100:00100000:0.0:1782221998.123307:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081680896 00000100:00100000:0.0:1782221998.123338:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1782221998.123344:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085541f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:6523:x1868795081680896:12345-0@lo:101: 00010000:00010000:0.0:1782221998.123354:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782221998.123373:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0840031400/0xe2b7cc26e6811072 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e681106b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221998.123472:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0840031400/0xe2b7cc26e6811072 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e681106b expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221998.123496:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0840031400/0xe2b7cc26e6811072 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e681106b expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221998.123504:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0840031400, rc 0) 00000100:00100000:0.0:1782221998.123545:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085541f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:6523:x1868795081680896:12345-0@lo:101: Request processed in 201us (2037us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221998.123551:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1782221998.124747:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081680896:0@lo:101: 00010000:00010000:0.0:1782221998.124772:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0840031e00/0xe2b7cc26e681106b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811072 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221998.124784:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0840031e00/0xe2b7cc26e681106b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6811072 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782221998.124861:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081681280:0@lo:501: 00000100:00100000:0.0:1782221998.124907:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221998.124957:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f085292acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782221998.125836:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081681280 00000100:00100000:2.0:1782221998.125846:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081681280 00000100:00100000:2.0:1782221998.126104:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1782221998.126114:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:6523:x1868795081681280:12345-0@lo:501: 00000100:00100000:2.0:1782221998.126352:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:6523:x1868795081681280:12345-0@lo:501: Request processed in 240us (1444us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221998.126360:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:3.0:1782221998.127859:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782221998.127907:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081681152 00000100:00100000:3.0:1782221998.127919:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081681152 00000100:00100000:3.0:1782221998.128001:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000004:00080000:1.0:1782221998.128002:0:7458:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1782221998.128020:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849baf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8449:x1868795081681152:12345-0@lo:700: 00000100:00100000:2.0:1782221998.128143:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081681280:0@lo:501: 00000100:00100000:2.0:1782221998.128207:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b16a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081681408:0@lo:503: 00000100:00100000:2.0:1782221998.128326:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221998.128360:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b778c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782221998.128400:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081681408 00000100:00100000:2.0:1782221998.128406:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081681408 00000100:00100000:2.0:1782221998.128448:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1782221998.128456:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:6523:x1868795081681408:12345-0@lo:503: 00000100:00100000:2.0:1782221998.128558:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:6523:x1868795081681408:12345-0@lo:503: Request processed in 101us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221998.128566:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1782221998.131926:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b16a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081681408:0@lo:503: 00000100:00100000:1.0:1782221998.132223:0:8880:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849bafb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8880:1868795081681536:0@lo:502: 00000100:00100000:1.0:1782221998.132317:0:8880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221998.132354:0:8880:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875c2d840 going to sleep for 11 seconds 00000100:00100000:2.0:1782221998.134090:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081681536 00000100:00100000:2.0:1782221998.134103:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081681536 00000100:00100000:2.0:1782221998.134159:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1782221998.134170:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:8880:x1868795081681536:12345-0@lo:502: 00000100:00100000:2.0:1782221998.142829:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:8880:x1868795081681536:12345-0@lo:502: Request processed in 8653us (10504us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221998.142850:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1782221998.142916:0:8880:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849bafb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8880:1868795081681536:0@lo:502: 00000100:00100000:2.0:1782221998.142984:0:8880:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b14000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8880:1868795081681664:0@lo:502: 00000100:00100000:2.0:1782221998.143023:0:8880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221998.143050:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081681664 00000100:00100000:2.0:1782221998.143056:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081681664 00000100:00100000:2.0:1782221998.143088:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1782221998.143095:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:8880:x1868795081681664:12345-0@lo:502: 00000100:00100000:2.0:1782221998.143167:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:8880:x1868795081681664:12345-0@lo:502: Request processed in 72us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221998.143173:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1782221998.143207:0:8880:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b778840 going to sleep for 11 seconds 00000100:00100000:2.0:1782221998.143218:0:8880:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b14000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8880:1868795081681664:0@lo:502: 40000000:02000000:2.0:1782221998.152496:0:6533:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000040:00080000:3.0:1782221998.167008:0:8880:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1782221998.167744:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1782221998.167782:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782221998.167795:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0840031e00/0xe2b7cc26e681106b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811072 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221998.167807:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f0840031e00/0xe2b7cc26e681106b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811072 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782221998.167817:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1782221998.167819:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8f08490d0000 from 5 10000000:01000000:1.0:1782221998.167822:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782221998.167857:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e6811079 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221998.167867:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e6811079 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221998.167891:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e6811079 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782221998.167915:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849bac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081681792:0@lo:101: 00000100:00100000:1.0:1782221998.167977:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221998.168010:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875c2d480 going to sleep for 11 seconds 00000100:00100000:1.0:1782221998.168029:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081681792 00000100:00100000:1.0:1782221998.168035:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081681792 00000100:00100000:1.0:1782221998.168085:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1782221998.168094:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:6523:x1868795081681792:12345-0@lo:101: 00010000:00010000:1.0:1782221998.168108:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782221998.168119:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0875802e00/0xe2b7cc26e6811080 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6811079 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221998.168141:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0875802e00/0xe2b7cc26e6811080 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6811079 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221998.168151:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0875802e00/0xe2b7cc26e6811080 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6811079 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221998.168161:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0875802e00, rc 0) 00000100:00100000:1.0:1782221998.168213:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+19:6523:x1868795081681792:12345-0@lo:101: Request processed in 119us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221998.168220:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1782221998.168293:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849bac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081681792:0@lo:101: 00010000:00010000:1.0:1782221998.168306:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e6811079 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811080 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221998.168325:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e6811079 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6811080 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782221998.168369:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849bac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081681920:0@lo:256: 00000100:00100000:1.0:1782221998.168396:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221998.168418:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875c2d480 going to sleep for 11 seconds 00000100:00100000:2.0:1782221998.168731:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081681920 00000100:00100000:2.0:1782221998.168736:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081681920 00000100:00100000:2.0:1782221998.168771:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1782221998.168779:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+19:6523:x1868795081681920:12345-0@lo:256: 20000000:01000000:2.0:1782221998.168793:0:6519:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1782221998.168811:0:6519:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1782221998.168814:0:6519:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1782221998.168891:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+19:6523:x1868795081681920:12345-0@lo:256: Request processed in 112us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221998.168898:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1782221998.169579:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849baf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8449:x1868795081681152:12345-0@lo:700: Request processed in 41562us (46641us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221998.169596:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1782221998.169641:0:8449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0849baf480 x1868795081681152/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1782222014 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782221998.169655:0:8449:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849baf480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8449:1868795081681152:0@lo:700: 40000000:02000000:2.0:1782221998.169664:0:8449:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:1.0:1782221998.171810:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849bac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081681920:0@lo:256: 10000000:01000000:1.0:1782221998.171876:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782221998.171886:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e6811079 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811080 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221998.171898:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e6811079 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811080 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782221998.171908:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1782221998.171910:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1782221998.171913:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1782221998.171945:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875802000/0xe2b7cc26e6811087 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221998.171953:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f0875802000/0xe2b7cc26e6811087 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221998.171962:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0875802000/0xe2b7cc26e6811087 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782221998.171980:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849bac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081682048:0@lo:101: 00000100:00100000:1.0:1782221998.172043:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221998.172095:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875c2d480 going to sleep for 11 seconds 00000100:00100000:1.0:1782221998.172116:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081682048 00000100:00100000:1.0:1782221998.172122:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081682048 00000100:00100000:1.0:1782221998.172168:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1782221998.172177:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+19:6523:x1868795081682048:12345-0@lo:101: 00010000:00010000:1.0:1782221998.172204:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782221998.172217:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0875802200/0xe2b7cc26e681108e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6811087 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221998.172266:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0875802200/0xe2b7cc26e681108e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6811087 expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221998.172277:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0875802200/0xe2b7cc26e681108e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6811087 expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221998.172287:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0875802200, rc 0) 00000100:00100000:1.0:1782221998.172322:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:6523:x1868795081682048:12345-0@lo:101: Request processed in 145us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221998.172329:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1782221998.172366:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849bac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081682048:0@lo:101: 00010000:00010000:1.0:1782221998.172380:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0875802000/0xe2b7cc26e6811087 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681108e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782221998.172390:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0875802000/0xe2b7cc26e6811087 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e681108e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782221998.172443:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849bac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081682176:0@lo:501: 00000100:00100000:1.0:1782221998.172491:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221998.172504:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875c2d480 going to sleep for 11 seconds 00000100:00100000:1.0:1782221998.172515:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081682176 00000100:00100000:1.0:1782221998.172518:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081682176 00000100:00100000:1.0:1782221998.172536:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1782221998.172542:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:6523:x1868795081682176:12345-0@lo:501: 00000100:00100000:1.0:1782221998.172652:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:6523:x1868795081682176:12345-0@lo:501: Request processed in 110us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221998.172660:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1782221998.172689:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849bac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081682176:0@lo:501: 00000100:00100000:1.0:1782221998.172713:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849bac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081682304:0@lo:503: 00000100:00100000:1.0:1782221998.172749:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221998.172762:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875c2d480 going to sleep for 11 seconds 00000100:00100000:1.0:1782221998.172774:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081682304 00000100:00100000:1.0:1782221998.172777:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081682304 00000100:00100000:1.0:1782221998.172794:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1782221998.172799:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:6523:x1868795081682304:12345-0@lo:503: 00000100:00100000:1.0:1782221998.172871:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:6523:x1868795081682304:12345-0@lo:503: Request processed in 71us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221998.172877:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1782221998.172911:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849bac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081682304:0@lo:503: 00000100:00100000:3.0:1782221998.173589:0:8882:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8882:1868795081682432:0@lo:502: 00000100:00100000:3.0:1782221998.173631:0:8882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221998.173661:0:8882:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08511ac840 going to sleep for 11 seconds 00000100:00100000:0.0:1782221998.173674:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081682432 00000100:00100000:0.0:1782221998.173682:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081682432 00000100:00100000:0.0:1782221998.173728:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1782221998.173736:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:8882:x1868795081682432:12345-0@lo:502: 00000100:00100000:0.0:1782221998.173849:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:8882:x1868795081682432:12345-0@lo:502: Request processed in 113us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221998.173857:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1782221998.174441:0:8882:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8882:1868795081682432:0@lo:502: 00000020:01000000:3.0:1782221998.174549:0:8882:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782221998.174558:0:8882:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1782221998.174566:0:8882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782221998.174569:0:8882:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1782221998.174574:0:8882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1782221998.174644:0:8882:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.127@tcp to nid 0x20000c0a8cb7f (192.168.203.127@tcp) 00000020:01000000:3.0:1782221998.174671:0:8882:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1782221998.174674:0:8882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782221998.174695:0:8882:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8f07460f0000) 00000020:00000080:3.0:1782221998.174718:0:8882:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1782221998.174725:0:8882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1782221998.174806:0:8882:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1782221998.174811:0:8882:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:3.0:1782221998.174818:0:8882:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe2b7cc26e681109c 00010000:00080000:3.0:1782221998.174848:0:8882:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f07463b2000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.127@tcp at head 00010000:00010000:3.0:1782221998.175075:0:8882:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000001:00100000:3.0:1782221998.200590:0:8436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1782221998.200848:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b787b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8878:x1868795081681024:12345-0@lo:700: Request processed in 77975us (78086us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221998.200884:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1782221998.201615:0:8878:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f086b785c00 x1868795081681024/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782222014 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782221998.201637:0:8878:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b785c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8878:1868795081681024:0@lo:700: 00000040:01000000:0.0:1782221998.202102:0:8882:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1782221998.202122:0:8882:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1782221998.202393:0:8882:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782221998.202743:0:8882:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782221998.202835:0:8882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1782221998.202922:0:8882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1782221998.206320:0:8884:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782221998.206328:0:8884:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1782221998.220597:0:8882:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1782221998.220613:0:8882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1782221998.220656:0:8882:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1782221998.220678:0:8882:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe2b7cc26e68110a3 00000100:00080000:0.0:1782221998.220688:0:8882:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782221998.220694:0:8882:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f07463b2000 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:0.0:1782221998.220728:0:8882:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f074561f100 x1868795081682560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782221998.220750:0:8882:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1782221998.220818:0:8882:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782221998.220823:0:8882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782221998.220826:0:8882:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1782221998.220830:0:8882:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782221998.220834:0:8882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782221998.220836:0:8882:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782221998.220839:0:8882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782221998.220841:0:8882:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1782221998.220869:0:8882:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8882:1868795081682688:0@lo:502: 00000100:00100000:0.0:1782221998.220946:0:8882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221998.221056:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081682688 00000100:00100000:2.0:1782221998.221073:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081682688 00000100:00100000:2.0:1782221998.221147:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1782221998.221159:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:8882:x1868795081682688:12345-0@lo:502: 00000100:00100000:2.0:1782221998.221830:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:8882:x1868795081682688:12345-0@lo:502: Request processed in 671us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221998.221841:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1782221998.222904:0:8882:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08502346c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782221998.222945:0:8882:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:8882:1868795081682688:0@lo:502: 00000020:01000000:0.0:1782221998.222999:0:8882:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:2.0:1782221998.223016:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081682560:0@lo:8: 00000020:00000080:0.0:1782221998.223018:0:8882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782221998.223023:0:8882:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:0.0:1782221998.223040:0:8882:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:2.0:1782221998.223114:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221998.223203:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081682560 00000100:00100000:2.0:1782221998.223212:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081682560 00000100:00100000:2.0:1782221998.223291:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782221998.223305:0:8440:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1782221998.223306:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3652:x1868795081682560:12345-0@lo:8: 00000100:00100000:0.0:1782221998.223330:0:8440:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:2.0:1782221998.223351:0:8443:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:2.0:1782221998.223402:0:8443:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe2b7cc26e68110aa 00002000:00100000:2.0:1782221998.223419:0:8443:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8f0745634800 ocd_connect_flags: 0xe044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1782221998.223435:0:8443:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1782221998.223439:0:8443:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1782221998.223554:0:8443:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000004:00080000:1.0:1782221998.223575:0:8878:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00080000:2.0:1782221998.223591:0:8443:0:(import.c:65:import_set_state_nolock()) ffff8f0745637000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782221998.223674:0:8878:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849baf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8878:1868795081682944:0@lo:7: 00000100:00100000:2.0:1782221998.223677:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3652:x1868795081682560:12345-0@lo:8: Request processed in 359us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221998.223693:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1782221998.223745:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f074561f100 x1868795081682560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782222008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782221998.223759:0:8878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221998.223774:0:3652:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782221998.223783:0:3652:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1782221998.223793:0:3652:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xe040401443000026 00000100:00100000:1.0:1782221998.223795:0:8878:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875c2d480 going to sleep for 11 seconds 00000100:00080000:2.0:1782221998.223803:0:3652:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1782221998.223808:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f07463b2000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1782221998.223833:0:3652:0:(osp_dev.c:1650:osp_import_event()) got connected 00000100:00100000:1.0:1782221998.223835:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081682816:0@lo:13: 00000100:00100000:2.0:1782221998.223843:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081682560:0@lo:8: 00000100:00100000:1.0:1782221998.223882:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221998.223940:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081682944 00000100:00100000:1.0:1782221998.223947:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081682944 00000100:00100000:1.0:1782221998.223985:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782221998.223993:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849bafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8878:x1868795081682944:12345-0@lo:7: 00000100:00100000:2.0:1782221998.225137:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081682816 00000100:00100000:2.0:1782221998.225150:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081682816 00000100:00100000:2.0:1782221998.225217:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782221998.225254:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088159ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3656:x1868795081682816:12345-0@lo:13: 00002000:00000024:2.0:1782221998.225292:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923943424 avail 3692421120 00000100:00100000:2.0:1782221998.225392:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088159ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3656:x1868795081682816:12345-0@lo:13: Request processed in 165us (1510us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221998.225404:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:3.0:1782221998.226127:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1782221998.226166:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1782221998.226178:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875802000/0xe2b7cc26e6811087 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681108e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221998.226191:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f0875802000/0xe2b7cc26e6811087 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681108e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782221998.226201:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1782221998.226203:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8f087805cd40 from 1 10000000:01000000:3.0:1782221998.226206:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782221998.226276:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0841459a00/0xe2b7cc26e68110b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221998.226295:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f0841459a00/0xe2b7cc26e68110b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782221998.226305:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0841459a00/0xe2b7cc26e68110b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782221998.226334:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081683072:0@lo:101: 00000100:00100000:3.0:1782221998.226389:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221998.226442:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08490a2cc0 going to sleep for 11 seconds 00000004:00080000:3.0:1782221998.227306:0:8884:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1782221998.228469:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081683072 00000100:00100000:0.0:1782221998.228483:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081683072 00000100:00100000:0.0:1782221998.228537:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1782221998.228547:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:6523:x1868795081683072:12345-0@lo:101: 00010000:00010000:0.0:1782221998.228562:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782221998.228580:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0840031a00/0xe2b7cc26e68110b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e68110b1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221998.228610:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0840031a00/0xe2b7cc26e68110b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e68110b1 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221998.228621:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0840031a00/0xe2b7cc26e68110b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68110b1 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221998.228631:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0840031a00, rc 0) 00000100:00100000:0.0:1782221998.228705:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:6523:x1868795081683072:12345-0@lo:101: Request processed in 159us (2314us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221998.228712:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1782221998.228786:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081683072:0@lo:101: 00010000:00010000:0.0:1782221998.228802:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0841459a00/0xe2b7cc26e68110b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68110b8 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221998.228811:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0841459a00/0xe2b7cc26e68110b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e68110b8 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782221998.228894:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081683200:0@lo:501: 00000100:00100000:0.0:1782221998.228925:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221998.228953:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f084a056e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782221998.228968:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081683200 00000100:00100000:0.0:1782221998.228971:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081683200 00000100:00100000:0.0:1782221998.228991:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1782221998.228997:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:6523:x1868795081683200:12345-0@lo:501: 00000100:00100000:0.0:1782221998.229063:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:6523:x1868795081683200:12345-0@lo:501: Request processed in 66us (138us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782221998.229069:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1782221998.229095:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081683200:0@lo:501: 00000004:00080000:3.0:1782221998.230343:0:8884:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 197259106176ns, next at 0ns, rc = 0 00080000:00080000:3.0:1782221998.230352:0:8884:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 10000000:01000000:0.0:1782221998.230548:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1782221998.230560:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0841459a00/0xe2b7cc26e68110b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68110b8 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782221998.230570:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f0841459a00/0xe2b7cc26e68110b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68110b8 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1782221998.232402:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0849bac380 x1868795081682816/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222014 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782221998.232431:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081682816:0@lo:13: 00000004:00080000:0.0:1782221998.234509:0:6505:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1782221998.234607:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081683328:0@lo:13: 00000100:00100000:0.0:1782221998.234675:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1782221998.234733:0:8886:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1782221998.234762:0:8886:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8886:1868795081683456:0@lo:7: 00000100:00100000:0.0:1782221998.234792:0:8886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221998.234820:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081683328 00000100:00100000:0.0:1782221998.234829:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081683456 00000100:00100000:3.0:1782221998.234837:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081683328 00000100:00100000:0.0:1782221998.234840:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081683456 00000100:00100000:3.0:1782221998.234935:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782221998.235313:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782221998.235463:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8886:x1868795081683456:12345-0@lo:7: 00000100:00100000:0.0:1782221998.235536:0:8886:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f084a056e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782221998.238353:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3653:x1868795081683328:12345-0@lo:13: 00002000:00000024:3.0:1782221998.238401:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923943424 avail 3692421120 00000100:00100000:3.0:1782221998.238716:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3653:x1868795081683328:12345-0@lo:13: Request processed in 3758us (4027us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221998.238728:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1782221998.238787:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782221998.241291:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f074561fb80 x1868795081683328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222014 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782221998.241321:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081683328:0@lo:13: 00002000:00080000:1.0:1782221998.242753:0:8442:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1782221998.242760:0:8442:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1782221998.242848:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849bafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8878:x1868795081682944:12345-0@lo:7: Request processed in 18852us (19095us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221998.242858:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1782221998.243779:0:8878:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0849baf480 x1868795081682944/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782222014 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782221998.243795:0:8878:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849baf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8878:1868795081682944:0@lo:7: 00000004:00080000:0.0:1782221998.243807:0:8878:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:0.0:1782221998.243846:0:8878:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8878:1868795081683584:0@lo:5: 00000100:00100000:0.0:1782221998.243889:0:8878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221998.243922:0:8878:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087d41d300 going to sleep for 11 seconds 00000100:00100000:1.0:1782221998.247871:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081683584 00000100:00100000:1.0:1782221998.247882:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081683584 00000100:00100000:1.0:1782221998.247940:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782221998.247950:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8878:x1868795081683584:12345-0@lo:5: 00002000:00080000:1.0:1782221998.247980:0:8887:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1782221998.248061:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8878:x1868795081683584:12345-0@lo:5: Request processed in 113us (4171us total) trans 0 rc 0/0 00000100:00100000:1.0:1782221998.248068:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1782221998.248204:0:8878:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f074561fb80 x1868795081683584/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782222014 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782221998.248221:0:8878:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8878:1868795081683584:0@lo:5: 00000004:00080000:0.0:1782221998.248265:0:8878:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1782221998.248309:0:8878:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8878:1868795081683712:0@lo:5: 00000100:00100000:0.0:1782221998.248353:0:8878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782221998.248534:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081683712 00000100:00100000:1.0:1782221998.248539:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081683712 00000100:00100000:1.0:1782221998.248570:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782221998.248589:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849baf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8878:x1868795081683712:12345-0@lo:5: 00002000:00080000:1.0:1782221998.248617:0:8442:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1782221998.249729:0:8878:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087d41d300 going to sleep for 11 seconds 00000100:00100000:1.0:1782221998.254072:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849baf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8878:x1868795081683712:12345-0@lo:5: Request processed in 5487us (5711us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1782221998.254093:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1782221998.254295:0:8878:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f074561fb80 x1868795081683712/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782222014 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782221998.254314:0:8878:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8878:1868795081683712:0@lo:5: 00000004:00080000:0.0:1782221998.254336:0:8878:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1782221998.254665:0:8878:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849bac380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8878:1868795081683840:0@lo:900: 00000100:00100000:0.0:1782221998.254721:0:8878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782221998.254758:0:8878:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087d41d300 going to sleep for 11 seconds 00000100:00100000:2.0:1782221998.255620:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081683840 00000100:00100000:2.0:1782221998.255638:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081683840 00000100:00100000:2.0:1782221998.255739:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782221998.255769:0:6537:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 2 min 2 max 256 00000100:00100000:2.0:1782221998.255771:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8878:x1868795081683840:12345-0@lo:900: 00000100:00100000:0.0:1782221998.255782:0:6537:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0002' 00002000:00080000:3.0:1782221998.255975:0:8443:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1782221998.255982:0:8443:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1782221998.256067:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8886:x1868795081683456:12345-0@lo:7: Request processed in 20608us (21272us total) trans 0 rc 0/0 00000100:00100000:3.0:1782221998.256081:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1782221998.256130:0:8886:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f074561f100 x1868795081683456/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782222014 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782221998.256144:0:8886:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8886:1868795081683456:0@lo:7: 00000004:00080000:0.0:1782221998.256156:0:8886:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1782221998.256204:0:8886:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877157b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8886:1868795081683968:0@lo:5: 00000100:00100000:0.0:1782221998.256281:0:8886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221998.256286:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8878:x1868795081683840:12345-0@lo:900: Request processed in 462us (1503us total) trans 0 rc 0/0 00000100:00100000:2.0:1782221998.256300:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782221998.256311:0:8886:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f084a056e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782221998.256352:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081683968 00000100:00100000:1.0:1782221998.256361:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081683968 00000100:00100000:1.0:1782221998.256408:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782221998.256417:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8886:x1868795081683968:12345-0@lo:5: 00002000:00080000:1.0:1782221998.256442:0:8887:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1782221998.256446:0:8887:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00010000:00080000:3.0:1782221998.261684:0:8878:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0849bac380 x1868795081683840/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1782222014 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782221998.261703:0:8878:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849bac380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8878:1868795081683840:0@lo:900: 00000001:00080000:1.0:1782221998.267318:0:8436:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:1.0:1782221998.267587:0:8436:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1782221998.267662:0:8436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1782221998.267907:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8886:x1868795081683968:12345-0@lo:5: Request processed in 11482us (11619us total) trans 4294967298 rc 0/0 00010000:00080000:3.0:1782221998.267977:0:8886:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0877157b80 x1868795081683968/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782222014 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782221998.267992:0:8886:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1782221998.267999:0:8886:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877157b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8886:1868795081683968:0@lo:5: 00000004:00080000:3.0:1782221998.268014:0:8886:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1782221998.268066:0:8886:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8886:1868795081684096:0@lo:700: 00000100:00100000:3.0:1782221998.268124:0:8886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782221998.268164:0:8886:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087d41d300 going to sleep for 11 seconds 00000100:00100000:2.0:1782221998.268534:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782221998.268631:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081684096 00000100:00100000:1.0:1782221998.268640:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081684096 00000100:00100000:1.0:1782221998.268683:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782221998.268692:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8886:x1868795081684096:12345-0@lo:700: 00000100:00100000:0.0:1782221998.286374:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8886:x1868795081684096:12345-0@lo:700: Request processed in 17673us (18240us total) trans 0 rc 0/0 00000100:00100000:0.0:1782221998.286387:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1782221998.286567:0:8886:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f087fdb2300 x1868795081684096/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782222014 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782221998.286590:0:8886:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8886:1868795081684096:0@lo:700: 00000004:02000040:1.0:1782221998.292899:0:8886:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:1.0:1782221998.306451:0:8886:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881598e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8886:1868795081684224:0@lo:5: 00000100:00100000:1.0:1782221998.306554:0:8886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782221998.306684:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081684224 00000100:00100000:2.0:1782221998.306697:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081684224 00000100:00100000:1.0:1782221998.306725:0:8886:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875c2d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782221998.306768:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782221998.306777:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8886:x1868795081684224:12345-0@lo:5: 00002000:00080000:3.0:1782221998.323860:0:8442:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1782221998.323882:0:8442:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:3.0:1782221998.327077:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8886:x1868795081684224:12345-0@lo:5: Request processed in 20294us (20517us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1782221998.327089:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1782221998.327703:0:8886:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0881598e00 x1868795081684224/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782222014 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782221998.327730:0:8886:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881598e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8886:1868795081684224:0@lo:5: 00000004:00080000:1.0:1782221998.327754:0:8886:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:3.0:1782221998.642640:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782221999.065936:0:8436:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:0.0:1782221999.661082:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222000.685601:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1782222001.255169:0:8973:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782222001.255779:0:8973:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1782222001.711149:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1782222002.331014:0:9021:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782222002.331024:0:9021:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1782222002.730479:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222003.179378:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782222003.179408:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877154700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081684352:0@lo:41: 00000100:00100000:0.0:1782222003.179476:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222003.179561:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081684352 00000100:00100000:1.0:1782222003.179570:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081684352 00000100:00100000:1.0:1782222003.179629:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782222003.179637:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081684352:12345-0@lo:41: 00000004:00000024:1.0:1782222003.179668:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1782222003.179711:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081684480:0@lo:41: 00000100:00100000:1.0:1782222003.179712:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081684352:12345-0@lo:41: Request processed in 74us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222003.179724:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782222003.179755:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222003.179853:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081684480 00000100:00100000:1.0:1782222003.179858:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081684480 00000100:00100000:1.0:1782222003.179882:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782222003.179888:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081684480:12345-0@lo:41: 00000004:00000024:1.0:1782222003.179906:0:7480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1782222003.179949:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081684480:12345-0@lo:41: Request processed in 61us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222003.179955:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782222003.179959:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877154700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081684352:0@lo:41: 00000100:00100000:3.0:1782222003.182570:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081684480:0@lo:41: 00000100:00100000:2.0:1782222003.701718:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081684608:0@lo:13: 00000100:00100000:2.0:1782222003.701828:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222003.701914:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1868795081685120:0@lo:400: 00000100:00100000:2.0:1782222003.701943:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222003.701972:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782222003.701979:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1868795081684992:0@lo:400: 00000100:00100000:2.0:1782222003.702003:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222003.702023:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081685504:0@lo:400: 00000100:00100000:2.0:1782222003.702052:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222003.702087:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081684736:0@lo:400: 00000100:00100000:2.0:1782222003.702125:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222003.702162:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1868795081685248:0@lo:400: 00000100:00100000:2.0:1782222003.702209:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222003.702212:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081684608 00000100:00100000:1.0:1782222003.702224:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081684608 00000100:00100000:2.0:1782222003.702229:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782222003.702272:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081684864:0@lo:400: 00000100:00100000:2.0:1782222003.702314:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222003.702323:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782222003.702335:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081684608:12345-0@lo:13: 00000100:00100000:2.0:1782222003.702337:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081685376:0@lo:400: 00000100:00100000:2.0:1782222003.702363:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1782222003.702377:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782222003.702398:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081685120 00000100:00100000:2.0:1782222003.702403:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081685120 00000100:00100000:1.0:1782222003.702431:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081684608:12345-0@lo:13: Request processed in 98us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222003.702437:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081684992 00000100:00100000:1.0:1782222003.702441:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782222003.702443:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081684992 00000100:00100000:2.0:1782222003.702463:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081685248 00000100:00100000:2.0:1782222003.702466:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081685248 00000100:00100000:2.0:1782222003.702482:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081684864 00000100:00100000:2.0:1782222003.702485:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081684864 00000100:00100000:2.0:1782222003.702499:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782222003.702505:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1868795081685120:12345-0@lo:400: 00000100:00100000:2.0:1782222003.702542:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1868795081685120:12345-0@lo:400: Request processed in 36us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222003.702548:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782222003.702561:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782222003.702567:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1868795081684992:12345-0@lo:400: 00000100:00100000:2.0:1782222003.702595:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1868795081684992:12345-0@lo:400: Request processed in 28us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222003.702602:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782222003.702611:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782222003.702616:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1868795081685248:12345-0@lo:400: 00000100:00100000:2.0:1782222003.702642:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1868795081685248:12345-0@lo:400: Request processed in 26us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222003.702648:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782222003.702660:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782222003.702666:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081684864:12345-0@lo:400: 00000100:00100000:2.0:1782222003.702708:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081684864:12345-0@lo:400: Request processed in 40us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222003.702710:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081684736 00000100:00100000:2.0:1782222003.702717:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782222003.702718:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081684736 00000100:00100000:2.0:1782222003.702746:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081685504 00000100:00100000:2.0:1782222003.702751:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081685504 00000100:00100000:0.0:1782222003.702759:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1782222003.702769:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:3653:x1868795081684736:12345-0@lo:400: 00000100:00100000:2.0:1782222003.702785:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081685376 00000100:00100000:2.0:1782222003.702789:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081685376 00000100:00100000:0.0:1782222003.702813:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:3653:x1868795081684736:12345-0@lo:400: Request processed in 47us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222003.702814:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782222003.702824:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081685504:12345-0@lo:400: 00000100:00100000:0.0:1782222003.702825:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1782222003.702865:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081685504:12345-0@lo:400: Request processed in 41us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222003.702872:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782222003.702882:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782222003.702888:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b785c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081685376:12345-0@lo:400: 00000100:00100000:2.0:1782222003.702912:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b785c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081685376:12345-0@lo:400: Request processed in 24us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222003.702918:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1782222003.702964:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0849b14700 x1868795081684992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222003.703421:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1868795081684992:0@lo:400: 00010000:00080000:2.0:1782222003.703441:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0849b16300 x1868795081685504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222003.703450:0:3656:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1782222003.703469:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081685504:0@lo:400: 00010000:00080000:2.0:1782222003.703482:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0849b17480 x1868795081684608/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222019 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222003.703506:0:3656:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1782222003.703527:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081684608:0@lo:13: 00010000:00080000:2.0:1782222003.703543:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0849b16a00 x1868795081685120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222003.703551:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1868795081685120:0@lo:400: 00010000:00080000:2.0:1782222003.703593:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0849b15500 x1868795081684864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222003.703601:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081684864:0@lo:400: 00010000:00080000:2.0:1782222003.703610:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0849b14380 x1868795081685376/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222003.703617:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081685376:0@lo:400: 00000100:00100000:2.0:1782222003.703627:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081684736:0@lo:400: 00010000:00080000:2.0:1782222003.703637:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0849b14e00 x1868795081685248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222003.703644:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1868795081685248:0@lo:400: 00000100:00080000:2.0:1782222003.708206:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782222003.708221:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782222003.708226:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782222003.710129:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081685632:0@lo:13: 00000100:00100000:0.0:1782222003.713756:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222003.714074:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081685632 00000100:00100000:2.0:1782222003.714086:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081685632 00000100:00100000:2.0:1782222003.714152:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782222003.714164:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877154700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081685632:12345-0@lo:13: 00002000:00000024:2.0:1782222003.714223:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782222003.715714:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877154700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081685632:12345-0@lo:13: Request processed in 1540us (1958us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222003.715729:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1782222003.716595:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f087fdb0e00 x1868795081685632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222019 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222003.716622:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081685632:0@lo:13: 00010000:00010000:1.0:1782222003.760458:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222004.779318:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222005.803428:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222006.826441:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222007.852427:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782222008.300339:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081685760:0@lo:41: 00000100:00100000:1.0:1782222008.300413:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222008.301679:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081685760 00000100:00100000:3.0:1782222008.301690:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081685760 00000100:00100000:3.0:1782222008.301747:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782222008.301756:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081685760:12345-0@lo:41: 00000004:00000024:3.0:1782222008.301791:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1782222008.301860:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081685760:12345-0@lo:41: Request processed in 104us (1446us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222008.301869:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782222008.301917:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081685760:0@lo:41: 00000100:00100000:3.0:1782222008.315492:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782222008.315525:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081685888:0@lo:41: 00000100:00100000:3.0:1782222008.315596:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222008.316461:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081685888 00000100:00100000:3.0:1782222008.316469:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081685888 00000100:00100000:3.0:1782222008.316517:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782222008.316527:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081685888:12345-0@lo:41: 00000004:00000024:3.0:1782222008.316562:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1782222008.316619:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081685888:12345-0@lo:41: Request processed in 93us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222008.316625:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782222008.317387:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081685888:0@lo:41: 00000100:00100000:3.0:1782222008.811829:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782222008.811866:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081686016:0@lo:13: 00000100:00100000:3.0:1782222008.811961:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222008.812049:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081686016 00000100:00100000:3.0:1782222008.812059:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081686016 00000100:00100000:3.0:1782222008.812133:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782222008.812145:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081686016:12345-0@lo:13: 00002000:00000024:3.0:1782222008.812197:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222008.812281:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081686016:12345-0@lo:13: Request processed in 139us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222008.812407:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1782222008.812455:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f087fdb0380 x1868795081686016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222024 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222008.812474:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081686016:0@lo:13: 00000100:00080000:2.0:1782222008.814590:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782222008.814807:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081686144:0@lo:13: 00000100:00100000:2.0:1782222008.814890:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222008.814939:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1868795081686656:0@lo:400: 00000100:00100000:2.0:1782222008.814996:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222008.815025:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782222008.815031:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1868795081686528:0@lo:400: 00000100:00100000:2.0:1782222008.815056:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222008.815082:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081686272:0@lo:400: 00000100:00100000:2.0:1782222008.815115:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222008.815136:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1868795081686784:0@lo:400: 00000100:00100000:2.0:1782222008.815173:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222008.815193:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782222008.815198:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081686400:0@lo:400: 00000100:00100000:2.0:1782222008.815218:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222008.816572:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081686272 00000100:00100000:0.0:1782222008.816588:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081686272 00000100:00100000:0.0:1782222008.816680:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1782222008.816692:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:3653:x1868795081686272:12345-0@lo:400: 00000100:00100000:0.0:1782222008.816789:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:3653:x1868795081686272:12345-0@lo:400: Request processed in 99us (1672us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222008.816797:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1782222008.821620:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081686912:0@lo:400: 00000100:00100000:2.0:1782222008.821688:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081686144 00000100:00100000:2.0:1782222008.821699:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081686144 00000100:00100000:2.0:1782222008.822182:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782222008.822195:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081686144:12345-0@lo:13: 00002000:00000024:2.0:1782222008.822268:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782222008.823381:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081686656 00000100:00100000:0.0:1782222008.823394:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081686656 00000100:00100000:0.0:1782222008.823453:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081686528 00000100:00100000:0.0:1782222008.823457:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081686528 00000100:00100000:0.0:1782222008.823476:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081686784 00000100:00100000:0.0:1782222008.823480:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081686784 00000100:00100000:0.0:1782222008.823496:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081686400 00000100:00100000:0.0:1782222008.823499:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081686400 00000100:00100000:0.0:1782222008.823518:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782222008.823527:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07465e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1868795081686656:12345-0@lo:400: 00000100:00100000:0.0:1782222008.823679:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07465e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1868795081686656:12345-0@lo:400: Request processed in 152us (8680us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222008.823687:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782222008.823706:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782222008.823712:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07465e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1868795081686528:12345-0@lo:400: 00000100:00100000:0.0:1782222008.823742:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07465e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1868795081686528:12345-0@lo:400: Request processed in 30us (8686us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222008.823748:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782222008.823759:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782222008.823765:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07465e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1868795081686784:12345-0@lo:400: 00000100:00100000:0.0:1782222008.823796:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07465e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1868795081686784:12345-0@lo:400: Request processed in 30us (8621us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222008.823802:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782222008.823813:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782222008.823819:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07465e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081686400:12345-0@lo:400: 00000100:00100000:0.0:1782222008.823847:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07465e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081686400:12345-0@lo:400: Request processed in 28us (8627us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222008.823852:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782222008.823917:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222008.823971:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081686272:0@lo:400: 00010000:00080000:0.0:1782222008.823990:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0849b17480 x1868795081686784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222008.824003:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1868795081686784:0@lo:400: 00010000:00080000:0.0:1782222008.824034:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0849b14380 x1868795081686400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222008.824058:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081686400:0@lo:400: 00000100:00100000:2.0:1782222008.826536:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081686144:12345-0@lo:13: Request processed in 4330us (11632us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222008.826552:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1782222008.826645:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782222008.826653:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782222008.826656:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782222008.838627:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0849b15500 x1868795081686528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222008.838654:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1868795081686528:0@lo:400: 00010000:00080000:2.0:1782222008.838672:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0849b14e00 x1868795081686144/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222024 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222008.838693:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081686144:0@lo:13: 00010000:00080000:2.0:1782222008.838707:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0849b16a00 x1868795081686656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222008.838716:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1868795081686656:0@lo:400: 00000100:00100000:2.0:1782222008.838770:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081686912 00000100:00100000:2.0:1782222008.838778:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081686912 00000100:00100000:2.0:1782222008.838840:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782222008.838851:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081686912:12345-0@lo:400: 00000100:00100000:2.0:1782222008.838981:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081686912:12345-0@lo:400: Request processed in 130us (15062us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222008.838989:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1782222008.840431:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0849b16300 x1868795081686912/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222008.840448:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081686912:0@lo:400: 00010000:00010000:0.0:1782222008.883018:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222009.903324:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222010.923200:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222011.946498:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222012.971839:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1782222013.370367:0:9521:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1782222013.370370:0:9521:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1782222013.370372:0:9521:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1782222013.370523:0:9521:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8f08815e6800 00000020:01000004:3.0:1782222013.370542:0:9521:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1782222013.370556:0:9521:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1782222013.370569:0:9521:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8f07460f3380) 00000020:00000080:3.0:1782222013.370585:0:9521:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00000100:00100000:2.0:1782222013.418374:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782222013.418398:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081687040:0@lo:41: 00000100:00100000:2.0:1782222013.418483:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222013.418554:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081687040 00000100:00100000:2.0:1782222013.418561:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081687040 00000100:00100000:2.0:1782222013.418617:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782222013.418626:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07465e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081687040:12345-0@lo:41: 00000004:00000024:2.0:1782222013.418660:0:7480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1782222013.418707:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07465e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081687040:12345-0@lo:41: Request processed in 82us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222013.418714:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782222013.418756:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081687040:0@lo:41: 00000100:00100000:0.0:1782222013.421577:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782222013.421625:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081687168:0@lo:41: 00000100:00100000:0.0:1782222013.421731:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222013.421815:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081687168 00000100:00100000:0.0:1782222013.421824:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081687168 00000100:00100000:0.0:1782222013.421883:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782222013.421897:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081687168:12345-0@lo:41: 00000004:00000024:0.0:1782222013.421944:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1782222013.422000:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081687168:12345-0@lo:41: Request processed in 107us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222013.422008:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782222013.422079:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081687168:0@lo:41: 00100000:10000000:2.0:1782222013.437958:0:9521:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1782222013.438017:0:9521:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:1.0:1782222013.467787:0:9521:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1782222013.468077:0:9521:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1782222013.468095:0:9521:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1782222013.468110:0:9521:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe2b7cc26e68110c6 00000020:01000004:1.0:1782222013.468129:0:9521:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1782222013.468158:0:9521:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.127@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1782222013.468162:0:9521:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1782222013.468169:0:9521:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1782222013.468208:0:9521:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1782222013.468214:0:9521:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.127@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1782222013.522905:0:9521:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.127@tcp ctxt 0 is initialized 00000020:01000004:3.0:1782222013.522942:0:9521:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.127@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1782222013.522946:0:9521:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1782222013.522947:0:9521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782222013.522949:0:9521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782222013.522950:0:9521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782222013.522951:0:9521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782222013.522952:0:9521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782222013.522953:0:9521:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782222013.522955:0:9521:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782222013.522956:0:9521:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782222013.522958:0:9521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782222013.522959:0:9521:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782222013.522962:0:9521:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1782222013.522965:0:9521:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782222013.522966:0:9521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782222013.522967:0:9521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782222013.522968:0:9521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782222013.522969:0:9521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782222013.522969:0:9521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782222013.522970:0:9521:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782222013.522971:0:9521:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782222013.522972:0:9521:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782222013.522973:0:9521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782222013.522974:0:9521:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782222013.522999:0:9521:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1782222013.523017:0:9521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9521:1868795081687296:0@lo:253: 00000100:00100000:3.0:1782222013.523099:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222013.523158:0:9521:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746158000 going to sleep for 11 seconds 00000100:00100000:2.0:1782222013.523726:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081687296 00000100:00100000:2.0:1782222013.523741:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081687296 00000100:00100000:2.0:1782222013.523843:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1782222013.523856:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:9521:x1868795081687296:12345-0@lo:253: 20000000:01000000:2.0:1782222013.523901:0:6519:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1782222013.523907:0:6519:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1782222013.523913:0:6519:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1782222013.523917:0:6519:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1782222013.524314:0:6519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782222013.524492:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:2.0:1782222013.524508:0:6519:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1782222013.524525:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:2.0:1782222013.524530:0:6519:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1782222013.524540:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:2.0:1782222013.524552:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:2.0:1782222013.524664:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:2.0:1782222013.524685:0:6519:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.127@tcp 20000000:01000000:2.0:1782222013.524693:0:6519:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.127@tcp (null) (null) (null) 00000040:00080000:2.0:1782222013.524711:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:2.0:1782222013.524719:0:6519:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1782222013.524732:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:2.0:1782222013.524738:0:6519:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.127@tcp (null) (null) 00000040:00080000:2.0:1782222013.524750:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:2.0:1782222013.524758:0:6519:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1782222013.524769:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:2.0:1782222013.524785:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:2.0:1782222013.524860:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:2.0:1782222013.524871:0:6519:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.127@tcp 20000000:01000000:2.0:1782222013.524873:0:6519:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.127@tcp (null) (null) (null) 00000040:00080000:2.0:1782222013.524887:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:2.0:1782222013.524893:0:6519:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1782222013.524906:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:2.0:1782222013.524911:0:6519:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.127@tcp (null) (null) 00000040:00080000:2.0:1782222013.524925:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:2.0:1782222013.524931:0:6519:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1782222013.524943:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:2.0:1782222013.524972:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:2.0:1782222013.525387:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:2.0:1782222013.525401:0:6519:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.127@tcp 20000000:01000000:2.0:1782222013.525403:0:6519:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.127@tcp (null) (null) (null) 00000040:00080000:2.0:1782222013.525418:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:2.0:1782222013.525424:0:6519:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1782222013.525437:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:2.0:1782222013.525442:0:6519:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.127@tcp (null) (null) 00000040:00080000:2.0:1782222013.525455:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:2.0:1782222013.525462:0:6519:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1782222013.525475:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:2.0:1782222013.525501:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:2.0:1782222013.525514:0:6519:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1782222013.525518:0:6519:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1782222013.525522:0:6519:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1782222013.525572:0:6519:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1782222013.525576:0:6519:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1782222013.530529:0:9527:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1782222013.532941:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1782222013.532984:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:2.0:1782222013.533004:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:2.0:1782222013.533021:0:6519:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1782222013.533024:0:6519:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1782222013.546226:0:9528:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 36 marker 25 1->4: lustre sys.timeout 20000000:01000000:1.0:1782222013.546766:0:9528:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 38 marker 25 2->4: lustre sys.timeout 00000040:00080000:1.0:1782222013.546789:0:9528:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:2.0:1782222013.548451:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:2.0:1782222013.548489:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:2.0:1782222013.548507:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:2.0:1782222013.548521:0:6519:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1782222013.548524:0:6519:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1782222013.549079:0:9529:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:2.0:1782222013.549101:0:9529:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:2.0:1782222013.549127:0:9529:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:0.0:1782222013.549310:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:0.0:1782222013.549337:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:0.0:1782222013.549352:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:0.0:1782222013.549365:0:6519:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1782222013.549367:0:6519:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1782222013.549797:0:9530:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:2.0:1782222013.549818:0:9530:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:2.0:1782222013.549834:0:9530:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:0.0:1782222013.551965:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:0.0:1782222013.552005:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:0.0:1782222013.552043:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:0.0:1782222013.552056:0:6519:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1782222013.552060:0:6519:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1782222013.558425:0:9531:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 5 marker 28 1->4: lustre sys.timeout 20000000:01000000:2.0:1782222013.558504:0:9531:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 7 marker 28 2->4: lustre sys.timeout 00000040:00080000:2.0:1782222013.558514:0:9531:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1782222013.558879:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1782222013.558903:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:1.0:1782222013.558914:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 10000000:01000000:1.0:1782222013.558934:0:6519:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1782222013.558962:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f0875803800/0xe2b7cc26e68110cd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222013.558985:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0840030200/0xe2b7cc26e6810fc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810fbc expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222013.558993:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0875803c00/0xe2b7cc26e6810fed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810fe6 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222013.559001:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0840031600/0xe2b7cc26e681102c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6811025 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222013.559029:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f087fb83a00/0xe2b7cc26e6811048 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6811041 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222013.559038:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0840031400/0xe2b7cc26e6811072 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e681106b expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222013.559044:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0875802200/0xe2b7cc26e681108e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6811087 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222013.559051:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0840031a00/0xe2b7cc26e68110b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68110b1 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222013.559059:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f0875803800/0xe2b7cc26e68110cd lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222013.559109:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0840031a00/0xe2b7cc26e68110b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e68110b1 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222013.559144:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0840031a00/0xe2b7cc26e68110b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e68110b1 expref: 21 pid: 6521 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222013.559161:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159bb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6519:1868795081687424:0@lo:104: 00000100:00100000:1.0:1782222013.559277:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782222013.559340:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0875802200/0xe2b7cc26e681108e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e6811087 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222013.559348:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0875802200/0xe2b7cc26e681108e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e6811087 expref: 21 pid: 6520 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222013.559357:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881598700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6519:1868795081687552:0@lo:104: 00000100:00100000:1.0:1782222013.559388:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782222013.559418:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0840031400/0xe2b7cc26e6811072 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e681106b expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222013.559427:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0840031400/0xe2b7cc26e6811072 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e681106b expref: 21 pid: 6521 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222013.559434:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881599c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6519:1868795081687680:0@lo:104: 00000100:00100000:1.0:1782222013.559453:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782222013.559468:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f087fb83a00/0xe2b7cc26e6811048 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e6811041 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222013.559476:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f087fb83a00/0xe2b7cc26e6811048 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e6811041 expref: 21 pid: 6521 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222013.559484:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881599180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6519:1868795081687808:0@lo:104: 00000100:00100000:1.0:1782222013.559501:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782222013.559515:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0840031600/0xe2b7cc26e681102c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e6811025 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222013.559523:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0840031600/0xe2b7cc26e681102c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e6811025 expref: 21 pid: 6521 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222013.559532:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881598380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6519:1868795081687936:0@lo:104: 00000100:00100000:1.0:1782222013.559556:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782222013.559580:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0875803c00/0xe2b7cc26e6810fed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e6810fe6 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222013.559589:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081687424 00010000:00010000:1.0:1782222013.559590:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0875803c00/0xe2b7cc26e6810fed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e6810fe6 expref: 21 pid: 6520 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222013.559600:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081687424 00000100:00100000:3.0:1782222013.559662:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081687552 00000100:00100000:3.0:1782222013.559672:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081687552 00000100:00100000:3.0:1782222013.559686:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081687680 00000100:00100000:3.0:1782222013.559688:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081687680 00000100:00100000:3.0:1782222013.559699:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081687808 00000100:00100000:3.0:1782222013.559701:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081687808 00000100:00100000:3.0:1782222013.559711:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081687936 00000100:00100000:3.0:1782222013.559713:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081687936 00000100:00100000:3.0:1782222013.559728:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782222013.559749:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881598a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+7:6519:x1868795081687424:12345-0@lo:104: 00010000:00010000:3.0:1782222013.559765:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f0841459a00/0xe2b7cc26e68110b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e68110b8 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222013.559831:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782222013.559841:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881598a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+7:6519:x1868795081687424:12345-0@lo:104: Request processed in 104us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222013.559850:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6519:1868795081688064:0@lo:104: 00000100:00100000:3.0:1782222013.559853:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782222013.559875:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782222013.559882:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881598000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+6:6519:x1868795081687552:12345-0@lo:104: 00010000:00010000:3.0:1782222013.559891:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f0875802000/0xe2b7cc26e6811087 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e681108e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222013.559905:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782222013.559929:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782222013.559936:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881598000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+6:6519:x1868795081687552:12345-0@lo:104: Request processed in 56us (547us total) trans 0 rc 0/0 00010000:00010000:1.0:1782222013.559943:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0840030200/0xe2b7cc26e6810fc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e6810fbc expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222013.559944:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1782222013.559957:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0840030200/0xe2b7cc26e6810fc3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e6810fbc expref: 21 pid: 6521 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222013.559967:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6519:1868795081688192:0@lo:104: 00000100:00100000:3.0:1782222013.559976:0:6509:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782222013.559989:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0842f73240 going to sleep for 11 seconds 00000100:00100000:3.0:1782222013.560003:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222013.560016:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081688064 00000100:00100000:1.0:1782222013.560019:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159bb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6519:1868795081687424:0@lo:104: 00000100:00100000:3.0:1782222013.560021:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081688064 00000100:00100000:1.0:1782222013.560035:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881598700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6519:1868795081687552:0@lo:104: 00000100:00100000:3.0:1782222013.560042:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081688192 00000100:00100000:3.0:1782222013.560051:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081688192 00000100:00100000:3.0:1782222013.560068:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782222013.560074:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088159aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+7:6519:x1868795081687680:12345-0@lo:104: 00010000:00010000:3.0:1782222013.560082:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f0840031e00/0xe2b7cc26e681106b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6811072 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.560097:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782222013.560107:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f0841459a00/0xe2b7cc26e68110b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e68110b8 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.560125:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0841459a00 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:0.0:1782222013.560137:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f0841459a00/0xe2b7cc26e68110b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e68110b8 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222013.560143:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1782222013.560149:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f0841459a00/0xe2b7cc26e68110b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e68110b8 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222013.560150:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088159aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+7:6519:x1868795081687680:12345-0@lo:104: Request processed in 76us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222013.560165:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 10000000:00010000:0.0:1782222013.560167:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f0841459a00/0xe2b7cc26e68110b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e68110b8 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782222013.560175:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1782222013.560179:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782222013.560187:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088159b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+6:6519:x1868795081687808:12345-0@lo:104: 00010000:00010000:3.0:1782222013.560196:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f087fb83400/0xe2b7cc26e6811041 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6811048 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.560212:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f0841459a00/0xe2b7cc26e68110b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e68110b8 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.560220:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782222013.560226:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:0.0:1782222013.560268:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f0841459a00/0xe2b7cc26e68110b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e68110b8 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222013.560270:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088159b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+6:6519:x1868795081687808:12345-0@lo:104: Request processed in 47us (730us total) trans 0 rc 0/0 00010000:00010000:0.0:1782222013.560283:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f0841459a00/0xe2b7cc26e68110b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e68110b8 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222013.560287:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1782222013.560306:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:3.0:1782222013.560307:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1782222013.560311:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f0875802000/0xe2b7cc26e6811087 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e681108e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222013.560319:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881599500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+5:6519:x1868795081687936:12345-0@lo:104: 00010000:00010000:3.0:1782222013.560327:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f0875802400/0xe2b7cc26e6811025 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e681102c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.560337:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0875802000 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:0.0:1782222013.560342:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f0875802000/0xe2b7cc26e6811087 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e681108e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.560350:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f0875802000/0xe2b7cc26e6811087 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e681108e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782222013.560358:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f0875802000/0xe2b7cc26e6811087 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e681108e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222013.560364:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 10000000:01000000:0.0:1782222013.560364:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1782222013.560373:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881599500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+5:6519:x1868795081687936:12345-0@lo:104: Request processed in 57us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222013.560380:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1782222013.560384:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f0875802000/0xe2b7cc26e6811087 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e681108e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.560394:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782222013.560401:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f0875802000/0xe2b7cc26e6811087 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e681108e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.560407:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f0875802000/0xe2b7cc26e6811087 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e681108e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222013.560408:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782222013.560420:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0746245050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+4:6519:x1868795081688064:12345-0@lo:104: 00010000:00010000:0.0:1782222013.560422:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782222013.560427:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f0840031e00/0xe2b7cc26e681106b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6811072 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222013.560431:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f0841459e00/0xe2b7cc26e6810fe6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810fed expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.560434:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0840031e00 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:0.0:1782222013.560440:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f0840031e00/0xe2b7cc26e681106b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e6811072 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.560460:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f0840031e00/0xe2b7cc26e681106b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e6811072 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782222013.560467:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f0840031e00/0xe2b7cc26e681106b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e6811072 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222013.560472:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 10000000:01000000:0.0:1782222013.560472:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1782222013.560481:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0746245050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+4:6519:x1868795081688064:12345-0@lo:104: Request processed in 63us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222013.560489:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1782222013.560492:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f0840031e00/0xe2b7cc26e681106b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811072 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.560499:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782222013.560516:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f0840031e00/0xe2b7cc26e681106b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811072 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.560522:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f0840031e00/0xe2b7cc26e681106b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811072 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222013.560523:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782222013.560535:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+3:6519:x1868795081688192:12345-0@lo:104: 00010000:00010000:0.0:1782222013.560538:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782222013.560543:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f087fb83400/0xe2b7cc26e6811041 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6811048 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222013.560544:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f0841459400/0xe2b7cc26e6810fbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810fc3 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.560557:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83400 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:0.0:1782222013.560562:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f087fb83400/0xe2b7cc26e6811041 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e6811048 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.560568:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f087fb83400/0xe2b7cc26e6811041 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e6811048 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782222013.560575:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f087fb83400/0xe2b7cc26e6811041 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e6811048 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222013.560582:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 10000000:01000000:0.0:1782222013.560588:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1782222013.560593:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+3:6519:x1868795081688192:12345-0@lo:104: Request processed in 58us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222013.560601:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1782222013.560617:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1782222013.560622:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f0875802400/0xe2b7cc26e6811025 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e681102c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222013.560631:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0875802400 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:3.0:1782222013.560634:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f0875802400/0xe2b7cc26e6811025 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e681102c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222013.560641:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f0875802400/0xe2b7cc26e6811025 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e681102c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782222013.560659:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f0875802400/0xe2b7cc26e6811025 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e681102c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782222013.560665:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782222013.560680:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f0875802400/0xe2b7cc26e6811025 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e681102c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222013.560686:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782222013.560692:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f0875802400/0xe2b7cc26e6811025 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e681102c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222013.560700:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f0875802400/0xe2b7cc26e6811025 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e681102c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222013.560711:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782222013.560715:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f0841459e00/0xe2b7cc26e6810fe6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810fed expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222013.560722:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0841459e00 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:3.0:1782222013.560725:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f0841459e00/0xe2b7cc26e6810fe6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e6810fed expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.560727:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f087fb83400/0xe2b7cc26e6811041 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811048 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222013.560740:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f0841459e00/0xe2b7cc26e6810fe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e6810fed expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.560742:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782222013.560749:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f087fb83400/0xe2b7cc26e6811041 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811048 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782222013.560750:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f0841459e00/0xe2b7cc26e6810fe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e6810fed expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.560767:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f087fb83400/0xe2b7cc26e6811041 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811048 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782222013.560768:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782222013.560781:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782222013.560786:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f0841459400/0xe2b7cc26e6810fbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810fc3 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222013.560793:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f0841459e00/0xe2b7cc26e6810fe6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810fed expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.560793:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0841459400 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:0.0:1782222013.560799:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f0841459400/0xe2b7cc26e6810fbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e6810fc3 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222013.560808:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782222013.560817:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f0841459e00/0xe2b7cc26e6810fe6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810fed expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.560817:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f0841459400/0xe2b7cc26e6810fbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e6810fc3 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782222013.560836:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f0841459400/0xe2b7cc26e6810fbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e6810fc3 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222013.560837:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f0841459e00/0xe2b7cc26e6810fe6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810fed expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782222013.560848:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782222013.560857:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222013.560861:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222013.560863:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222013.560879:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f0841459400/0xe2b7cc26e6810fbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810fc3 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.560886:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782222013.560896:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f0841459400/0xe2b7cc26e6810fbc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810fc3 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.560903:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f0841459400/0xe2b7cc26e6810fbc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810fc3 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.560918:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222013.560920:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222013.560922:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222013.560930:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222013.560955:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081688320:0@lo:103: 00000100:00100000:0.0:1782222013.560994:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222013.561037:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877155500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081688832:0@lo:103: 00000100:00100000:0.0:1782222013.561058:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222013.561080:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782222013.561086:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877157800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081688448:0@lo:103: 00000100:00100000:0.0:1782222013.561106:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222013.561140:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081688960:0@lo:103: 00000100:00100000:0.0:1782222013.561163:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222013.561190:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081688576:0@lo:103: 00000100:00100000:3.0:1782222013.561195:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081688320 00000100:00100000:3.0:1782222013.561202:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081688320 00000100:00100000:0.0:1782222013.561216:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782222013.561230:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0840031a00/0xe2b7cc26e68110b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e68110b1 expref: 22 pid: 6521 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222013.561230:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081689088:0@lo:103: 00000100:00100000:0.0:1782222013.561285:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222013.561308:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081688832 00000100:00100000:3.0:1782222013.561312:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081688832 00000100:00100000:0.0:1782222013.561312:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782222013.561321:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081688704:0@lo:103: 00010000:00010000:3.0:1782222013.561329:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f087fb83a00/0xe2b7cc26e6811048 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6811041 expref: 23 pid: 6521 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222013.561346:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081688448 00000100:00100000:0.0:1782222013.561346:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222013.561351:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081688448 00010000:00010000:3.0:1782222013.561366:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0875802200/0xe2b7cc26e681108e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6811087 expref: 24 pid: 6520 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222013.561379:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081688960 00000100:00100000:3.0:1782222013.561382:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081688960 00000100:00100000:0.0:1782222013.561386:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081688576 00010000:00010000:3.0:1782222013.561394:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0875803c00/0xe2b7cc26e6810fed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810fe6 expref: 25 pid: 6520 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222013.561398:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081688576 00010000:00010000:0.0:1782222013.561420:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0840031400/0xe2b7cc26e6811072 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e681106b expref: 26 pid: 6521 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222013.561426:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081689088 00000100:00100000:3.0:1782222013.561432:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081689088 00000100:00100000:0.0:1782222013.561438:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081688704 00000100:00100000:0.0:1782222013.561444:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081688704 00010000:00010000:3.0:1782222013.561450:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0840030200/0xe2b7cc26e6810fc3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810fbc expref: 28 pid: 6521 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.561458:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0840031600/0xe2b7cc26e681102c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6811025 expref: 28 pid: 6521 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222013.561472:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782222013.561479:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782222013.561484:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877156680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+28:3653:x1868795081688320:12345-0@lo:103: 00000100:00100000:0.0:1782222013.561491:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877157100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+28:3653:x1868795081688832:12345-0@lo:103: 00010000:00010000:3.0:1782222013.561498:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222013.561502:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222013.561507:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0840031a00/0xe2b7cc26e68110b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e68110b1 expref: 28 pid: 6521 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.561509:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f087fb83a00/0xe2b7cc26e6811048 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6811041 expref: 28 pid: 6521 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.561526:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f087fb83a00/0xe2b7cc26e6811048 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e6811041 expref: 28 pid: 6521 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222013.561543:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0840031a00/0xe2b7cc26e68110b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e68110b1 expref: 28 pid: 6521 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222013.561742:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881599c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6519:1868795081687680:0@lo:104: 00000100:00100000:1.0:1782222013.561754:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881599180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6519:1868795081687808:0@lo:104: 00000100:00100000:1.0:1782222013.561763:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881598380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6519:1868795081687936:0@lo:104: 00000100:00100000:1.0:1782222013.561769:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6519:1868795081688064:0@lo:104: 00000100:00100000:1.0:1782222013.561777:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6519:1868795081688192:0@lo:104: 00010000:00010000:0.0:1782222013.561924:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f087fb83a00/0xe2b7cc26e6811048 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e6811041 expref: 28 pid: 6521 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.561938:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782222013.561983:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877157100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+27:3653:x1868795081688832:12345-0@lo:103: Request processed in 495us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222013.561989:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782222013.562007:0:6511:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1782222013.562015:0:6511:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1782222013.562034:0:6512:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1782222013.562043:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782222013.562049:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877156300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+26:3653:x1868795081688448:12345-0@lo:103: 00010000:00010000:0.0:1782222013.562058:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222013.562070:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0875802200/0xe2b7cc26e681108e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6811087 expref: 26 pid: 6520 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.562080:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0875802200/0xe2b7cc26e681108e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e6811087 expref: 26 pid: 6520 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.562091:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0875802200/0xe2b7cc26e681108e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e6811087 expref: 26 pid: 6520 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.562101:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782222013.562142:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877156300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+25:3653:x1868795081688448:12345-0@lo:103: Request processed in 92us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222013.562148:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782222013.562161:0:6512:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1782222013.562166:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782222013.562173:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08429a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3653:x1868795081688960:12345-0@lo:103: 00010000:00010000:0.0:1782222013.562182:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222013.562187:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0875803c00/0xe2b7cc26e6810fed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810fe6 expref: 24 pid: 6520 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.562195:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0875803c00/0xe2b7cc26e6810fed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e6810fe6 expref: 24 pid: 6520 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.562206:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0875803c00/0xe2b7cc26e6810fed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e6810fe6 expref: 24 pid: 6520 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.562214:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782222013.562259:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08429a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:3653:x1868795081688960:12345-0@lo:103: Request processed in 87us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222013.562266:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782222013.562285:0:6512:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1782222013.562291:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782222013.562296:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877156d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:3655:x1868795081688576:12345-0@lo:103: 00010000:00010000:0.0:1782222013.562305:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222013.562309:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0840031400/0xe2b7cc26e6811072 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e681106b expref: 22 pid: 6521 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.562318:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0840031400/0xe2b7cc26e6811072 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e681106b expref: 22 pid: 6521 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.562329:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0840031400/0xe2b7cc26e6811072 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e681106b expref: 22 pid: 6521 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.562338:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782222013.562364:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877156d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:3655:x1868795081688576:12345-0@lo:103: Request processed in 68us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222013.562370:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782222013.562380:0:6512:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1782222013.562387:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782222013.562392:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877154e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:3655:x1868795081689088:12345-0@lo:103: 00010000:00010000:0.0:1782222013.562400:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222013.562404:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0840030200/0xe2b7cc26e6810fc3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810fbc expref: 20 pid: 6521 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.562412:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0840030200/0xe2b7cc26e6810fc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e6810fbc expref: 20 pid: 6521 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.562420:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0840030200/0xe2b7cc26e6810fc3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e6810fbc expref: 20 pid: 6521 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.562439:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782222013.562462:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877154e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+19:3655:x1868795081689088:12345-0@lo:103: Request processed in 70us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222013.562469:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782222013.562480:0:6512:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1782222013.562486:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782222013.562492:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877155880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:3655:x1868795081688704:12345-0@lo:103: 00010000:00010000:0.0:1782222013.562499:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222013.562504:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0840031600/0xe2b7cc26e681102c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6811025 expref: 18 pid: 6521 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.562513:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0840031600/0xe2b7cc26e681102c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e6811025 expref: 18 pid: 6521 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.562522:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0840031600/0xe2b7cc26e681102c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e6811025 expref: 18 pid: 6521 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.562530:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782222013.562549:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877155880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:3655:x1868795081688704:12345-0@lo:103: Request processed in 58us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222013.562555:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782222013.562586:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081688704:0@lo:103: 00000100:00100000:0.0:1782222013.562594:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081688576:0@lo:103: 00000100:00100000:0.0:1782222013.562600:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081689088:0@lo:103: 00000100:00100000:2.0:1782222013.562811:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877157800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081688448:0@lo:103: 00000100:00100000:2.0:1782222013.562822:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081688960:0@lo:103: 00000100:00100000:2.0:1782222013.562835:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877155500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081688832:0@lo:103: 00010000:00010000:3.0:1782222013.564224:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0840031a00/0xe2b7cc26e68110b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e68110b1 expref: 16 pid: 6521 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222013.564338:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f0875803800/0xe2b7cc26e68110cd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222013.564348:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0875803800/0xe2b7cc26e68110cd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222013.564376:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f0875803800/0xe2b7cc26e68110cd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222013.564383:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f0875803800/0xe2b7cc26e68110cd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222013.564391:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f0875803800/0xe2b7cc26e68110cd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222013.564412:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f0875803800/0xe2b7cc26e68110cd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222013.564421:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0875803800 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:1.0:1782222013.564422:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f0875803800/0xe2b7cc26e68110cd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222013.564427:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f0875803800/0xe2b7cc26e68110cd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222013.564451:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f0875803800/0xe2b7cc26e68110cd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222013.564451:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff8f0875803800/0xe2b7cc26e68110cd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222013.564473:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f0875803800/0xe2b7cc26e68110cd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50a19400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222013.564476:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f0875803800/0xe2b7cc26e68110cd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222013.564493:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782222013.564509:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0875803800/0xe2b7cc26e68110cd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782222013.564530:0:6519:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1782222013.569960:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877156680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:3653:x1868795081688320:12345-0@lo:103: Request processed in 8461us (8946us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222013.569981:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782222013.570031:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081688320:0@lo:103: 00000100:00100000:3.0:1782222013.574083:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+14:9521:x1868795081687296:12345-0@lo:253: Request processed in 50216us (50969us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222013.574102:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1782222013.574282:0:9521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9521:1868795081687296:0@lo:253: 10000000:01000000:0.0:1782222013.574318:0:9521:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1782222013.574322:0:9521:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782222013.574324:0:9521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782222013.574326:0:9521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782222013.574327:0:9521:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1782222013.574328:0:9521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782222013.574330:0:9521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782222013.574332:0:9521:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782222013.574335:0:9521:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1782222013.574337:0:9521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782222013.574339:0:9521:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1782222013.574369:0:9521:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f08815e6800 from lustre-OST0001 10000000:01000000:0.0:1782222013.574419:0:9521:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1782222013.574423:0:9521:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1782222013.574435:0:9521:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f087805cd40 local copy 10000000:01000000:0.0:1782222013.574450:0:9521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1782222013.574509:0:9521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e68110d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.574522:0:9521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e68110d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.574533:0:9521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e68110d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222013.574557:0:9521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877157480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9521:1868795081689216:0@lo:101: 00000100:00100000:0.0:1782222013.574605:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222013.574653:0:9521:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087fb65f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782222013.574684:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081689216 00000100:00100000:2.0:1782222013.574694:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081689216 00000100:00100000:2.0:1782222013.574751:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1782222013.574761:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+14:9521:x1868795081689216:12345-0@lo:101: 00010000:00010000:2.0:1782222013.574779:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222013.574796:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f087fb82800/0xe2b7cc26e68110db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e68110d4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222013.574827:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fb82800/0xe2b7cc26e68110db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e68110d4 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222013.574838:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f087fb82800/0xe2b7cc26e68110db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68110d4 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222013.574849:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb82800, rc 0) 00000100:00100000:2.0:1782222013.574891:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:9521:x1868795081689216:12345-0@lo:101: Request processed in 131us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222013.574899:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1782222013.574996:0:9521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877157480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9521:1868795081689216:0@lo:101: 00010000:00010000:0.0:1782222013.575010:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e68110d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xe2b7cc26e68110db expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.575033:0:9521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e68110d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe2b7cc26e68110db expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222013.575170:0:9521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877157480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9521:1868795081689344:0@lo:501: 00000100:00100000:0.0:1782222013.575199:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222013.575221:0:9521:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087fb65f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782222013.575340:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081689344 00000100:00100000:3.0:1782222013.575346:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081689344 00000100:00100000:3.0:1782222013.575379:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1782222013.575387:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:9521:x1868795081689344:12345-0@lo:501: 00000100:00100000:3.0:1782222013.575486:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:9521:x1868795081689344:12345-0@lo:501: Request processed in 99us (285us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782222013.575493:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1782222013.575689:0:9521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877157480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9521:1868795081689344:0@lo:501: 10000000:01000000:0.0:1782222013.575707:0:9521:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1782222013.575727:0:9521:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1782222013.575733:0:9521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e68110d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe2b7cc26e68110db expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.575742:0:9521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e68110d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe2b7cc26e68110db expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.575749:0:9521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e68110d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe2b7cc26e68110db expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.575775:0:9521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1782222013.575808:0:9521:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f08815e6800 10000000:01000000:0.0:1782222013.575814:0:9521:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1782222013.575820:0:9521:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1782222013.575824:0:9521:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782222013.575830:0:9521:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1782222013.575833:0:9521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1782222013.575856:0:9521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0840031600/0xe2b7cc26e68110e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.575878:0:9521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f0840031600/0xe2b7cc26e68110e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.575888:0:9521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0840031600/0xe2b7cc26e68110e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222013.575904:0:9521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877157480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9521:1868795081689472:0@lo:101: 00000100:00100000:0.0:1782222013.575937:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222013.575972:0:9521:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087fb65000 going to sleep for 11 seconds 00010000:00010000:3.0:1782222013.576036:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782222013.576050:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e68110d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe2b7cc26e68110db expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222013.576057:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0840030c00 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:3.0:1782222013.576062:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e68110d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe2b7cc26e68110db expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222013.576072:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e68110d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xe2b7cc26e68110db expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782222013.576081:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e68110d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xe2b7cc26e68110db expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782222013.576086:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782222013.576108:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e68110d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe2b7cc26e68110db expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222013.576114:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1782222013.576175:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081689600:0@lo:103: 00000100:00100000:0.0:1782222013.576206:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222013.576291:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081689600 00000100:00100000:2.0:1782222013.576297:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081689600 00010000:00010000:3.0:1782222013.576315:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e68110d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe2b7cc26e68110db expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222013.576325:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e68110d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe2b7cc26e68110db expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222013.576333:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081689472 00000100:00100000:1.0:1782222013.576339:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081689472 00010000:00010000:3.0:1782222013.576344:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222013.576348:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1782222013.576349:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222013.576354:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222013.576360:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877154380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:3656:x1868795081689600:12345-0@lo:103: 00010000:00010000:2.0:1782222013.576374:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782222013.576376:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1782222013.576383:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:9521:x1868795081689472:12345-0@lo:101: 00010000:00010000:2.0:1782222013.576392:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f087fb82800/0xe2b7cc26e68110db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2b7cc26e68110d4 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222013.576393:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222013.576404:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782222013.576404:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0875802a00/0xe2b7cc26e68110e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e68110e2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222013.576422:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0875802a00/0xe2b7cc26e68110e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e68110e2 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222013.576433:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0875802a00/0xe2b7cc26e68110e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68110e2 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222013.576440:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0875802a00, rc 0) 00000100:00100000:1.0:1782222013.576482:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:9521:x1868795081689472:12345-0@lo:101: Request processed in 99us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222013.576489:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1782222013.576822:0:9521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877157480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9521:1868795081689472:0@lo:101: 00010000:00010000:3.0:1782222013.576838:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0840031600/0xe2b7cc26e68110e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68110e9 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222013.576861:0:9521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0840031600/0xe2b7cc26e68110e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e68110e9 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222013.576973:0:9521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9521:1868795081689728:0@lo:501: 00000100:00100000:3.0:1782222013.577008:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222013.577040:0:9521:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746158000 going to sleep for 11 seconds 00000100:00100000:2.0:1782222013.577096:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877154380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:3656:x1868795081689600:12345-0@lo:103: Request processed in 736us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222013.577107:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782222013.577107:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081689600:0@lo:103: 00000100:00100000:1.0:1782222013.577382:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081689728 00000100:00100000:1.0:1782222013.577388:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081689728 00000100:00100000:1.0:1782222013.577427:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1782222013.577436:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08672c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:9521:x1868795081689728:12345-0@lo:501: 00000100:00100000:1.0:1782222013.577604:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08672c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:9521:x1868795081689728:12345-0@lo:501: Request processed in 168us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222013.577612:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1782222013.577715:0:9521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9521:1868795081689728:0@lo:501: 00000100:00100000:0.0:1782222013.577748:0:9521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877157480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9521:1868795081689856:0@lo:503: 00000100:00100000:0.0:1782222013.577790:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222013.577817:0:9521:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087fb65cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782222013.578022:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081689856 00000100:00100000:1.0:1782222013.578027:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081689856 00000100:00100000:1.0:1782222013.578061:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1782222013.578068:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08672c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:9521:x1868795081689856:12345-0@lo:503: 00000100:00100000:0.0:1782222013.578309:0:9521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877157480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9521:1868795081689856:0@lo:503: 00000040:00080000:0.0:1782222013.578809:0:9521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782222013.578903:0:9521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877157480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9521:1868795081689984:0@lo:502: 00000100:00100000:0.0:1782222013.578964:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222013.579008:0:9521:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087fb65a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782222013.579161:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081689984 00000100:00100000:2.0:1782222013.579174:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081689984 00000100:00100000:2.0:1782222013.579214:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1782222013.579221:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:9521:x1868795081689984:12345-0@lo:502: 00000100:00100000:2.0:1782222013.579498:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:9521:x1868795081689984:12345-0@lo:502: Request processed in 277us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222013.579505:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1782222013.579595:0:9521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877157480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9521:1868795081689984:0@lo:502: 00000100:00100000:1.0:1782222013.580006:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08672c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:9521:x1868795081689856:12345-0@lo:503: Request processed in 198us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222013.580017:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000040:00080000:0.0:1782222013.580067:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1782222013.580099:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1782222013.580730:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1782222013.580756:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1782222013.580791:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1782222013.580810:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1782222013.580857:0:9521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877157480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9521:1868795081690112:0@lo:502: 00000100:00100000:0.0:1782222013.580934:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222013.580985:0:9521:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087fb65a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782222013.581023:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081690112 00000100:00100000:0.0:1782222013.581030:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081690112 00000100:00100000:0.0:1782222013.581078:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1782222013.581086:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:9521:x1868795081690112:12345-0@lo:502: 00000100:00100000:0.0:1782222013.581919:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:9521:x1868795081690112:12345-0@lo:502: Request processed in 829us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222013.581928:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1782222013.582050:0:9521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877157480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9521:1868795081690112:0@lo:502: 00000040:00080000:1.0:1782222013.582473:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1782222013.582489:0:9521:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:3.0:1782222013.583225:0:9533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782222013.583255:0:9533:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1782222013.583264:0:9533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782222013.583267:0:9533:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1782222013.583274:0:9533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782222013.583295:0:9533:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8f07460f4d40) 00000020:00000080:3.0:1782222013.583328:0:9533:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1782222013.583335:0:9533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1782222013.583471:0:9533:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f08815e6800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1782222013.583482:0:9533:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1782222013.583491:0:9533:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe2b7cc26e68110f7 00010000:00010000:3.0:1782222013.592557:0:9533:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1782222013.592929:0:9533:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1782222013.602744:0:9533:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1782222013.603330:0:9533:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1782222013.612596:0:9533:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1782222013.613964:0:9533:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1782222013.619777:0:9533:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1782222013.628220:0:9533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1782222013.628273:0:9533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782222013.628281:0:9533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782222013.628284:0:9533:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1782222013.628288:0:9533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782222013.628294:0:9533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782222013.628295:0:9533:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1782222013.628299:0:9533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1782222013.628301:0:9533:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1782222013.628338:0:9533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782222013.628342:0:9533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782222013.628343:0:9533:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:3.0:1782222013.628347:0:9533:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1782222013.628932:0:9521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1782222013.628970:0:9521:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1782222013.629002:0:9521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0840031600/0xe2b7cc26e68110e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68110e9 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222013.629017:0:9521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f0840031600/0xe2b7cc26e68110e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68110e9 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782222013.629028:0:9521:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f08815e6800 from 1 10000000:01000000:1.0:1782222013.629031:0:9521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782222013.629080:0:9521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875803800/0xe2b7cc26e68110fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222013.629089:0:9521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f0875803800/0xe2b7cc26e68110fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222013.629126:0:9521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0875803800/0xe2b7cc26e68110fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222013.629157:0:9521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9521:1868795081690240:0@lo:101: 00000100:00100000:1.0:1782222013.629270:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222013.629314:0:9521:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b63e600 going to sleep for 11 seconds 00000100:00100000:3.0:1782222013.630177:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081690240 00000100:00100000:3.0:1782222013.630190:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081690240 00000100:00100000:3.0:1782222013.630278:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1782222013.630288:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:9521:x1868795081690240:12345-0@lo:101: 00010000:00010000:3.0:1782222013.630307:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222013.630323:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0841459e00/0xe2b7cc26e6811105 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e68110fe expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222013.630356:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0841459e00/0xe2b7cc26e6811105 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e68110fe expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222013.630367:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0841459e00/0xe2b7cc26e6811105 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68110fe expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222013.630377:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0841459e00, rc 0) 00000100:00100000:3.0:1782222013.630460:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:9521:x1868795081690240:12345-0@lo:101: Request processed in 172us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222013.630628:0:9521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9521:1868795081690240:0@lo:101: 00010000:00010000:1.0:1782222013.630651:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0875803800/0xe2b7cc26e68110fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811105 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222013.630661:0:9521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0875803800/0xe2b7cc26e68110fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6811105 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222013.630792:0:9521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9521:1868795081690368:0@lo:501: 00000100:00100000:1.0:1782222013.630827:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222013.630869:0:9521:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b63e600 going to sleep for 11 seconds 00000100:00100000:2.0:1782222013.630930:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081690368 00000100:00100000:2.0:1782222013.630935:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081690368 00000100:00100000:2.0:1782222013.630968:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1782222013.630976:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:9521:x1868795081690368:12345-0@lo:501: 00000100:00100000:2.0:1782222013.631089:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:9521:x1868795081690368:12345-0@lo:501: Request processed in 113us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222013.631096:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1782222013.631148:0:9521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9521:1868795081690368:0@lo:501: 00000100:00100000:2.0:1782222013.631194:0:9521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9521:1868795081690496:0@lo:503: 00000100:00100000:2.0:1782222013.631256:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222013.631273:0:9521:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0845260480 going to sleep for 11 seconds 00000100:00100000:2.0:1782222013.631284:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081690496 00000100:00100000:2.0:1782222013.631287:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081690496 00000100:00100000:2.0:1782222013.631301:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1782222013.631306:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:9521:x1868795081690496:12345-0@lo:503: 00000100:00100000:2.0:1782222013.631390:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:9521:x1868795081690496:12345-0@lo:503: Request processed in 82us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222013.631395:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1782222013.631437:0:9521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9521:1868795081690496:0@lo:503: 00000040:00080000:2.0:1782222013.631702:0:9521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782222013.631772:0:9521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9521:1868795081690624:0@lo:502: 00000100:00100000:2.0:1782222013.631802:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222013.631814:0:9521:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746415e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782222013.631827:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081690624 00000100:00100000:2.0:1782222013.631830:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081690624 00000100:00100000:2.0:1782222013.631845:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1782222013.631851:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:9521:x1868795081690624:12345-0@lo:502: 00000100:00100000:2.0:1782222013.631915:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:9521:x1868795081690624:12345-0@lo:502: Request processed in 64us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222013.631921:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1782222013.631952:0:9521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9521:1868795081690624:0@lo:502: 00000040:00080000:2.0:1782222013.632177:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1782222013.632200:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1782222013.632217:0:9521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9521:1868795081690752:0@lo:502: 00000100:00100000:2.0:1782222013.632273:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222013.632292:0:9521:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746415e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782222013.632304:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081690752 00000100:00100000:2.0:1782222013.632307:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081690752 00000100:00100000:2.0:1782222013.632322:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1782222013.632327:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:9521:x1868795081690752:12345-0@lo:502: 00000100:00100000:2.0:1782222013.632379:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:9521:x1868795081690752:12345-0@lo:502: Request processed in 51us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222013.632385:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1782222013.632414:0:9521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9521:1868795081690752:0@lo:502: 00000040:00080000:2.0:1782222013.632450:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1782222013.632456:0:9521:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000100:00100000:3.0:1782222013.633818:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000020:01000000:2.0:1782222013.635888:0:9536:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782222013.635905:0:9536:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782222013.635908:0:9536:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1782222013.635919:0:9536:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f08815e6800 00000020:00000080:2.0:1782222013.635923:0:9536:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1782222013.635945:0:9536:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782222013.635948:0:9536:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782222013.635949:0:9536:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1782222013.635953:0:9536:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1782222013.636146:0:9521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1782222013.636185:0:9521:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782222013.636264:0:9521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875803800/0xe2b7cc26e68110fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811105 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222013.636279:0:9521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f0875803800/0xe2b7cc26e68110fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811105 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782222013.636436:0:9521:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1782222013.636440:0:9521:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f08815e6800 10000000:01000000:1.0:1782222013.636444:0:9521:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f08815e6800 10000000:01000000:1.0:1782222013.636455:0:9521:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782222013.636463:0:9521:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8f08815e6800 from 1 10000000:01000000:1.0:1782222013.636466:0:9521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782222013.636513:0:9521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875803200/0xe2b7cc26e681110c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222013.636523:0:9521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f0875803200/0xe2b7cc26e681110c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222013.636538:0:9521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0875803200/0xe2b7cc26e681110c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222013.636568:0:9521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9521:1868795081690880:0@lo:101: 00000100:00100000:1.0:1782222013.636654:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222013.636708:0:9521:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08492a1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782222013.636815:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081690880 00000100:00100000:0.0:1782222013.636824:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081690880 00000100:00100000:0.0:1782222013.636873:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1782222013.636883:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:9521:x1868795081690880:12345-0@lo:101: 00010000:00010000:0.0:1782222013.636900:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222013.636915:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0840030200/0xe2b7cc26e6811113 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e681110c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.636943:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0840030200/0xe2b7cc26e6811113 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e681110c expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.636954:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0840030200/0xe2b7cc26e6811113 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e681110c expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.636963:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0840030200, rc 0) 00000100:00100000:0.0:1782222013.637018:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:9521:x1868795081690880:12345-0@lo:101: Request processed in 135us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222013.637025:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1782222013.637079:0:9521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9521:1868795081690880:0@lo:101: 00010000:00010000:0.0:1782222013.637097:0:9521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0875803200/0xe2b7cc26e681110c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811113 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.637105:0:9521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0875803200/0xe2b7cc26e681110c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6811113 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222013.637221:0:9521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877156a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9521:1868795081691008:0@lo:501: 00000100:00100000:0.0:1782222013.637271:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222013.637298:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081691008 00000100:00100000:0.0:1782222013.637298:0:9521:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087fb65a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782222013.637303:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081691008 00000100:00100000:3.0:1782222013.637339:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1782222013.637347:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:9521:x1868795081691008:12345-0@lo:501: 00000100:00100000:1.0:1782222013.642997:0:9521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877156a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9521:1868795081691008:0@lo:501: 00000100:00100000:1.0:1782222013.643106:0:9521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881598380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9521:1868795081691136:0@lo:503: 00000100:00100000:1.0:1782222013.643218:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222013.643292:0:9521:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08492a1300 going to sleep for 11 seconds 00000100:00100000:0.0:1782222013.643308:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081691136 00000100:00100000:0.0:1782222013.643316:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081691136 00000100:00100000:0.0:1782222013.643393:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1782222013.643405:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:9521:x1868795081691136:12345-0@lo:503: 00000100:00100000:0.0:1782222013.643557:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:9521:x1868795081691136:12345-0@lo:503: Request processed in 154us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222013.643566:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1782222013.643606:0:9521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881598380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9521:1868795081691136:0@lo:503: 00000040:00080000:1.0:1782222013.643932:0:9521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782222013.644013:0:9521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881598380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9521:1868795081691264:0@lo:502: 00000100:00100000:1.0:1782222013.644066:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222013.644098:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081691264 00000100:00100000:1.0:1782222013.644102:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081691264 00000100:00100000:1.0:1782222013.644137:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1782222013.644144:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:9521:x1868795081691264:12345-0@lo:502: 00000100:00100000:1.0:1782222013.644226:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:9521:x1868795081691264:12345-0@lo:502: Request processed in 83us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222013.644274:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1782222013.644308:0:9521:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08492a1300 going to sleep for 11 seconds 00000100:00100000:1.0:1782222013.644321:0:9521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881598380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9521:1868795081691264:0@lo:502: 00000040:00080000:1.0:1782222013.644651:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1782222013.644677:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1782222013.644689:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1782222013.644700:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1782222013.644711:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1782222013.644721:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1782222013.644732:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1782222013.644743:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1782222013.644753:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1782222013.644764:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1782222013.644775:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1782222013.644786:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1782222013.644797:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1782222013.644808:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1782222013.644818:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1782222013.644829:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1782222013.644840:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1782222013.644851:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1782222013.644863:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1782222013.644874:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1782222013.644886:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1782222013.644898:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1782222013.644910:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1782222013.644923:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1782222013.644935:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1782222013.644946:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1782222013.644957:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1782222013.644968:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1782222013.644988:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1782222013.645000:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1782222013.645010:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1782222013.645022:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1782222013.645033:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1782222013.645044:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1782222013.645055:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1782222013.645065:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1782222013.645076:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:1.0:1782222013.645088:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1782222013.645100:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:1.0:1782222013.645142:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:1.0:1782222013.645156:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:1.0:1782222013.645167:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:1.0:1782222013.645178:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:1.0:1782222013.645189:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:1.0:1782222013.645199:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:1.0:1782222013.645208:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:1.0:1782222013.645264:0:9521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881598380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9521:1868795081691392:0@lo:502: 00000100:00100000:1.0:1782222013.645324:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222013.645372:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081691392 00000100:00100000:1.0:1782222013.645379:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081691392 00000100:00100000:1.0:1782222013.645410:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1782222013.645418:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:9521:x1868795081691392:12345-0@lo:502: 00000100:00100000:1.0:1782222013.645994:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:9521:x1868795081691392:12345-0@lo:502: Request processed in 574us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222013.646004:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1782222013.647606:0:9521:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08492a1300 going to sleep for 11 seconds 00000100:00100000:1.0:1782222013.647658:0:9521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881598380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9521:1868795081691392:0@lo:502: 00000040:00080000:1.0:1782222013.647790:0:9521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:1.0:1782222013.647821:0:9521:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000100:00100000:3.0:1782222013.648692:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:9521:x1868795081691008:12345-0@lo:501: Request processed in 11339us (11413us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222013.648707:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000020:01000004:1.0:1782222013.650757:0:9538:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1782222013.650781:0:9538:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8f087e8419c0) 00000020:00000080:1.0:1782222013.650812:0:9538:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:1.0:1782222013.651037:0:9538:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f08815e6800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1782222013.651044:0:9538:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f08815e6800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1782222013.651351:0:9538:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8f08815e6800 3 00010000:00080000:1.0:1782222013.651396:0:9538:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f0875aa2800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.127@tcp at head 00010000:00010000:1.0:1782222013.655644:0:9538:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:1.0:1782222013.655790:0:9538:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1782222013.655862:0:9538:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782222013.655882:0:9538:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xe2b7cc26e6811121 00000100:00080000:1.0:1782222013.655899:0:9538:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782222013.655907:0:9538:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f0875aa2800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:1.0:1782222013.655957:0:9538:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0881598380 x1868795081691520/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782222013.656629:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1868795081691520:0@lo:38: 00000100:00100000:2.0:1782222013.656726:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222013.656855:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081691520 00000100:00100000:3.0:1782222013.656864:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081691520 00000100:00100000:3.0:1782222013.656912:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782222013.656921:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07465e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3652:x1868795081691520:12345-0@lo:38: 00010000:00080000:3.0:1782222013.656952:0:6528:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:3.0:1782222013.656987:0:6528:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xe2b7cc26e6811128 00000004:00100000:3.0:1782222013.657006:0:6528:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1782222013.657048:0:6528:0:(import.c:65:import_set_state_nolock()) ffff8f07466f7800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1782222013.657149:0:9538:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1782222013.657230:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1868795081691776:0@lo:400: 00000100:00100000:0.0:1782222013.657283:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222013.657288:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081691648:0@lo:400: 00000100:00100000:0.0:1782222013.657311:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081692288:0@lo:400: 00000100:00100000:1.0:1782222013.657319:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222013.658664:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222013.658747:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1868795081692032:0@lo:400: 00000100:00100000:0.0:1782222013.658799:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222013.658829:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782222013.658836:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1868795081691904:0@lo:400: 00000100:00100000:0.0:1782222013.658856:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222013.658882:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081691776 00000100:00100000:0.0:1782222013.658889:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081691776 00000100:00100000:0.0:1782222013.658929:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081691648 00000100:00100000:0.0:1782222013.658932:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081691648 00000100:00100000:0.0:1782222013.658962:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081692032 00000100:00100000:0.0:1782222013.658965:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081692032 00000100:00100000:0.0:1782222013.658990:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081691904 00000100:00100000:0.0:1782222013.658993:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081691904 00000100:00100000:0.0:1782222013.659008:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782222013.659016:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1868795081691776:12345-0@lo:400: 00000100:00100000:0.0:1782222013.659077:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1868795081691776:12345-0@lo:400: Request processed in 61us (1793us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222013.659084:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782222013.659103:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782222013.659109:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088159b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081691648:12345-0@lo:400: 00000100:00100000:0.0:1782222013.659152:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088159b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081691648:12345-0@lo:400: Request processed in 44us (1832us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222013.659158:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782222013.659170:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782222013.659176:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1868795081692032:12345-0@lo:400: 00000100:00100000:0.0:1782222013.659206:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1868795081692032:12345-0@lo:400: Request processed in 30us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222013.659211:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782222013.659221:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782222013.659226:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1868795081691904:12345-0@lo:400: 00000100:00100000:0.0:1782222013.659283:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1868795081691904:12345-0@lo:400: Request processed in 58us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222013.659289:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782222013.659309:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081692288 00000100:00100000:0.0:1782222013.659313:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081692288 00000100:00100000:0.0:1782222013.659339:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782222013.659345:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081692288:12345-0@lo:400: 00000100:00100000:0.0:1782222013.659377:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081692288:12345-0@lo:400: Request processed in 32us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222013.659383:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1782222013.659399:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782222013.659403:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782222013.659405:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1782222013.659441:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0881598700 x1868795081691904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222013.659456:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1868795081691904:0@lo:400: 00010000:00080000:0.0:1782222013.659466:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f088159bb80 x1868795081692032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222013.659474:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1868795081692032:0@lo:400: 00010000:00080000:0.0:1782222013.659505:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f088159a300 x1868795081692288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222013.659514:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081692288:0@lo:400: 00010000:00080000:0.0:1782222013.659526:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0881599c00 x1868795081691776/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222013.659534:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1868795081691776:0@lo:400: 00000100:00100000:3.0:1782222013.660484:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07465e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1868795081691520:12345-0@lo:38: Request processed in 3555us (3750us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222013.660497:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1782222013.662179:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0881599180 x1868795081691648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222013.662201:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081691648:0@lo:400: 00000100:00100000:1.0:1782222013.662216:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081692160:0@lo:400: 00000100:00100000:1.0:1782222013.662319:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222013.662694:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081692160 00000100:00100000:3.0:1782222013.662703:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081692160 00000100:00100000:3.0:1782222013.662773:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782222013.662784:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088159a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081692160:12345-0@lo:400: 00000100:00100000:3.0:1782222013.662857:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088159a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081692160:12345-0@lo:400: Request processed in 75us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222013.662865:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1782222013.662929:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f088159b100 x1868795081692160/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222013.662940:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081692160:0@lo:400: 00000100:00080000:1.0:1782222013.663091:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000004:1.0:1782222013.665082:0:9538:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1782222013.665103:0:9538:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8f087e840000) 00000020:00000080:1.0:1782222013.665151:0:9538:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:1.0:1782222013.665414:0:9538:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f08815e6800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1782222013.665419:0:9538:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f08815e6800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1782222013.665422:0:9538:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8f08815e6800 3 00000100:00080000:3.0:1782222013.665636:0:9540:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8f087fdb0700 x1868795081692416/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222013.665649:0:9540:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746158c00 going to sleep for 0 seconds 00010000:00080000:1.0:1782222013.666601:0:9538:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f07472a5000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.127@tcp at head 00010000:00080000:2.0:1782222013.668010:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0881598380 x1868795081691520/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782222023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222013.668028:0:3652:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782222013.668039:0:3652:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1782222013.668594:0:3652:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1782222013.668605:0:3652:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1782222013.668610:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f0875aa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1782222013.668622:0:3652:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000a7f36b32): req@ffff8f087fdb0700 x1868795081692416/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1782222013.670460:0:9538:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:1.0:1782222013.670880:0:9538:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1782222013.670942:0:9538:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782222013.670973:0:9538:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xe2b7cc26e6811136 00000100:00080000:1.0:1782222013.670986:0:9538:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782222013.670994:0:9538:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8f07472a5000 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:1.0:1782222013.671043:0:9538:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0881599180 x1868795081692544/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782222013.671230:0:9538:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1782222013.671533:0:9540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222013.671594:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081692416 00000100:00100000:3.0:1782222013.671604:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081692416 00000100:00100000:3.0:1782222013.671677:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782222013.671686:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9540:x1868795081692416:12345-0@lo:901: 00000100:00100000:3.0:1782222013.671795:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9540:x1868795081692416:12345-0@lo:901: Request processed in 110us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222013.671803:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1782222013.671825:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1782222013.671860:0:9540:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f087fdb0700 x1868795081692416/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1782222029 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222013.671876:0:9540:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb0700 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9540:1868795081692416:0@lo:901: 00000100:00100000:2.0:1782222013.674790:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1868795081691520:0@lo:38: 00000100:00100000:2.0:1782222013.674843:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3652:1868795081692544:0@lo:38: 00000100:00100000:2.0:1782222013.674936:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222013.675163:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081692544 00000100:00100000:3.0:1782222013.675174:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081692544 00000100:00100000:3.0:1782222013.675227:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782222013.675269:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07465e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3652:x1868795081692544:12345-0@lo:38: 00010000:00080000:3.0:1782222013.675304:0:6527:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:3.0:1782222013.675351:0:6527:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xe2b7cc26e681113d 00000004:00100000:3.0:1782222013.675372:0:6527:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1782222013.675414:0:6527:0:(import.c:65:import_set_state_nolock()) ffff8f07466f4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782222013.675621:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07465e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1868795081692544:12345-0@lo:38: Request processed in 351us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222013.675629:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1782222013.675725:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0881599180 x1868795081692544/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782222023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222013.675737:0:3652:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782222013.675745:0:3652:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1782222013.675754:0:3652:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1782222013.675759:0:3652:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1782222013.675776:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f07472a5000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1782222013.675782:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3652:1868795081692544:0@lo:38: 00000040:00080000:1.0:1782222013.677798:0:9538:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:2.0:1782222013.678038:0:9521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1782222013.678093:0:9521:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782222013.678143:0:9521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875803200/0xe2b7cc26e681110c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811113 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222013.678157:0:9521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f0875803200/0xe2b7cc26e681110c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811113 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1782222013.678213:0:9521:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1782222013.678215:0:9521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782222013.678217:0:9521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782222013.678218:0:9521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782222013.678219:0:9521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782222013.678221:0:9521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782222013.678223:0:9521:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782222013.678225:0:9521:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782222013.678226:0:9521:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782222013.678228:0:9521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782222013.678230:0:9521:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782222013.678251:0:9521:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1782222013.678254:0:9521:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782222013.678256:0:9521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782222013.678257:0:9521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782222013.678258:0:9521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782222013.678259:0:9521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782222013.678261:0:9521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782222013.678262:0:9521:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782222013.678263:0:9521:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782222013.678264:0:9521:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782222013.678265:0:9521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782222013.678265:0:9521:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782222013.678300:0:9521:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1782222013.678322:0:9521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9521:1868795081692672:0@lo:253: 00000100:00100000:2.0:1782222013.678405:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222013.678460:0:9521:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746415840 going to sleep for 11 seconds 00000100:00100000:2.0:1782222013.678706:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081692672 00000100:00100000:2.0:1782222013.678715:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081692672 00000100:00100000:2.0:1782222013.678775:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1782222013.678792:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:9521:x1868795081692672:12345-0@lo:253: 20000000:01000000:2.0:1782222013.678828:0:6521:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1782222013.678846:0:6521:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1782222013.690416:0:6521:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1782222013.690453:0:6521:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1782222013.690506:0:6542:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1782222013.690514:0:6542:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1782222013.690549:0:6542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f0840031400/0xe2b7cc26e6811144 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.690573:0:6542:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f087fb83e00/0xe2b7cc26e681103a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6811033 expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.690582:0:6542:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0875802e00/0xe2b7cc26e6811080 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6811079 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.690591:0:6542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f0840031400/0xe2b7cc26e6811144 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.690645:0:6542:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0875802e00/0xe2b7cc26e6811080 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e6811079 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.690662:0:6542:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0875802e00/0xe2b7cc26e6811080 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e6811079 expref: 17 pid: 6521 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222013.690682:0:6542:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877157800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6542:1868795081692800:0@lo:104: 00000100:00100000:0.0:1782222013.690770:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222013.691420:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:9521:x1868795081692672:12345-0@lo:253: Request processed in 12626us (13011us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222013.691447:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00010000:00010000:0.0:1782222013.692198:0:6542:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f087fb83e00/0xe2b7cc26e681103a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e6811033 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.692214:0:6542:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f087fb83e00/0xe2b7cc26e681103a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e6811033 expref: 16 pid: 6519 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222013.692228:0:6542:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877156a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6542:1868795081692928:0@lo:104: 00000100:00100000:0.0:1782222013.692299:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222013.695330:0:9521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9521:1868795081692672:0@lo:253: 10000000:01000000:3.0:1782222013.695358:0:9521:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1782222013.695362:0:9521:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782222013.695364:0:9521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782222013.695365:0:9521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782222013.695367:0:9521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782222013.695368:0:9521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782222013.695369:0:9521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782222013.695371:0:9521:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782222013.695373:0:9521:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782222013.695375:0:9521:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782222013.695377:0:9521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782222013.695379:0:9521:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1782222013.695400:0:9521:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1782222013.696563:0:6542:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875edff00 going to sleep for 11 seconds 00000100:00100000:2.0:1782222013.703642:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081692800 00000100:00100000:2.0:1782222013.703663:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081692800 00000100:00100000:2.0:1782222013.703734:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081692928 00000100:00100000:2.0:1782222013.703739:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081692928 00000100:00100000:2.0:1782222013.703762:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782222013.703772:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877157b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+4:6542:x1868795081692800:12345-0@lo:104: 00010000:00010000:2.0:1782222013.703800:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e6811079 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6811080 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222013.703935:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782222013.703941:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877157b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+4:6542:x1868795081692800:12345-0@lo:104: Request processed in 171us (13171us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222013.703949:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782222013.703968:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782222013.703973:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877157480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+3:6542:x1868795081692928:12345-0@lo:104: 00010000:00010000:2.0:1782222013.703981:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f087fb82c00/0xe2b7cc26e6811033 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e681103a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222013.704014:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782222013.704019:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877157480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+3:6542:x1868795081692928:12345-0@lo:104: Request processed in 46us (11722us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222013.704024:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1782222013.704930:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782222013.704944:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e6811079 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6811080 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.704955:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0875803000 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:0.0:1782222013.704959:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e6811079 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e6811080 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.704971:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e6811079 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e6811080 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782222013.704979:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e6811079 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e6811080 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782222013.704985:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1782222013.705036:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e6811079 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811080 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.705043:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782222013.705070:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e6811079 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811080 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.705076:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e6811079 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811080 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.705091:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782222013.705095:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f087fb82c00/0xe2b7cc26e6811033 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e681103a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.705100:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb82c00 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:0.0:1782222013.705149:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f087fb82c00/0xe2b7cc26e6811033 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e681103a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.705157:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f087fb82c00/0xe2b7cc26e6811033 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e681103a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782222013.705163:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f087fb82c00/0xe2b7cc26e6811033 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e681103a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782222013.705168:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1782222013.705183:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f087fb82c00/0xe2b7cc26e6811033 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e681103a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.705188:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782222013.705193:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f087fb82c00/0xe2b7cc26e6811033 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e681103a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.705199:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f087fb82c00/0xe2b7cc26e6811033 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e681103a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.705215:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222013.705216:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222013.705218:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222013.705226:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222013.705264:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081693184:0@lo:103: 00000100:00100000:3.0:1782222013.706706:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081693056:0@lo:103: 00000100:00100000:3.0:1782222013.706800:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:10000000:3.0:1782222013.707576:0:9521:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1782222013.707751:0:9521:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1782222013.707983:0:9521:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1782222013.708161:0:9521:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1782222013.708385:0:9521:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1782222013.708618:0:9521:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:0.0:1782222013.709159:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222013.709316:0:6542:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877157800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6542:1868795081692800:0@lo:104: 00000100:00100000:0.0:1782222013.709674:0:6542:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877156a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6542:1868795081692928:0@lo:104: 00010000:00010000:0.0:1782222013.709711:0:6542:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f0840031400/0xe2b7cc26e6811144 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222013.709848:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081693056 00000100:00100000:2.0:1782222013.709858:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081693056 00010000:00010000:2.0:1782222013.709914:0:9532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0875802e00/0xe2b7cc26e6811080 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6811079 expref: 17 pid: 6521 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222013.709954:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081693184 00000100:00100000:2.0:1782222013.709957:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081693184 00010000:00010000:2.0:1782222013.709970:0:9532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f087fb83e00/0xe2b7cc26e681103a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6811033 expref: 18 pid: 6519 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222013.709993:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782222013.710004:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:3655:x1868795081693056:12345-0@lo:103: 00010000:00010000:2.0:1782222013.710023:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782222013.710030:0:9532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0875802e00/0xe2b7cc26e6811080 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6811079 expref: 18 pid: 6521 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222013.710043:0:9532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0875802e00/0xe2b7cc26e6811080 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e6811079 expref: 18 pid: 6521 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222013.710066:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0875802e00/0xe2b7cc26e6811080 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e6811079 expref: 18 pid: 6521 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222013.710084:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782222013.710151:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:3655:x1868795081693056:12345-0@lo:103: Request processed in 148us (3351us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222013.710159:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782222013.710177:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782222013.710184:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:3656:x1868795081693184:12345-0@lo:103: 00010000:00010000:2.0:1782222013.710192:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782222013.710196:0:9532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f087fb83e00/0xe2b7cc26e681103a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6811033 expref: 16 pid: 6519 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222013.710215:0:9532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f087fb83e00/0xe2b7cc26e681103a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e6811033 expref: 16 pid: 6519 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222013.710226:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f087fb83e00/0xe2b7cc26e681103a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e6811033 expref: 16 pid: 6519 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222013.710286:0:9532:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f0840031400/0xe2b7cc26e6811144 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222013.710296:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0840031400/0xe2b7cc26e6811144 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1782222013.710315:0:9532:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.019802471s 00010000:00010000:2.0:1782222013.710321:0:9532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f0840031400/0xe2b7cc26e6811144 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222013.710339:0:9532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f0840031400/0xe2b7cc26e6811144 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222013.710347:0:9532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f0840031400/0xe2b7cc26e6811144 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222013.710354:0:9532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f0840031400/0xe2b7cc26e6811144 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222013.710362:0:9532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0840031400 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:2.0:1782222013.710367:0:9532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f0840031400/0xe2b7cc26e6811144 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222013.710377:0:9532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f0840031400/0xe2b7cc26e6811144 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222013.710400:0:9532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f0840031400/0xe2b7cc26e6811144 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222013.710410:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782222013.710441:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:3656:x1868795081693184:12345-0@lo:103: Request processed in 256us (1286us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222013.710447:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782222013.710605:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081693184:0@lo:103: 00010000:00010000:0.0:1782222013.710632:0:6542:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f0840031400/0xe2b7cc26e6811144 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.710642:0:6542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f0840031400/0xe2b7cc26e6811144 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222013.710650:0:6542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0840031400/0xe2b7cc26e6811144 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222013.714690:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081693056:0@lo:103: 00000001:00000004:2.0:1782222013.716185:0:9521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1782222013.727519:0:9521:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1782222013.727534:0:9521:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1782222013.727587:0:9521:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1782222013.727652:0:9521:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.127@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1782222013.727677:0:9521:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1782222013.727700:0:9521:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1782222013.728753:0:9521:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782222013.728966:0:9521:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:1.0:1782222013.934199:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081693312:0@lo:13: 00000100:00100000:1.0:1782222013.934341:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222013.934516:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081693312 00000100:00100000:3.0:1782222013.934527:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081693312 00000100:00100000:3.0:1782222013.934603:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782222013.934615:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081693312:12345-0@lo:13: 00002000:00000024:3.0:1782222013.934656:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222013.934738:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081693312:12345-0@lo:13: Request processed in 125us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222013.934746:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1782222013.934797:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f087fdb0380 x1868795081693312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222029 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222013.934817:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081693312:0@lo:13: 00000100:00100000:1.0:1782222013.936912:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782222013.936949:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081693440:0@lo:13: 00000100:00100000:1.0:1782222013.937036:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222013.937151:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081693440 00000100:00100000:3.0:1782222013.937162:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081693440 00000100:00100000:3.0:1782222013.937231:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782222013.937277:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881598000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081693440:12345-0@lo:13: 00002000:00000024:3.0:1782222013.937309:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222013.937369:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881598000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081693440:12345-0@lo:13: Request processed in 104us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222013.937378:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1782222013.938908:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f087fdb0380 x1868795081693440/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222029 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222013.938936:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081693440:0@lo:13: 00010000:00010000:3.0:1782222014.005172:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1782222014.861897:0:9594:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782222014.862603:0:9594:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1782222015.018496:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222016.044613:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222017.070153:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222018.090828:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222018.540379:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782222018.540405:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081693568:0@lo:41: 00000100:00100000:2.0:1782222018.540475:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222018.540538:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081693568 00000100:00100000:2.0:1782222018.540546:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081693568 00000100:00100000:2.0:1782222018.540590:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782222018.540598:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07465e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081693568:12345-0@lo:41: 00000004:00000024:2.0:1782222018.540634:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1782222018.540676:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07465e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081693568:12345-0@lo:41: Request processed in 78us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222018.540696:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782222018.540743:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081693568:0@lo:41: 00000100:00100000:0.0:1782222018.544776:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782222018.544800:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081693696:0@lo:41: 00000100:00100000:0.0:1782222018.544886:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222018.544948:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081693696 00000100:00100000:0.0:1782222018.544954:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081693696 00000100:00100000:0.0:1782222018.544996:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1782222018.545004:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081693696:12345-0@lo:41: 00000004:00000024:0.0:1782222018.545038:0:7480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1782222018.545101:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081693696:12345-0@lo:41: Request processed in 96us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222018.545108:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1782222018.545152:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081693696:0@lo:41: 00000100:00100000:0.0:1782222019.050420:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081693824:0@lo:400: 00000100:00100000:1.0:1782222019.050460:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081694336:0@lo:400: 00000100:00100000:3.0:1782222019.050524:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1868795081694080:0@lo:400: 00000100:00100000:1.0:1782222019.050982:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222019.051029:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081694848:0@lo:400: 00000100:00100000:1.0:1782222019.051890:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222019.051937:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1782222019.051946:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081694208:0@lo:400: 00000100:00100000:1.0:1782222019.051979:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222019.051998:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1868795081694720:0@lo:400: 00000100:00100000:1.0:1782222019.052018:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222019.052033:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1868795081695232:0@lo:400: 00000100:00100000:1.0:1782222019.052054:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222019.052107:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081694336 00000100:00100000:1.0:1782222019.052115:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081694336 00000100:00100000:1.0:1782222019.052153:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081694208 00000100:00100000:1.0:1782222019.052156:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081694208 00000100:00100000:1.0:1782222019.052171:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782222019.052177:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081694336:12345-0@lo:400: 00000100:00100000:1.0:1782222019.052230:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081694336:12345-0@lo:400: Request processed in 52us (1248us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222019.052253:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782222019.052272:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782222019.052278:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081694208:12345-0@lo:400: 00000100:00100000:1.0:1782222019.052305:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081694208:12345-0@lo:400: Request processed in 27us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222019.052312:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782222019.052346:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081694208:0@lo:400: 00000100:00100000:1.0:1782222019.052356:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081694336:0@lo:400: 00000100:00100000:1.0:1782222019.052538:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081694848 00000100:00100000:1.0:1782222019.052542:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081694848 00000100:00100000:1.0:1782222019.052593:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782222019.052599:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081694848:12345-0@lo:400: 00000100:00100000:1.0:1782222019.052636:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081694848:12345-0@lo:400: Request processed in 37us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222019.052642:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1782222019.052674:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782222019.052695:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0881599c00 x1868795081694848/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222019.052705:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081694848:0@lo:400: 00000100:00100000:1.0:1782222019.052767:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081694720 00000100:00100000:1.0:1782222019.052770:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081694720 00000100:00100000:1.0:1782222019.052800:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081695232 00000100:00100000:1.0:1782222019.052804:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081695232 00000100:00100000:1.0:1782222019.052822:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782222019.052828:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1868795081694720:12345-0@lo:400: 00000100:00100000:1.0:1782222019.052862:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1868795081694720:12345-0@lo:400: Request processed in 34us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222019.052869:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782222019.052880:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782222019.052886:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1868795081695232:12345-0@lo:400: 00000100:00100000:1.0:1782222019.052914:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1868795081695232:12345-0@lo:400: Request processed in 29us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222019.052920:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1782222019.052981:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1782222019.052999:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088159b100 x1868795081694720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222019.053009:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1868795081694720:0@lo:400: 00010000:00080000:1.0:1782222019.053029:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0881598700 x1868795081695232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222019.053037:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1868795081695232:0@lo:400: 00000100:00100000:1.0:1782222019.053178:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782222019.053188:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081695360:0@lo:13: 00000100:00100000:1.0:1782222019.053256:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222019.053278:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222019.053309:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1868795081694592:0@lo:400: 00000100:00100000:1.0:1782222019.053314:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081694080 00000100:00100000:1.0:1782222019.053319:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081694080 00000100:00100000:3.0:1782222019.053346:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222019.053349:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782222019.053358:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1868795081694080:12345-0@lo:400: 00000100:00100000:3.0:1782222019.053370:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1868795081695104:0@lo:400: 00000100:00100000:3.0:1782222019.053394:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222019.053406:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1782222019.053412:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1868795081694464:0@lo:400: 00000100:00100000:3.0:1782222019.053434:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222019.053458:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081694976:0@lo:400: 00000100:00100000:3.0:1782222019.053486:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222019.053513:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081695360 00000100:00100000:3.0:1782222019.053517:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081695360 00000100:00100000:3.0:1782222019.053546:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782222019.053554:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081695360:12345-0@lo:13: 00002000:00000024:3.0:1782222019.053580:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782222019.053585:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1868795081694080:12345-0@lo:400: Request processed in 226us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222019.053594:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782222019.053607:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081694592 00000100:00100000:1.0:1782222019.053611:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081694592 00000100:00100000:3.0:1782222019.053630:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081695360:12345-0@lo:13: Request processed in 75us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222019.053633:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081695104 00000100:00100000:1.0:1782222019.053638:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081695104 00000100:00100000:3.0:1782222019.053641:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782222019.053675:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081694976 00000100:00100000:3.0:1782222019.053679:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081694976 00000100:00100000:3.0:1782222019.053706:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782222019.053714:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b785f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081694976:12345-0@lo:400: 00000100:00100000:1.0:1782222019.053720:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081694464 00000100:00100000:1.0:1782222019.053725:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081694464 00000100:00100000:1.0:1782222019.053747:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782222019.053752:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b785f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081694976:12345-0@lo:400: Request processed in 38us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222019.053756:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1868795081694592:12345-0@lo:400: 00000100:00100000:3.0:1782222019.053765:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782222019.053799:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1868795081694592:12345-0@lo:400: Request processed in 45us (453us total) trans 0 rc 0/0 00010000:00080000:3.0:1782222019.053809:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747502a00 x1868795081695360/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222035 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222019.053809:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782222019.053825:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782222019.053829:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081695360:0@lo:13: 00000100:00100000:1.0:1782222019.053834:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1868795081695104:12345-0@lo:400: 00000100:00100000:3.0:1782222019.053859:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782222019.053866:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1868795081695104:12345-0@lo:400: Request processed in 34us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222019.053871:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1868795081694464:12345-0@lo:400: 00000100:00100000:1.0:1782222019.053885:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1782222019.053906:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782222019.053910:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782222019.053920:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1868795081694464:12345-0@lo:400: Request processed in 51us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222019.053928:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1782222019.053960:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0881599180 x1868795081694464/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222019.053984:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1868795081694464:0@lo:400: 00010000:00080000:3.0:1782222019.053998:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088159a300 x1868795081694976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222019.054006:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081694976:0@lo:400: 00010000:00080000:3.0:1782222019.054015:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088159b800 x1868795081694080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222019.054022:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1868795081694080:0@lo:400: 00010000:00080000:3.0:1782222019.054031:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0881598380 x1868795081694592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222019.054039:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1868795081694592:0@lo:400: 00010000:00080000:3.0:1782222019.054049:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088159bb80 x1868795081695104/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222019.054056:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1868795081695104:0@lo:400: 00000100:00100000:0.0:1782222019.054214:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222019.054481:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081693824 00000100:00100000:3.0:1782222019.054486:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081693824 00000100:00100000:1.0:1782222019.054519:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081693952:0@lo:13: 00000100:00100000:1.0:1782222019.054553:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222019.054605:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1782222019.054614:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:3653:x1868795081693824:12345-0@lo:400: 00000100:00100000:1.0:1782222019.054690:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081693824:0@lo:400: 00000100:00100000:3.0:1782222019.054721:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:3653:x1868795081693824:12345-0@lo:400: Request processed in 108us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222019.054728:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1782222019.054810:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081693952 00000100:00100000:3.0:1782222019.054814:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081693952 00000100:00100000:3.0:1782222019.054846:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782222019.054860:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081693952:12345-0@lo:13: 00002000:00000024:3.0:1782222019.054873:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222019.054952:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081693952:12345-0@lo:13: Request processed in 93us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222019.054959:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1782222019.055012:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f087fdb1180 x1868795081693952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222035 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222019.055027:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081693952:0@lo:13: 00010000:00010000:3.0:1782222019.117541:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222020.141499:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782222020.611531:0:9884:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1782222021.162779:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1782222021.652196:0:9936:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782222021.652939:0:9936:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1782222022.124004:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1782222022.124012:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8f087fb98800 from 39 10000000:01000000:0.0:1782222022.124016:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782222022.124068:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e681114b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222022.124080:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e681114b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222022.124091:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e681114b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222022.124115:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b15500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081695488:0@lo:101: 00000100:00100000:0.0:1782222022.124178:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222022.124267:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087fb75f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782222022.125494:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081695488 00000100:00100000:2.0:1782222022.125504:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081695488 00000100:00100000:2.0:1782222022.125550:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1782222022.125559:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:6523:x1868795081695488:12345-0@lo:101: 00010000:00010000:2.0:1782222022.125571:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222022.125585:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e6811152 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e681114b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222022.125609:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e6811152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e681114b expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222022.125619:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e6811152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e681114b expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222022.125629:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb83200, rc 0) 00000100:00100000:2.0:1782222022.125680:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:6523:x1868795081695488:12345-0@lo:101: Request processed in 122us (1502us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222022.125687:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1782222022.125737:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b15500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081695488:0@lo:101: 00010000:00010000:2.0:1782222022.125751:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e681114b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811152 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222022.125760:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e681114b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6811152 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222022.125820:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081695616:0@lo:501: 00000100:00100000:2.0:1782222022.125852:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222022.125874:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746415840 going to sleep for 11 seconds 00000100:00100000:2.0:1782222022.125886:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081695616 00000100:00100000:2.0:1782222022.125889:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081695616 00000100:00100000:2.0:1782222022.125907:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1782222022.125913:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:6523:x1868795081695616:12345-0@lo:501: 00000100:00100000:2.0:1782222022.126011:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:6523:x1868795081695616:12345-0@lo:501: Request processed in 97us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222022.126017:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1782222022.127369:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081695616:0@lo:501: 00000100:00100000:2.0:1782222022.127414:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081695744:0@lo:503: 00000100:00100000:2.0:1782222022.127471:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222022.127494:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746415840 going to sleep for 11 seconds 00000100:00100000:2.0:1782222022.127512:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081695744 00000100:00100000:2.0:1782222022.127515:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081695744 00000100:00100000:2.0:1782222022.127546:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1782222022.127552:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:6523:x1868795081695744:12345-0@lo:503: 00000100:00100000:2.0:1782222022.127635:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:6523:x1868795081695744:12345-0@lo:503: Request processed in 83us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222022.127642:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1782222022.127681:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081695744:0@lo:503: 00000100:00100000:2.0:1782222022.127862:0:9961:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9961:1868795081695872:0@lo:502: 00000100:00100000:2.0:1782222022.127893:0:9961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222022.127911:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081695872 00000100:00100000:2.0:1782222022.127914:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081695872 00000100:00100000:2.0:1782222022.127936:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1782222022.127948:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:9961:x1868795081695872:12345-0@lo:502: 00000100:00100000:2.0:1782222022.128013:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:9961:x1868795081695872:12345-0@lo:502: Request processed in 65us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222022.128019:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1782222022.128046:0:9961:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f07464159c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782222022.128068:0:9961:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9961:1868795081695872:0@lo:502: 00000100:00100000:2.0:1782222022.128101:0:9961:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9961:1868795081696000:0@lo:502: 00000100:00100000:2.0:1782222022.128129:0:9961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222022.128145:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081696000 00000100:00100000:2.0:1782222022.128148:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081696000 00000100:00100000:2.0:1782222022.128165:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1782222022.128171:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:9961:x1868795081696000:12345-0@lo:502: 00000100:00100000:2.0:1782222022.133572:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:9961:x1868795081696000:12345-0@lo:502: Request processed in 5394us (5435us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222022.133592:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1782222022.133666:0:9961:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f07464159c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782222022.133692:0:9961:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9961:1868795081696000:0@lo:502: 00000040:00080000:2.0:1782222022.133727:0:9961:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1782222022.133792:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1782222022.133812:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782222022.133823:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e681114b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811152 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222022.133833:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e681114b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811152 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782222022.133842:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1782222022.133853:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1782222022.133856:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1782222022.133885:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb82e00/0xe2b7cc26e6811159 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222022.133893:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f087fb82e00/0xe2b7cc26e6811159 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222022.133901:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f087fb82e00/0xe2b7cc26e6811159 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222022.133918:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081696128:0@lo:101: 00000100:00100000:2.0:1782222022.133952:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222022.133971:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f07464159c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782222022.133986:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081696128 00000100:00100000:2.0:1782222022.133991:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081696128 00000100:00100000:2.0:1782222022.134023:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1782222022.134043:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:6523:x1868795081696128:12345-0@lo:101: 00010000:00010000:2.0:1782222022.134061:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222022.134074:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f087fb82600/0xe2b7cc26e6811160 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6811159 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222022.134096:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fb82600/0xe2b7cc26e6811160 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6811159 expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222022.134106:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f087fb82600/0xe2b7cc26e6811160 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6811159 expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222022.134113:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb82600, rc 0) 00000100:00100000:2.0:1782222022.134142:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:6523:x1868795081696128:12345-0@lo:101: Request processed in 100us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222022.134154:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1782222022.134182:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081696128:0@lo:101: 00010000:00010000:2.0:1782222022.134194:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f087fb82e00/0xe2b7cc26e6811159 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811160 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222022.134203:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f087fb82e00/0xe2b7cc26e6811159 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6811160 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222022.134284:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081696256:0@lo:501: 00000100:00100000:2.0:1782222022.134309:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222022.134321:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f07464159c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782222022.134331:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081696256 00000100:00100000:2.0:1782222022.134334:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081696256 00000100:00100000:2.0:1782222022.134355:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1782222022.134361:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:6523:x1868795081696256:12345-0@lo:501: 00000100:00100000:2.0:1782222022.134467:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:6523:x1868795081696256:12345-0@lo:501: Request processed in 105us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222022.134473:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1782222022.134498:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081696256:0@lo:501: 00000100:00100000:2.0:1782222022.134521:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081696384:0@lo:503: 00000100:00100000:2.0:1782222022.134554:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222022.134566:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f07464159c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782222022.134576:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081696384 00000100:00100000:2.0:1782222022.134579:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081696384 00000100:00100000:2.0:1782222022.134594:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1782222022.134599:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:6523:x1868795081696384:12345-0@lo:503: 00000100:00100000:2.0:1782222022.134677:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:6523:x1868795081696384:12345-0@lo:503: Request processed in 76us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222022.134684:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1782222022.134721:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081696384:0@lo:503: 00000100:00100000:2.0:1782222022.134926:0:9962:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9962:1868795081696512:0@lo:502: 00000100:00100000:2.0:1782222022.134958:0:9962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222022.134974:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081696512 00000100:00100000:2.0:1782222022.134977:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081696512 00000100:00100000:2.0:1782222022.134997:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1782222022.135003:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:9962:x1868795081696512:12345-0@lo:502: 00000100:00100000:2.0:1782222022.143455:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:9962:x1868795081696512:12345-0@lo:502: Request processed in 8442us (8487us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222022.143469:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1782222022.143553:0:9962:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746415600 going to sleep for 11 seconds 00000100:00100000:2.0:1782222022.143579:0:9962:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9962:1868795081696512:0@lo:502: 00000020:01000000:2.0:1782222022.143615:0:9962:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782222022.143624:0:9962:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782222022.143626:0:9962:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1782222022.143630:0:9962:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782222022.143632:0:9962:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1782222022.143662:0:9962:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9962:1868795081696640:0@lo:502: 00000100:00100000:2.0:1782222022.143713:0:9962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222022.143741:0:9962:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746415600 going to sleep for 11 seconds 00000100:00100000:0.0:1782222022.143825:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081696640 00000100:00100000:0.0:1782222022.143832:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081696640 00000100:00100000:0.0:1782222022.143879:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1782222022.143887:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:9962:x1868795081696640:12345-0@lo:502: 00000100:00100000:0.0:1782222022.144010:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:9962:x1868795081696640:12345-0@lo:502: Request processed in 122us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222022.144016:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1782222022.144204:0:9962:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9962:1868795081696640:0@lo:502: 00000020:01000000:1.0:1782222022.144259:0:9962:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782222022.144264:0:9962:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222022.144266:0:9962:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:1.0:1782222022.144270:0:9962:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1782222022.144507:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1782222022.144528:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1782222022.144537:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb82e00/0xe2b7cc26e6811159 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811160 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222022.144554:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f087fb82e00/0xe2b7cc26e6811159 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811160 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782222022.144564:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1782222022.144566:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8f0849b46800 from 39 10000000:01000000:0.0:1782222022.144568:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782222022.144589:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e6811167 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222022.144597:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e6811167 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222022.144606:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e6811167 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222022.144619:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b14380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081696768:0@lo:101: 00000100:00100000:0.0:1782222022.144651:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222022.144674:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087fb75540 going to sleep for 11 seconds 00000100:00100000:0.0:1782222022.144688:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081696768 00000100:00100000:0.0:1782222022.144691:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081696768 00000100:00100000:0.0:1782222022.144715:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1782222022.144722:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:6523:x1868795081696768:12345-0@lo:101: 00010000:00010000:0.0:1782222022.144730:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222022.144741:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0840030600/0xe2b7cc26e681116e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6811167 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222022.144760:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0840030600/0xe2b7cc26e681116e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6811167 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222022.144781:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0840030600/0xe2b7cc26e681116e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6811167 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222022.144790:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0840030600, rc 0) 00000100:00100000:0.0:1782222022.144818:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:6523:x1868795081696768:12345-0@lo:101: Request processed in 97us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222022.144824:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1782222022.144852:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b14380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081696768:0@lo:101: 00010000:00010000:0.0:1782222022.144864:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e6811167 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681116e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222022.144872:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e6811167 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e681116e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222022.144915:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b14380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081696896:0@lo:501: 00000100:00100000:0.0:1782222022.144939:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222022.144951:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087fb75540 going to sleep for 11 seconds 00000100:00100000:0.0:1782222022.144962:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081696896 00000100:00100000:0.0:1782222022.144965:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081696896 00000100:00100000:0.0:1782222022.144981:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1782222022.144987:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:6523:x1868795081696896:12345-0@lo:501: 00000100:00100000:0.0:1782222022.145303:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:6523:x1868795081696896:12345-0@lo:501: Request processed in 315us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222022.145310:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1782222022.145338:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b14380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081696896:0@lo:501: 00000100:00100000:0.0:1782222022.145363:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b14380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081697024:0@lo:503: 00000100:00100000:0.0:1782222022.145402:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222022.145420:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087fb75540 going to sleep for 11 seconds 00000100:00100000:0.0:1782222022.145431:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081697024 00000100:00100000:0.0:1782222022.145434:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081697024 00000100:00100000:0.0:1782222022.145451:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1782222022.145457:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:6523:x1868795081697024:12345-0@lo:503: 00000100:00100000:0.0:1782222022.145529:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:6523:x1868795081697024:12345-0@lo:503: Request processed in 71us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222022.145535:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1782222022.145572:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b14380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081697024:0@lo:503: 00000100:00100000:0.0:1782222022.145737:0:9963:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b14380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9963:1868795081697152:0@lo:502: 00000100:00100000:0.0:1782222022.145770:0:9963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222022.145787:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081697152 00000100:00100000:0.0:1782222022.145790:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081697152 00000100:00100000:0.0:1782222022.145809:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1782222022.145814:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:9963:x1868795081697152:12345-0@lo:502: 00000100:00100000:0.0:1782222022.145878:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:9963:x1868795081697152:12345-0@lo:502: Request processed in 63us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222022.145884:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1782222022.145911:0:9963:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087fb75540 going to sleep for 11 seconds 00000100:00100000:0.0:1782222022.145923:0:9963:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b14380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9963:1868795081697152:0@lo:502: 00000100:00100000:0.0:1782222022.145960:0:9963:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b14380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9963:1868795081697280:0@lo:502: 00000100:00100000:0.0:1782222022.145989:0:9963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222022.146004:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081697280 00000100:00100000:0.0:1782222022.146007:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081697280 00000100:00100000:0.0:1782222022.146024:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1782222022.146281:0:9963:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0850175480 going to sleep for 11 seconds 00000100:00100000:0.0:1782222022.149278:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:9963:x1868795081697280:12345-0@lo:502: 00000100:00100000:0.0:1782222022.149444:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:9963:x1868795081697280:12345-0@lo:502: Request processed in 177us (3453us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222022.158916:0:9963:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b14380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9963:1868795081697280:0@lo:502: 00000040:00080000:1.0:1782222022.158969:0:9963:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1782222022.159516:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1782222022.159537:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782222022.159548:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e6811167 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681116e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222022.159560:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e6811167 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681116e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782222022.159570:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1782222022.159573:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8f0849b46800 from 6 10000000:01000000:1.0:1782222022.159575:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782222022.159609:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875802800/0xe2b7cc26e6811175 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222022.159627:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f0875802800/0xe2b7cc26e6811175 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222022.159637:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0875802800/0xe2b7cc26e6811175 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222022.159658:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747500380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081697408:0@lo:101: 00000100:00100000:1.0:1782222022.159716:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222022.159749:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747482000 going to sleep for 11 seconds 00000100:00100000:1.0:1782222022.159765:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081697408 00000100:00100000:1.0:1782222022.159771:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081697408 00000100:00100000:1.0:1782222022.159803:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1782222022.159810:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+19:6523:x1868795081697408:12345-0@lo:101: 00010000:00010000:1.0:1782222022.159822:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222022.159833:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0875802600/0xe2b7cc26e681117c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6811175 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222022.159855:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0875802600/0xe2b7cc26e681117c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6811175 expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222022.159864:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0875802600/0xe2b7cc26e681117c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6811175 expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222022.159872:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0875802600, rc 0) 00000100:00100000:1.0:1782222022.159908:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:6523:x1868795081697408:12345-0@lo:101: Request processed in 97us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222022.159914:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1782222022.159945:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747500380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081697408:0@lo:101: 00010000:00010000:1.0:1782222022.159964:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0875802800/0xe2b7cc26e6811175 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681117c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222022.159972:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0875802800/0xe2b7cc26e6811175 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e681117c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222022.160013:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747500380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081697536:0@lo:256: 00000100:00100000:1.0:1782222022.160042:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222022.160050:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747482000 going to sleep for 11 seconds 00000100:00100000:1.0:1782222022.160080:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081697536 00000100:00100000:1.0:1782222022.160084:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081697536 00000100:00100000:1.0:1782222022.160099:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1782222022.160105:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:6523:x1868795081697536:12345-0@lo:256: 20000000:01000000:1.0:1782222022.160118:0:6521:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1782222022.160133:0:6521:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1782222022.160136:0:6521:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1782222022.160221:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:6523:x1868795081697536:12345-0@lo:256: Request processed in 115us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222022.160228:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1782222022.160275:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747500380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081697536:0@lo:256: 10000000:01000000:1.0:1782222022.160314:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782222022.160319:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875802800/0xe2b7cc26e6811175 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681117c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222022.160327:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f0875802800/0xe2b7cc26e6811175 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681117c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782222022.160334:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1782222022.160340:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:1.0:1782222022.160342:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1782222022.160357:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875803a00/0xe2b7cc26e6811183 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222022.160364:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f0875803a00/0xe2b7cc26e6811183 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222022.160372:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0875803a00/0xe2b7cc26e6811183 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222022.160384:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747500380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081697664:0@lo:101: 00000100:00100000:1.0:1782222022.160409:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222022.160417:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747482000 going to sleep for 11 seconds 00000100:00100000:1.0:1782222022.160433:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081697664 00000100:00100000:1.0:1782222022.160436:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081697664 00000100:00100000:1.0:1782222022.160453:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1782222022.160459:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0850982850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:6523:x1868795081697664:12345-0@lo:101: 00010000:00010000:1.0:1782222022.160466:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222022.160473:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0875803400/0xe2b7cc26e681118a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6811183 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222022.160487:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0875803400/0xe2b7cc26e681118a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6811183 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222022.160496:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0875803400/0xe2b7cc26e681118a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6811183 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222022.160503:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0875803400, rc 0) 00000100:00100000:1.0:1782222022.160529:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0850982850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:6523:x1868795081697664:12345-0@lo:101: Request processed in 70us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222022.160540:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1782222022.160562:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747500380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081697664:0@lo:101: 00010000:00010000:1.0:1782222022.160572:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0875803a00/0xe2b7cc26e6811183 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681118a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222022.160580:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0875803a00/0xe2b7cc26e6811183 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e681118a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222022.160627:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747500380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081697792:0@lo:501: 00000100:00100000:1.0:1782222022.160649:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222022.160656:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747482000 going to sleep for 11 seconds 00000100:00100000:1.0:1782222022.160670:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081697792 00000100:00100000:1.0:1782222022.160673:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081697792 00000100:00100000:1.0:1782222022.160687:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1782222022.160692:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:6523:x1868795081697792:12345-0@lo:501: 00000100:00100000:1.0:1782222022.160797:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:6523:x1868795081697792:12345-0@lo:501: Request processed in 104us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222022.160802:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1782222022.160821:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747500380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081697792:0@lo:501: 00000100:00100000:1.0:1782222022.160845:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747500380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081697920:0@lo:503: 00000100:00100000:1.0:1782222022.160880:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222022.160887:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747482000 going to sleep for 11 seconds 00000100:00100000:1.0:1782222022.160901:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081697920 00000100:00100000:1.0:1782222022.160904:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081697920 00000100:00100000:1.0:1782222022.160920:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1782222022.160924:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0850980c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:6523:x1868795081697920:12345-0@lo:503: 00000100:00100000:1.0:1782222022.161000:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0850980c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:6523:x1868795081697920:12345-0@lo:503: Request processed in 74us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222022.161007:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1782222022.161036:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747500380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081697920:0@lo:503: 00000100:00100000:1.0:1782222022.161214:0:9964:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747500380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9964:1868795081698048:0@lo:502: 00000100:00100000:1.0:1782222022.161265:0:9964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222022.161282:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081698048 00000100:00100000:1.0:1782222022.161285:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081698048 00000100:00100000:1.0:1782222022.161303:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1782222022.161308:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0850981450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:9964:x1868795081698048:12345-0@lo:502: 00000100:00100000:1.0:1782222022.161374:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0850981450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:9964:x1868795081698048:12345-0@lo:502: Request processed in 66us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222022.161381:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1782222022.161405:0:9964:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747482780 going to sleep for 11 seconds 00000100:00100000:1.0:1782222022.161416:0:9964:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747500380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9964:1868795081698048:0@lo:502: 00000020:01000000:1.0:1782222022.161437:0:9964:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1782222022.161444:0:9964:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1782222022.161451:0:9964:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222022.161453:0:9964:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1782222022.161457:0:9964:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1782222022.161461:0:9964:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.127@tcp to nid 0x20000c0a8cb7f (192.168.203.127@tcp) 00000020:01000000:1.0:1782222022.161479:0:9964:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1782222022.161481:0:9964:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782222022.161504:0:9964:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8f087fe93380) 00000020:00000080:1.0:1782222022.161527:0:9964:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1782222022.161533:0:9964:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1782222022.161608:0:9964:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1782222022.161618:0:9964:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1782222022.161625:0:9964:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe2b7cc26e6811198 00010000:00080000:1.0:1782222022.161654:0:9964:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f0875aa2000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.127@tcp at head 00010000:00010000:1.0:1782222022.161864:0:9964:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1782222022.161985:0:9964:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1782222022.161995:0:9964:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1782222022.167323:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000040:00080000:1.0:1782222022.168502:0:9964:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782222022.168662:0:9964:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782222022.168796:0:9964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1782222022.168878:0:9964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1782222022.182848:0:9965:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782222022.182855:0:9965:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1782222022.185785:0:9964:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1782222022.185801:0:9964:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1782222022.185844:0:9964:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1782222022.185868:0:9964:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe2b7cc26e681119f 00000100:00080000:3.0:1782222022.185880:0:9964:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782222022.185886:0:9964:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f0875aa2000 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:3.0:1782222022.185921:0:9964:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f086b784a80 x1868795081698176/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782222022.185952:0:9964:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1782222022.185994:0:9964:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782222022.185998:0:9964:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782222022.186000:0:9964:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1782222022.186003:0:9964:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782222022.186006:0:9964:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782222022.186008:0:9964:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1782222022.186010:0:9964:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1782222022.186013:0:9964:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1782222022.186123:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b784a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1868795081698176:0@lo:8: 00000100:00100000:0.0:1782222022.186191:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222022.186275:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081698176 00000100:00100000:0.0:1782222022.186281:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081698176 00000100:00100000:0.0:1782222022.186308:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782222022.186315:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3652:x1868795081698176:12345-0@lo:8: 00010000:00080000:0.0:1782222022.186342:0:8443:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:0.0:1782222022.186365:0:8443:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe2b7cc26e68111a6 00002000:00100000:0.0:1782222022.186378:0:8443:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8f07463b5800 ocd_connect_flags: 0xe044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1782222022.186382:0:8443:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:0.0:1782222022.186386:0:8443:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1782222022.186443:0:8443:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1782222022.186637:0:8443:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1782222022.186661:0:8443:0:(import.c:65:import_set_state_nolock()) ffff8f07463b2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782222022.186709:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3652:x1868795081698176:12345-0@lo:8: Request processed in 393us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222022.186716:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1782222022.186756:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f086b784a80 x1868795081698176/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782222032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222022.186766:0:3652:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782222022.186773:0:3652:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1782222022.186779:0:3652:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xe040401443000026 00000100:00080000:0.0:1782222022.186792:0:3652:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1782222022.186794:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f0875aa2000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1782222022.186804:0:3652:0:(osp_dev.c:1650:osp_import_event()) got connected 00000100:00100000:0.0:1782222022.186809:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b784a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1868795081698176:0@lo:8: 00000004:00080000:0.0:1782222022.186833:0:9965:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1782222022.186880:0:9965:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 221215644281ns, next at 0ns, rc = 0 00080000:00080000:0.0:1782222022.186886:0:9965:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1782222022.186936:0:9966:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b17b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9966:1868795081698304:0@lo:700: 00000100:00100000:0.0:1782222022.186962:0:9966:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222022.187094:0:9964:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849bac380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9964:1868795081698432:0@lo:502: 00000100:00100000:3.0:1782222022.187140:0:9964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222022.187172:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081698432 00000100:00100000:3.0:1782222022.187177:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081698432 00000100:00100000:0.0:1782222022.187353:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081698304 00000100:00100000:0.0:1782222022.187357:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081698304 00000100:00100000:0.0:1782222022.187390:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782222022.187396:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9966:x1868795081698304:12345-0@lo:700: 00000100:00100000:0.0:1782222022.187425:0:8450:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b15500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8450:1868795081698560:0@lo:700: 00000100:00100000:0.0:1782222022.187454:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222022.187469:0:8450:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f085091ef00 going to sleep for 11 seconds 00000100:00080000:0.0:1782222022.187480:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782222022.188825:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747500380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081698688:0@lo:400: 00000100:00100000:1.0:1782222022.188872:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222022.188894:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1868795081699200:0@lo:400: 00000100:00100000:1.0:1782222022.188916:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222022.188930:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747501880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1868795081699712:0@lo:400: 00000100:00100000:1.0:1782222022.188950:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222022.188968:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782222022.188974:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747501500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081698816:0@lo:400: 00000100:00100000:1.0:1782222022.188997:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222022.189014:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747502300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1868795081699328:0@lo:400: 00000100:00100000:2.0:1782222022.189811:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1782222022.189826:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0850980850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:9964:x1868795081698432:12345-0@lo:502: 00000100:00100000:0.0:1782222022.191393:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081698560 00000100:00100000:0.0:1782222022.191406:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081698560 00000100:00100000:0.0:1782222022.191465:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782222022.191475:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8450:x1868795081698560:12345-0@lo:700: 00000100:00080000:0.0:1782222022.191589:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782222022.191606:0:9966:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f085091ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1782222022.192500:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747502680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1868795081699072:0@lo:400: 00000100:00100000:2.0:1782222022.192895:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0850980850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:9964:x1868795081698432:12345-0@lo:502: Request processed in 3071us (5752us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222022.192919:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00010000:00010000:2.0:1782222022.193326:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782222022.194552:0:7458:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:3.0:1782222022.195148:0:9964:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0850234cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782222022.195182:0:9964:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849bac380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9964:1868795081698432:0@lo:502: 00000020:01000000:3.0:1782222022.195217:0:9964:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782222022.195224:0:9964:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782222022.195226:0:9964:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:3.0:1782222022.195231:0:9964:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:1.0:1782222022.196208:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222022.196281:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081698688 00000100:00100000:1.0:1782222022.196289:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081698688 00000100:00100000:1.0:1782222022.196323:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081699200 00000100:00100000:1.0:1782222022.196327:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081699200 00000100:00100000:1.0:1782222022.196353:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081699712 00000100:00100000:1.0:1782222022.196356:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081699712 00000100:00100000:1.0:1782222022.196379:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081699328 00000100:00100000:1.0:1782222022.196381:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081699328 00000100:00100000:1.0:1782222022.196396:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1782222022.196404:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081698688:12345-0@lo:400: 00000100:00100000:1.0:1782222022.196465:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081698688:12345-0@lo:400: Request processed in 60us (7591us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222022.196472:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1782222022.196487:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782222022.196494:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1868795081699200:12345-0@lo:400: 00000100:00100000:1.0:1782222022.196522:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1868795081699200:12345-0@lo:400: Request processed in 29us (7605us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222022.196527:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782222022.196538:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782222022.196543:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088159aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1868795081699712:12345-0@lo:400: 00000100:00100000:1.0:1782222022.196567:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088159aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1868795081699712:12345-0@lo:400: Request processed in 25us (7617us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222022.196573:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782222022.196583:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782222022.196589:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1868795081699328:12345-0@lo:400: 00000100:00100000:0.0:1782222022.196589:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222022.196609:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747500e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081699584:0@lo:400: 00000100:00100000:1.0:1782222022.196610:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1868795081699328:12345-0@lo:400: Request processed in 23us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222022.196615:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782222022.196623:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081699072 00000100:00100000:1.0:1782222022.196625:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081699072 00000100:00100000:1.0:1782222022.196638:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782222022.196643:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1868795081699072:12345-0@lo:400: 00000100:00100000:3.0:1782222022.197338:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747503480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081698944:0@lo:400: 00000100:00100000:0.0:1782222022.197995:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222022.198003:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1868795081699072:12345-0@lo:400: Request processed in 1358us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222022.198016:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782222022.198110:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081699584 00000100:00100000:2.0:1782222022.198116:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081699584 00000100:00100000:2.0:1782222022.198158:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782222022.198166:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081699584:12345-0@lo:400: 00000100:00100000:2.0:1782222022.198254:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081699584:12345-0@lo:400: Request processed in 89us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222022.198259:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081698816 00000100:00100000:2.0:1782222022.198260:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782222022.198263:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081698816 00000100:00100000:1.0:1782222022.198291:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782222022.198298:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088159bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081698816:12345-0@lo:400: 00000100:00100000:1.0:1782222022.198332:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088159bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081698816:12345-0@lo:400: Request processed in 35us (9334us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222022.198339:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1782222022.198352:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747500e00 x1868795081699584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000020:01000000:1.0:1782222022.198355:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:1.0:1782222022.198385:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1782222022.198394:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875803a00/0xe2b7cc26e6811183 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681118a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222022.198405:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f0875803a00/0xe2b7cc26e6811183 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681118a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782222022.198415:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782222022.198417:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8f08490d0000 from 39 10000000:01000000:1.0:1782222022.198420:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000100:00100000:0.0:1782222022.198442:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747500e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081699584:0@lo:400: 00010000:00010000:1.0:1782222022.198447:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875803e00/0xe2b7cc26e68111ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222022.198454:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f0875803e00/0xe2b7cc26e68111ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222022.198464:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0875803e00/0xe2b7cc26e68111ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1782222022.198469:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747502680 x1868795081699072/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222022.198477:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747502680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1868795081699072:0@lo:400: 00000100:00100000:1.0:1782222022.198480:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081699840:0@lo:101: 00000100:00100000:1.0:1782222022.198517:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222022.198543:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087d41d780 going to sleep for 11 seconds 00000100:00080000:1.0:1782222022.198556:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782222022.198560:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782222022.198561:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081699840 00000100:00080000:1.0:1782222022.198563:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782222022.198565:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081699840 00000100:00100000:1.0:1782222022.198581:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747501500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081698816:0@lo:400: 00010000:00080000:1.0:1782222022.198594:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747502300 x1868795081699328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222022.198603:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747502300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1868795081699328:0@lo:400: 00000100:00100000:0.0:1782222022.198623:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1782222022.198657:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222022.198678:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747502d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081699456:0@lo:400: 00000100:00100000:0.0:1782222022.198697:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0850980050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:6523:x1868795081699840:12345-0@lo:101: 00000100:00100000:3.0:1782222022.198702:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782222022.198706:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222022.198718:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0840030e00/0xe2b7cc26e68111b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e68111ad expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222022.198729:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081699456 00000100:00100000:3.0:1782222022.198732:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081699456 00010000:00010000:0.0:1782222022.198740:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0840030e00/0xe2b7cc26e68111b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e68111ad expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222022.198751:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0840030e00/0xe2b7cc26e68111b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68111ad expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222022.198759:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1782222022.198760:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0840030e00, rc 0) 00000100:00100000:3.0:1782222022.198764:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0875aaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081699456:12345-0@lo:400: 00000100:00100000:0.0:1782222022.198788:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0850980050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:6523:x1868795081699840:12345-0@lo:101: Request processed in 93us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222022.198791:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0875aaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081699456:12345-0@lo:400: Request processed in 28us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222022.198794:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1782222022.198797:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1782222022.198834:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747500380 x1868795081698688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222022.198845:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747500380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081698688:0@lo:400: 00010000:00080000:1.0:1782222022.198859:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747503100 x1868795081699200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222022.198868:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1868795081699200:0@lo:400: 00010000:00080000:1.0:1782222022.198880:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747501880 x1868795081699712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222022.198887:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747501880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1868795081699712:0@lo:400: 00000100:00100000:1.0:1782222022.198907:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081698944 00000100:00100000:1.0:1782222022.198909:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081698944 00000100:00100000:1.0:1782222022.198930:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782222022.198937:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081698944:12345-0@lo:400: 00000100:00100000:1.0:1782222022.198985:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081698944:12345-0@lo:400: Request processed in 43us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222022.198998:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1782222022.199012:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782222022.199037:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081699840:0@lo:101: 00010000:00010000:1.0:1782222022.199051:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0875803e00/0xe2b7cc26e68111ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68111b4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222022.199068:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0875803e00/0xe2b7cc26e68111ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e68111b4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222022.199118:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081699968:0@lo:501: 00000100:00100000:1.0:1782222022.199144:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222022.199168:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087d41d780 going to sleep for 11 seconds 00010000:00080000:3.0:1782222022.199308:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747502d80 x1868795081699456/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222022.199317:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747502d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081699456:0@lo:400: 00000100:00100000:3.0:1782222022.199333:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747503480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081698944:0@lo:400: 00000100:00100000:2.0:1782222022.200380:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081699968 00000100:00100000:2.0:1782222022.200387:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081699968 00000100:00100000:2.0:1782222022.200447:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1782222022.200454:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0850982c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:6523:x1868795081699968:12345-0@lo:501: 00000100:00100000:2.0:1782222022.200572:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0850982c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:6523:x1868795081699968:12345-0@lo:501: Request processed in 118us (1426us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222022.200579:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1782222022.200616:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081699968:0@lo:501: 00000100:00100000:2.0:1782222022.200651:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081700096:0@lo:503: 00000100:00100000:2.0:1782222022.200687:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222022.200702:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746415300 going to sleep for 11 seconds 00000100:00100000:2.0:1782222022.200714:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081700096 00000100:00100000:2.0:1782222022.200717:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081700096 00000100:00100000:2.0:1782222022.200734:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1782222022.200738:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0850981050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:6523:x1868795081700096:12345-0@lo:503: 00000100:00100000:2.0:1782222022.200807:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0850981050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:6523:x1868795081700096:12345-0@lo:503: Request processed in 67us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222022.200817:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1782222022.200845:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081700096:0@lo:503: 00000100:00100000:2.0:1782222022.201419:0:9968:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9968:1868795081700224:0@lo:502: 00000100:00100000:2.0:1782222022.201451:0:9968:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222022.201477:0:9968:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f07464159c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782222022.201559:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081700224 00000100:00100000:0.0:1782222022.201564:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081700224 00000100:00100000:0.0:1782222022.201584:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1782222022.201590:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085541c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:9968:x1868795081700224:12345-0@lo:502: 00000100:00100000:0.0:1782222022.201674:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085541c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:9968:x1868795081700224:12345-0@lo:502: Request processed in 83us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222022.201680:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1782222022.201756:0:9968:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9968:1868795081700224:0@lo:502: 00000100:00100000:2.0:1782222022.201791:0:9968:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9968:1868795081700352:0@lo:502: 00000100:00100000:2.0:1782222022.201817:0:9968:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222022.201834:0:9968:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f07464159c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782222022.202076:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081700352 00000100:00100000:0.0:1782222022.202081:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081700352 00000100:00100000:0.0:1782222022.202178:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1782222022.202185:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085541e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:9968:x1868795081700352:12345-0@lo:502: 00000100:00100000:0.0:1782222022.202274:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085541e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:9968:x1868795081700352:12345-0@lo:502: Request processed in 89us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222022.202280:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1782222022.205772:0:9968:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9968:1868795081700352:0@lo:502: 00000040:00080000:2.0:1782222022.205817:0:9968:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 40000000:02000000:0.0:1782222022.206409:0:6533:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000020:01000000:1.0:1782222022.213372:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1782222022.213414:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782222022.213428:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875803e00/0xe2b7cc26e68111ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68111b4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222022.213442:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f0875803e00/0xe2b7cc26e68111ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68111b4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782222022.213454:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1782222022.213457:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8f08490d0000 from 6 10000000:01000000:1.0:1782222022.213460:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782222022.213501:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875803600/0xe2b7cc26e68111bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222022.213509:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f0875803600/0xe2b7cc26e68111bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222022.213535:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0875803600/0xe2b7cc26e68111bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222022.213559:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081700480:0@lo:101: 00000100:00100000:1.0:1782222022.213625:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222022.213665:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087d41d780 going to sleep for 11 seconds 00000100:00100000:1.0:1782222022.213692:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081700480 00000100:00100000:1.0:1782222022.213698:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081700480 00000100:00100000:1.0:1782222022.213740:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1782222022.213748:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085541d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:6523:x1868795081700480:12345-0@lo:101: 00010000:00010000:1.0:1782222022.213762:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222022.213773:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0875802e00/0xe2b7cc26e68111c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e68111bb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222022.213796:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0875802e00/0xe2b7cc26e68111c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e68111bb expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222022.213806:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0875802e00/0xe2b7cc26e68111c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68111bb expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222022.213814:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0875802e00, rc 0) 00000100:00100000:1.0:1782222022.213850:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085541d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:6523:x1868795081700480:12345-0@lo:101: Request processed in 102us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222022.213856:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1782222022.213904:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081700480:0@lo:101: 00010000:00010000:1.0:1782222022.213919:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0875803600/0xe2b7cc26e68111bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68111c2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222022.213939:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0875803600/0xe2b7cc26e68111bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e68111c2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222022.213983:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081700608:0@lo:256: 00000100:00100000:1.0:1782222022.214013:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222022.214028:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087d41d780 going to sleep for 11 seconds 00000100:00100000:1.0:1782222022.214042:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081700608 00000100:00100000:1.0:1782222022.214045:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081700608 00000100:00100000:1.0:1782222022.214081:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1782222022.214087:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085541f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:6523:x1868795081700608:12345-0@lo:256: 20000000:01000000:1.0:1782222022.214100:0:6519:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1782222022.214115:0:6519:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1782222022.214117:0:6519:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1782222022.214184:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085541f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:6523:x1868795081700608:12345-0@lo:256: Request processed in 96us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222022.214190:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1782222022.218166:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081700608:0@lo:256: 10000000:01000000:1.0:1782222022.218249:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782222022.218260:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875803600/0xe2b7cc26e68111bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68111c2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222022.218272:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f0875803600/0xe2b7cc26e68111bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68111c2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782222022.218282:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1782222022.218284:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1782222022.218287:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1782222022.218326:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e68111c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222022.218335:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e68111c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222022.218345:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e68111c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222022.218363:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081700736:0@lo:101: 00000100:00100000:1.0:1782222022.218424:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222022.218463:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087d41d780 going to sleep for 11 seconds 00000100:00100000:1.0:1782222022.218481:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081700736 00000100:00100000:1.0:1782222022.218487:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081700736 00000100:00100000:1.0:1782222022.218527:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1782222022.218535:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:6523:x1868795081700736:12345-0@lo:101: 00010000:00010000:1.0:1782222022.218549:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222022.218562:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0875803c00/0xe2b7cc26e68111d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e68111c9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222022.218587:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0875803c00/0xe2b7cc26e68111d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e68111c9 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222022.218599:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0875803c00/0xe2b7cc26e68111d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68111c9 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222022.218607:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0875803c00, rc 0) 00000100:00100000:1.0:1782222022.218646:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:6523:x1868795081700736:12345-0@lo:101: Request processed in 110us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222022.218653:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1782222022.218698:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081700736:0@lo:101: 00010000:00010000:1.0:1782222022.218710:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e68111c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68111d0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222022.218720:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e68111c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e68111d0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222022.218769:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081700864:0@lo:501: 00000100:00100000:1.0:1782222022.218793:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222022.218812:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b7f30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782222022.218823:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081700864 00000100:00100000:1.0:1782222022.218826:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081700864 00000100:00100000:1.0:1782222022.218845:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1782222022.218850:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:6523:x1868795081700864:12345-0@lo:501: 00000100:00100000:1.0:1782222022.218950:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:6523:x1868795081700864:12345-0@lo:501: Request processed in 99us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222022.218957:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1782222022.218983:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081700864:0@lo:501: 00000100:00100000:1.0:1782222022.219002:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081700992:0@lo:503: 00000100:00100000:1.0:1782222022.219034:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222022.219070:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b7f30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782222022.219522:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8450:x1868795081698560:12345-0@lo:700: Request processed in 28048us (32066us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222022.219530:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1782222022.219693:0:8450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0849b15500 x1868795081698560/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1782222038 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222022.219705:0:8450:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b15500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8450:1868795081698560:0@lo:700: 40000000:02000000:1.0:1782222022.219715:0:8450:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:3.0:1782222022.223696:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081700992 00000100:00100000:3.0:1782222022.223708:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081700992 00000100:00100000:3.0:1782222022.223759:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1782222022.223769:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:6523:x1868795081700992:12345-0@lo:503: 00000100:00100000:3.0:1782222022.223936:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:6523:x1868795081700992:12345-0@lo:503: Request processed in 168us (4900us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222022.223944:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1782222022.224005:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081700992:0@lo:503: 00000100:00100000:0.0:1782222022.226438:0:9971:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747503480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9971:1868795081701120:0@lo:502: 00000100:00100000:0.0:1782222022.226513:0:9971:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222022.226559:0:9971:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0851442600 going to sleep for 11 seconds 00000100:00100000:2.0:1782222022.226615:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081701120 00000100:00100000:2.0:1782222022.226622:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081701120 00000100:00100000:2.0:1782222022.226673:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1782222022.226682:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:9971:x1868795081701120:12345-0@lo:502: 00000100:00100000:2.0:1782222022.226804:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:9971:x1868795081701120:12345-0@lo:502: Request processed in 122us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222022.226810:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1782222022.226816:0:9971:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747503480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9971:1868795081701120:0@lo:502: 00000020:01000000:3.0:1782222022.226841:0:9971:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782222022.226848:0:9971:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1782222022.226855:0:9971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782222022.226857:0:9971:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1782222022.226862:0:9971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1782222022.226866:0:9971:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.127@tcp to nid 0x20000c0a8cb7f (192.168.203.127@tcp) 00000020:01000000:3.0:1782222022.226887:0:9971:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1782222022.226889:0:9971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782222022.226913:0:9971:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8f0747568000) 00000020:00000080:3.0:1782222022.226936:0:9971:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1782222022.226942:0:9971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1782222022.227893:0:9971:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1782222022.227902:0:9971:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:3.0:1782222022.227917:0:9971:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe2b7cc26e68111de 00010000:00080000:3.0:1782222022.227961:0:9971:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f07472a1000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.127@tcp at head 00010000:00010000:3.0:1782222022.228419:0:9971:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:3.0:1782222022.228552:0:9971:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1782222022.228566:0:9971:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1782222022.229411:0:9971:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782222022.229528:0:9971:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782222022.229707:0:9971:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1782222022.229798:0:9971:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1782222022.232007:0:9973:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782222022.232018:0:9973:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1782222022.233724:0:9971:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1782222022.233738:0:9971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1782222022.233789:0:9971:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1782222022.233815:0:9971:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe2b7cc26e68111e5 00000100:00080000:3.0:1782222022.233826:0:9971:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782222022.233833:0:9971:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f07472a1000 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:3.0:1782222022.233866:0:9971:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0875aad180 x1868795081701248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782222022.233894:0:9971:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1782222022.233986:0:9971:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782222022.233990:0:9971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782222022.233992:0:9971:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1782222022.233995:0:9971:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782222022.233999:0:9971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782222022.234001:0:9971:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1782222022.234004:0:9971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1782222022.234006:0:9971:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1782222022.234048:0:9971:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aad500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9971:1868795081701376:0@lo:502: 00000100:00100000:3.0:1782222022.234135:0:9971:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222022.234168:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081701376 00000100:00100000:3.0:1782222022.234175:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081701376 00000100:00100000:3.0:1782222022.234210:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1782222022.234218:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:9971:x1868795081701376:12345-0@lo:502: 00000100:00100000:3.0:1782222022.234344:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:9971:x1868795081701376:12345-0@lo:502: Request processed in 126us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222022.234351:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1782222022.234393:0:9971:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b778d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782222022.234413:0:9971:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aad500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:9971:1868795081701376:0@lo:502: 00000020:01000000:3.0:1782222022.234436:0:9971:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782222022.234441:0:9971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782222022.234442:0:9971:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:3.0:1782222022.234450:0:9971:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:2.0:1782222022.234630:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1782222022.234652:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1782222022.234663:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e68111c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68111d0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222022.234672:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e68111c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68111d0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782222022.234690:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1782222022.234693:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8f087805cd40 from 1 10000000:01000000:2.0:1782222022.234695:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1782222022.234718:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb82800/0xe2b7cc26e68111ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222022.234726:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f087fb82800/0xe2b7cc26e68111ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222022.234734:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f087fb82800/0xe2b7cc26e68111ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222022.234747:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081701504:0@lo:101: 00000100:00100000:2.0:1782222022.234776:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222022.234802:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746415240 going to sleep for 11 seconds 00000100:00100000:1.0:1782222022.234912:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081701248:0@lo:8: 00000100:00100000:1.0:1782222022.234957:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222022.235082:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081701248 00000100:00100000:2.0:1782222022.235087:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081701248 00000100:00100000:2.0:1782222022.235111:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782222022.235116:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3652:x1868795081701248:12345-0@lo:8: 00010000:00080000:2.0:1782222022.235139:0:8440:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:2.0:1782222022.235161:0:8440:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe2b7cc26e68111f3 00002000:00100000:2.0:1782222022.235173:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8f0843ca9800 ocd_connect_flags: 0xe044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1782222022.235178:0:8440:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1782222022.235181:0:8440:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1782222022.235198:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081701504 00000100:00100000:3.0:1782222022.235202:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081701504 00000100:00100000:3.0:1782222022.235228:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1782222022.235261:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:6523:x1868795081701504:12345-0@lo:101: 00010000:00010000:3.0:1782222022.235271:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222022.235284:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0841459200/0xe2b7cc26e68111fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e68111ec expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222022.235304:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0841459200/0xe2b7cc26e68111fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e68111ec expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222022.235314:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0841459200/0xe2b7cc26e68111fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68111ec expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222022.235323:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0841459200, rc 0) 00000100:00100000:3.0:1782222022.235356:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:6523:x1868795081701504:12345-0@lo:101: Request processed in 122us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222022.235362:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1782222022.235397:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081701504:0@lo:101: 00010000:00010000:3.0:1782222022.235409:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f087fb82800/0xe2b7cc26e68111ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68111fa expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222022.235418:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f087fb82800/0xe2b7cc26e68111ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e68111fa expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222022.235466:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081701632:0@lo:501: 00000100:00100000:3.0:1782222022.235490:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222022.235502:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b7780c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782222022.235520:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081701632 00000100:00100000:3.0:1782222022.235524:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081701632 00000100:00100000:3.0:1782222022.235545:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1782222022.235552:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:6523:x1868795081701632:12345-0@lo:501: 00000100:00100000:3.0:1782222022.235616:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:6523:x1868795081701632:12345-0@lo:501: Request processed in 64us (125us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782222022.235623:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1782222022.235915:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081701632:0@lo:501: 10000000:01000000:3.0:1782222022.235942:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1782222022.235948:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb82800/0xe2b7cc26e68111ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68111fa expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222022.235955:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f087fb82800/0xe2b7cc26e68111ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68111fa expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782222022.237202:0:8440:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1782222022.237517:0:8440:0:(import.c:65:import_set_state_nolock()) ffff8f0843caf800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782222022.237647:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3652:x1868795081701248:12345-0@lo:8: Request processed in 2526us (2686us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222022.237663:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1782222022.238700:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0875aad180 x1868795081701248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782222032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222022.238714:0:3652:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782222022.238722:0:3652:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1782222022.238731:0:3652:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xe040401443000026 00000100:00080000:0.0:1782222022.238738:0:3652:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1782222022.238741:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f07472a1000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1782222022.238801:0:3652:0:(osp_dev.c:1650:osp_import_event()) got connected 00000100:00100000:0.0:1782222022.238808:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081701248:0@lo:8: 00000001:00100000:0.0:1782222022.238878:0:9523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1782222022.238959:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9966:x1868795081698304:12345-0@lo:700: Request processed in 51563us (51995us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222022.238969:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1782222022.239008:0:9966:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0849b17b80 x1868795081698304/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782222038 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222022.239019:0:9966:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b17b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9966:1868795081698304:0@lo:700: 00000004:00080000:0.0:1782222022.239175:0:9973:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1782222022.239311:0:9973:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 221268075236ns, next at 0ns, rc = 0 00080000:00080000:0.0:1782222022.239319:0:9973:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1782222022.242847:0:6505:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1782222022.248977:0:9966:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1782222022.248980:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782222022.249001:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747502d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081701760:0@lo:13: 00000100:00100000:0.0:1782222022.249001:0:9966:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747501880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9966:1868795081701888:0@lo:7: 00000100:00100000:0.0:1782222022.249800:0:9966:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222022.249837:0:9966:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0851442e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782222022.249887:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081701888 00000100:00100000:2.0:1782222022.249895:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081701888 00000100:00100000:2.0:1782222022.249981:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782222022.249991:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9966:x1868795081701888:12345-0@lo:7: 00000100:00100000:1.0:1782222022.250534:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222022.250624:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782222022.250635:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081702016:0@lo:13: 00000100:00100000:1.0:1782222022.250663:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222022.250687:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081701760 00000100:00100000:1.0:1782222022.250692:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081701760 00000100:00100000:1.0:1782222022.250715:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081702016 00000100:00100000:1.0:1782222022.250717:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081702016 00000100:00100000:1.0:1782222022.250738:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782222022.250745:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881598700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3653:x1868795081701760:12345-0@lo:13: 00002000:00000024:1.0:1782222022.250764:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923927040 avail 3692404736 00000100:00100000:1.0:1782222022.250804:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881598700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3653:x1868795081701760:12345-0@lo:13: Request processed in 58us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222022.250810:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782222022.250826:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782222022.250831:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3656:x1868795081702016:12345-0@lo:13: 00002000:00000024:1.0:1782222022.250840:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923927040 avail 3692404736 00000100:00100000:1.0:1782222022.250864:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3656:x1868795081702016:12345-0@lo:13: Request processed in 33us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222022.250870:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1782222022.250884:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1782222022.250907:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088159b100 x1868795081702016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222038 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222022.250931:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081702016:0@lo:13: 00010000:00080000:1.0:1782222022.250960:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747502d80 x1868795081701760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222038 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222022.250973:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747502d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081701760:0@lo:13: 00000004:00080000:1.0:1782222022.250987:0:9974:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1782222022.251003:0:9974:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9974:1868795081702144:0@lo:7: 00000100:00100000:1.0:1782222022.251026:0:9974:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1782222022.254361:0:8443:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1782222022.254369:0:8443:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1782222022.254448:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9966:x1868795081701888:12345-0@lo:7: Request processed in 4456us (4646us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222022.254458:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1782222022.257355:0:9966:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747501880 x1868795081701888/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782222038 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222022.257376:0:9966:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747501880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9966:1868795081701888:0@lo:7: 00000004:00080000:3.0:1782222022.257394:0:9966:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1782222022.257444:0:9966:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aad500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9966:1868795081702272:0@lo:5: 00000100:00100000:1.0:1782222022.258587:0:9974:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f085091ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1782222022.258654:0:9966:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222022.258675:0:9966:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b7780c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782222022.258690:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081702272 00000100:00100000:2.0:1782222022.258696:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081702272 00000100:00100000:2.0:1782222022.258745:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782222022.258753:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07465e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9966:x1868795081702272:12345-0@lo:5: 00002000:00080000:2.0:1782222022.258780:0:8440:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1782222022.258827:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07465e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9966:x1868795081702272:12345-0@lo:5: Request processed in 75us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222022.258834:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1782222022.258872:0:9966:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0875aad500 x1868795081702272/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782222038 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222022.258883:0:9966:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aad500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9966:1868795081702272:0@lo:5: 00000004:00080000:2.0:1782222022.258893:0:9966:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1782222022.258923:0:9966:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9966:1868795081702400:0@lo:5: 00000100:00100000:2.0:1782222022.258946:0:9966:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222022.258986:0:9966:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0858da3540 going to sleep for 11 seconds 00000100:00100000:2.0:1782222022.258997:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081702400 00000100:00100000:2.0:1782222022.259001:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081702400 00000100:00100000:2.0:1782222022.259023:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782222022.259291:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07465e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9966:x1868795081702400:12345-0@lo:5: 00002000:00080000:2.0:1782222022.259316:0:8440:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:2.0:1782222022.261722:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07465e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:9966:x1868795081702400:12345-0@lo:5: Request processed in 2427us (2769us total) trans 4294967297 rc 0/0 00010000:00080000:3.0:1782222022.261734:0:9966:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07465e0700 x1868795081702400/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782222038 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222022.261751:0:9966:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9966:1868795081702400:0@lo:5: 00000100:00100000:0.0:1782222022.261773:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081702144 00000004:00080000:3.0:1782222022.261774:0:9966:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1782222022.261778:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081702144 00000100:00100000:3.0:1782222022.261813:0:9966:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aadf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9966:1868795081702528:0@lo:900: 00000100:00100000:3.0:1782222022.261854:0:9966:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222022.261873:0:9966:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b778a80 going to sleep for 11 seconds 00000100:00100000:1.0:1782222022.261882:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081702528 00000100:00100000:1.0:1782222022.261886:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081702528 00000100:00100000:1.0:1782222022.261922:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782222022.261931:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0875aac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9966:x1868795081702528:12345-0@lo:900: 00000100:00100000:1.0:1782222022.261986:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0875aac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9966:x1868795081702528:12345-0@lo:900: Request processed in 56us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222022.261993:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1782222022.262012:0:9966:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0875aadf80 x1868795081702528/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1782222038 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222022.262022:0:9966:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aadf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9966:1868795081702528:0@lo:900: 00000100:00100000:2.0:1782222022.262193:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782222022.262645:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782222022.262656:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9974:x1868795081702144:12345-0@lo:7: 00002000:00080000:0.0:1782222022.267525:0:8442:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1782222022.267533:0:8442:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1782222022.267633:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9974:x1868795081702144:12345-0@lo:7: Request processed in 4968us (16594us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222022.267643:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1782222022.267777:0:9974:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088159b100 x1868795081702144/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782222038 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222022.267791:0:9974:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9974:1868795081702144:0@lo:7: 00000004:00080000:2.0:1782222022.267805:0:9974:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1782222022.267841:0:9974:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9974:1868795081702656:0@lo:5: 00000100:00100000:2.0:1782222022.267873:0:9974:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222022.267902:0:9974:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b7b5000 going to sleep for 11 seconds 00000100:00100000:0.0:1782222022.267945:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081702656 00000100:00100000:0.0:1782222022.267951:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081702656 00000100:00100000:0.0:1782222022.268075:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782222022.268084:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07465e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9974:x1868795081702656:12345-0@lo:5: 00002000:00080000:0.0:1782222022.268115:0:8440:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1782222022.268118:0:8440:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00080000:0.0:1782222022.273492:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:0.0:1782222022.273509:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1782222022.273516:0:9523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1782222022.273677:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07465e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9974:x1868795081702656:12345-0@lo:5: Request processed in 5589us (5799us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1782222022.273687:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1782222022.273898:0:9974:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07465e1c00 x1868795081702656/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782222038 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222022.273911:0:9974:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1782222022.273918:0:9974:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9974:1868795081702656:0@lo:5: 00000004:00080000:3.0:1782222022.273935:0:9974:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1782222022.273982:0:9974:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aadf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9974:1868795081702784:0@lo:700: 00000100:00100000:3.0:1782222022.274016:0:9974:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222022.274051:0:9974:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b778a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782222022.274070:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081702784 00000100:00100000:0.0:1782222022.274076:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081702784 00000100:00100000:0.0:1782222022.274151:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782222022.274160:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0875aad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9974:x1868795081702784:12345-0@lo:700: 00000100:00100000:0.0:1782222022.288161:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0875aad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9974:x1868795081702784:12345-0@lo:700: Request processed in 13993us (14135us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222022.288176:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1782222022.288304:0:9974:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0875aadf80 x1868795081702784/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782222038 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222022.288317:0:9974:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aadf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9974:1868795081702784:0@lo:700: 00000004:02000040:3.0:1782222022.295477:0:9974:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:2.0:1782222022.300831:0:9974:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9974:1868795081702912:0@lo:5: 00000100:00100000:2.0:1782222022.300900:0:9974:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222022.300938:0:9974:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b7b5900 going to sleep for 11 seconds 00000100:00100000:0.0:1782222022.301002:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081702912 00000100:00100000:0.0:1782222022.301010:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081702912 00000100:00100000:0.0:1782222022.301070:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782222022.301079:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07465e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9974:x1868795081702912:12345-0@lo:5: 00002000:00080000:0.0:1782222022.314285:0:8442:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1782222022.314309:0:8442:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:0.0:1782222022.318796:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07465e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9974:x1868795081702912:12345-0@lo:5: Request processed in 17711us (17889us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1782222022.318808:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1782222022.318936:0:9974:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07465e1180 x1868795081702912/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782222038 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222022.318953:0:9974:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9974:1868795081702912:0@lo:5: 00000004:00080000:2.0:1782222022.318968:0:9974:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000001:00080000:2.0:1782222022.512449:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:1.0:1782222023.210527:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222023.659297:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782222023.659321:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747500380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081703040:0@lo:41: 00000100:00100000:0.0:1782222023.659403:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222023.661467:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782222023.661492:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081703168:0@lo:41: 00000100:00100000:3.0:1782222023.661555:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222023.662627:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081703040 00000100:00100000:2.0:1782222023.662637:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081703040 00000100:00100000:2.0:1782222023.662695:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081703168 00000100:00100000:2.0:1782222023.662699:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081703168 00000100:00100000:2.0:1782222023.662717:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782222023.662725:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081703040:12345-0@lo:41: 00000004:00000024:2.0:1782222023.662759:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1782222023.662824:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081703040:12345-0@lo:41: Request processed in 99us (3421us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222023.662832:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782222023.662850:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1782222023.662855:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0875aad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081703168:12345-0@lo:41: 00000004:00000024:2.0:1782222023.662873:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1782222023.662907:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0875aad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081703168:12345-0@lo:41: Request processed in 51us (1353us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222023.662913:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1782222023.662959:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747500380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081703040:0@lo:41: 00000100:00100000:2.0:1782222023.662998:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081703168:0@lo:41: 00000100:00100000:2.0:1782222024.170435:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747501500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081703296:0@lo:13: 00000100:00100000:2.0:1782222024.170505:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222024.170634:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081703296 00000100:00100000:0.0:1782222024.170645:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081703296 00000100:00100000:0.0:1782222024.170705:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782222024.170714:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07465e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081703296:12345-0@lo:13: 00002000:00000024:0.0:1782222024.170749:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782222024.170796:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07465e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081703296:12345-0@lo:13: Request processed in 83us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222024.170802:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1782222024.170841:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747501500 x1868795081703296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222040 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222024.170873:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747501500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081703296:0@lo:13: 00000100:00080000:2.0:1782222024.171001:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782222024.172683:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782222024.172703:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081703424:0@lo:13: 00000100:00100000:1.0:1782222024.172756:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222024.173292:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081703424 00000100:00100000:0.0:1782222024.173299:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081703424 00000100:00100000:0.0:1782222024.173360:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782222024.173369:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088159b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081703424:12345-0@lo:13: 00002000:00000024:0.0:1782222024.173389:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782222024.173436:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088159b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081703424:12345-0@lo:13: Request processed in 68us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222024.173443:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1782222024.173487:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0881599500 x1868795081703424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222040 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222024.173505:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081703424:0@lo:13: 00000100:00080000:2.0:1782222024.173578:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782222024.236185:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1782222024.684503:0:10047:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782222024.684842:0:10047:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1782222025.258683:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1782222025.649966:0:10095:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782222025.649978:0:10095:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:3.0:1782222026.177437:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222026.177589:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060682880 00000100:00100000:0.0:1782222026.177599:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060682880 00000100:00100000:0.0:1782222026.177640:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 180 00000100:00100000:0.0:1782222026.177648:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2386:x1868795060682880:12345-192.168.203.27@tcp:250: 00010000:00080000:0.0:1782222026.177682:0:6521:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from a2ca5b6e-1b2d-4770-b014-03af882e6158@192.168.203.27@tcp t0 exp 0000000000000000 cur 225 last 0 00000020:00000080:0.0:1782222026.177721:0:6521:0:(genops.c:1406:class_connect()) connect: client a2ca5b6e-1b2d-4770-b014-03af882e6158, cookie 0xe2b7cc26e6811201 00000100:00080000:0.0:1782222026.177871:0:6521:0:(import.c:65:import_set_state_nolock()) ffff8f0875d56000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782222026.177939:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+5:2386:x1868795060682880:12345-192.168.203.27@tcp:250: Request processed in 289us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222026.177947:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 180 00000100:00100000:2.0:1782222026.185080:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222026.186364:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060683008 00000100:00100000:3.0:1782222026.186378:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060683008 00000100:00100000:3.0:1782222026.186463:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 181 00000100:00100000:3.0:1782222026.186473:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+5:6146:x1868795060683008:12345-192.168.203.27@tcp:101: 00010000:00010000:3.0:1782222026.186490:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222026.186508:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0841458400/0xe2b7cc26e6811208 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x558f77f2f75582c2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222026.186536:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0841458400/0xe2b7cc26e6811208 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75582c2 expref: 6 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222026.186547:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0841458400/0xe2b7cc26e6811208 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75582c2 expref: 6 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222026.186556:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0841458400, rc 0) 00000100:00100000:3.0:1782222026.186624:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+6:6146:x1868795060683008:12345-192.168.203.27@tcp:101: Request processed in 153us (1552us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222026.186631:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 181 00000100:00100000:1.0:1782222026.193595:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222026.193683:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060683136 00000100:00100000:3.0:1782222026.193692:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060683136 00000100:00100000:3.0:1782222026.193749:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 182 00000100:00100000:3.0:1782222026.193757:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+6:6146:x1868795060683136:12345-192.168.203.27@tcp:501: 00000100:00100000:3.0:1782222026.193864:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+6:6146:x1868795060683136:12345-192.168.203.27@tcp:501: Request processed in 107us (276us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782222026.193871:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 182 00000100:00100000:2.0:1782222026.196658:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222026.196746:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060683264 00000100:00100000:0.0:1782222026.196756:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060683264 00000100:00100000:0.0:1782222026.196818:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 183 00000100:00100000:0.0:1782222026.196828:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+6:6146:x1868795060683264:12345-192.168.203.27@tcp:101: 00010000:00010000:0.0:1782222026.196844:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222026.196861:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0840030000/0xe2b7cc26e681120f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x558f77f2f75582c9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222026.196888:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0840030000/0xe2b7cc26e681120f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75582c9 expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222026.196898:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0840030000/0xe2b7cc26e681120f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75582c9 expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222026.196907:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0840030000, rc 0) 00000100:00100000:0.0:1782222026.196962:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+7:6146:x1868795060683264:12345-192.168.203.27@tcp:101: Request processed in 136us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222026.196969:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 183 00000100:00100000:2.0:1782222026.208113:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222026.208376:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060683392 00000100:00100000:0.0:1782222026.208386:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060683392 00000100:00100000:0.0:1782222026.208450:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 184 00000100:00100000:0.0:1782222026.208460:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+7:6146:x1868795060683392:12345-192.168.203.27@tcp:501: 00000100:00100000:0.0:1782222026.208608:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+8:6146:x1868795060683392:12345-192.168.203.27@tcp:501: Request processed in 148us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222026.208632:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 184 00000100:00100000:1.0:1782222026.233530:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222026.233697:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060683520 00000100:00100000:3.0:1782222026.233707:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060683520 00000100:00100000:3.0:1782222026.233763:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 185 00000100:00100000:3.0:1782222026.233772:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+8:6146:x1868795060683520:12345-192.168.203.27@tcp:503: 00000100:00100000:3.0:1782222026.233928:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+8:6146:x1868795060683520:12345-192.168.203.27@tcp:503: Request processed in 157us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222026.233936:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 185 00000100:00100000:2.0:1782222026.254595:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222026.255120:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060683648 00000100:00100000:3.0:1782222026.255130:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060683648 00000100:00100000:3.0:1782222026.255198:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 186 00000100:00100000:3.0:1782222026.255208:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+8:6165:x1868795060683648:12345-192.168.203.27@tcp:502: 00000100:00100000:2.0:1782222026.255766:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+8:6165:x1868795060683648:12345-192.168.203.27@tcp:502: Request processed in 555us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222026.255794:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 186 00010000:00010000:1.0:1782222026.285393:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222026.312470:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222026.312583:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060683776 00000100:00100000:0.0:1782222026.312594:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060683776 00000100:00100000:0.0:1782222026.312654:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 187 00000100:00100000:0.0:1782222026.312673:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+8:6165:x1868795060683776:12345-192.168.203.27@tcp:502: 00000100:00100000:0.0:1782222026.312839:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+8:6165:x1868795060683776:12345-192.168.203.27@tcp:502: Request processed in 175us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222026.312847:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 187 00000100:00100000:1.0:1782222026.318847:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222026.319008:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060683904 00000100:00100000:2.0:1782222026.319018:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060683904 00000100:00100000:2.0:1782222026.319085:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 188 00000100:00100000:2.0:1782222026.319095:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+8:6146:x1868795060683904:12345-192.168.203.27@tcp:101: 00010000:00010000:2.0:1782222026.319110:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222026.319129:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f087fb83600/0xe2b7cc26e6811216 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x558f77f2f75582fa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222026.319155:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fb83600/0xe2b7cc26e6811216 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75582fa expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222026.319166:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f087fb83600/0xe2b7cc26e6811216 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75582fa expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222026.319181:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb83600, rc 0) 00000100:00100000:2.0:1782222026.319278:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+9:6146:x1868795060683904:12345-192.168.203.27@tcp:101: Request processed in 185us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222026.319285:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 188 00000100:00100000:2.0:1782222026.324628:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222026.326404:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060684032 00000100:00100000:3.0:1782222026.326419:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060684032 00000100:00100000:3.0:1782222026.326489:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 189 00000100:00100000:3.0:1782222026.326501:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+9:6146:x1868795060684032:12345-192.168.203.27@tcp:256: 20000000:01000000:3.0:1782222026.326528:0:6520:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1782222026.326553:0:6520:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1782222026.326558:0:6520:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1782222026.326561:0:6520:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1782222026.326563:0:6520:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1782222026.326565:0:6520:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1782222026.329482:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+9:6146:x1868795060684032:12345-192.168.203.27@tcp:256: Request processed in 2974us (4851us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222026.329498:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 189 00000100:00100000:1.0:1782222026.344110:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222026.350190:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060684160 00000100:00100000:0.0:1782222026.350205:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060684160 00000100:00100000:0.0:1782222026.350333:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 190 00000100:00100000:0.0:1782222026.350344:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+9:6146:x1868795060684160:12345-192.168.203.27@tcp:101: 00010000:00010000:0.0:1782222026.350359:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222026.350375:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0840031400/0xe2b7cc26e681121d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558301 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222026.350402:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0840031400/0xe2b7cc26e681121d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558301 expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222026.350414:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0840031400/0xe2b7cc26e681121d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558301 expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222026.350423:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0840031400, rc 0) 00000100:00100000:0.0:1782222026.350489:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:6146:x1868795060684160:12345-192.168.203.27@tcp:101: Request processed in 147us (6388us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222026.350508:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 190 00000100:00100000:2.0:1782222026.353007:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222026.353474:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060684288 00000100:00100000:0.0:1782222026.353483:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060684288 00000100:00100000:0.0:1782222026.353541:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 191 00000100:00100000:0.0:1782222026.353550:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:6146:x1868795060684288:12345-192.168.203.27@tcp:501: 00000100:00100000:0.0:1782222026.353934:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:6146:x1868795060684288:12345-192.168.203.27@tcp:501: Request processed in 383us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222026.353943:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 191 00000100:00100000:3.0:1782222026.374424:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222026.374973:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060684416 00000100:00100000:2.0:1782222026.374984:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060684416 00000100:00100000:2.0:1782222026.375052:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 192 00000100:00100000:2.0:1782222026.375063:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08672c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:6146:x1868795060684416:12345-192.168.203.27@tcp:503: 00000100:00100000:2.0:1782222026.375229:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08672c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:6146:x1868795060684416:12345-192.168.203.27@tcp:503: Request processed in 167us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222026.375295:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 192 00000100:00100000:1.0:1782222026.384799:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222026.385700:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060684544 00000100:00100000:0.0:1782222026.385709:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060684544 00000100:00100000:0.0:1782222026.385767:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 193 00000100:00100000:0.0:1782222026.385776:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:6172:x1868795060684544:12345-192.168.203.27@tcp:502: 00000100:00100000:0.0:1782222026.385995:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:6172:x1868795060684544:12345-192.168.203.27@tcp:502: Request processed in 219us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222026.386003:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 193 00000100:00100000:1.0:1782222026.391116:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222026.391342:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060684672 00000100:00100000:3.0:1782222026.391351:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060684672 00000100:00100000:3.0:1782222026.391407:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 194 00000100:00100000:3.0:1782222026.391416:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08672c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:6172:x1868795060684672:12345-192.168.203.27@tcp:502: 00000100:00100000:3.0:1782222026.391566:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08672c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:6172:x1868795060684672:12345-192.168.203.27@tcp:502: Request processed in 150us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222026.391573:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 194 00000100:00100000:3.0:1782222026.399748:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222026.399993:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060684800 00000100:00100000:1.0:1782222026.400004:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060684800 00000100:00100000:1.0:1782222026.400061:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 7 00000100:00100000:1.0:1782222026.400069:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0875aadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2386:x1868795060684800:12345-192.168.203.27@tcp:38: 00010000:00080000:1.0:1782222026.400097:0:6526:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 77bf2c2c-f408-43f9-ae59-449550631d05@192.168.203.27@tcp t0 exp 0000000000000000 cur 225 last 0 00000020:00000080:1.0:1782222026.400145:0:6526:0:(genops.c:1406:class_connect()) connect: client 77bf2c2c-f408-43f9-ae59-449550631d05, cookie 0xe2b7cc26e6811224 00000004:00100000:1.0:1782222026.400168:0:6526:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1782222026.402003:0:6526:0:(import.c:65:import_set_state_nolock()) ffff8f07415bf800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782222026.403631:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0875aadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+6:2386:x1868795060684800:12345-192.168.203.27@tcp:38: Request processed in 3554us (3885us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222026.403644:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 7 00000100:00100000:1.0:1782222026.403791:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222026.404702:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060685056 00000100:00100000:3.0:1782222026.404712:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060685056 00000100:00100000:3.0:1782222026.404799:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 8 00000100:00100000:3.0:1782222026.404807:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088159a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2386:x1868795060685056:12345-192.168.203.27@tcp:38: 00010000:00080000:3.0:1782222026.404834:0:8465:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 77bf2c2c-f408-43f9-ae59-449550631d05@192.168.203.27@tcp t0 exp 0000000000000000 cur 225 last 0 00000020:00000080:3.0:1782222026.404993:0:8465:0:(genops.c:1406:class_connect()) connect: client 77bf2c2c-f408-43f9-ae59-449550631d05, cookie 0xe2b7cc26e681122b 00000004:00100000:3.0:1782222026.405014:0:8465:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1782222026.405281:0:8465:0:(import.c:65:import_set_state_nolock()) ffff8f07472a6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782222026.405525:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088159a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+6:2386:x1868795060685056:12345-192.168.203.27@tcp:38: Request processed in 716us (1746us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222026.405533:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 8 00000100:00100000:1.0:1782222027.245208:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081703680:0@lo:400: 00000100:00100000:1.0:1782222027.245313:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222027.245369:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087719b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1868795081704192:0@lo:400: 00000100:00100000:1.0:1782222027.245395:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222027.245421:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087719ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1868795081704704:0@lo:400: 00000100:00100000:1.0:1782222027.245438:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222027.245464:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1782222027.245470:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081703808:0@lo:400: 00000100:00100000:1.0:1782222027.245492:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222027.245512:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087719a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1868795081704320:0@lo:400: 00000100:00100000:1.0:1782222027.245545:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222027.245558:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1868795081704832:0@lo:400: 00000100:00100000:1.0:1782222027.245574:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222027.245601:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081703808 00000100:00100000:1.0:1782222027.245607:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081703808 00000100:00100000:1.0:1782222027.245646:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782222027.245653:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081703808:12345-0@lo:400: 00000100:00100000:1.0:1782222027.245697:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081703808:12345-0@lo:400: Request processed in 45us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222027.245704:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782222027.245725:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081703680 00000100:00100000:1.0:1782222027.245728:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081703680 00000100:00100000:1.0:1782222027.245741:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081704192 00000100:00100000:1.0:1782222027.245743:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081704192 00000100:00100000:1.0:1782222027.245757:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081704704 00000100:00100000:1.0:1782222027.245760:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081704704 00000100:00100000:1.0:1782222027.245770:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081704320 00000100:00100000:1.0:1782222027.245771:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081704320 00000100:00100000:1.0:1782222027.245780:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081704832 00000100:00100000:1.0:1782222027.245782:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081704832 00000100:00100000:1.0:1782222027.245792:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782222027.245797:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088159b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081703680:12345-0@lo:400: 00000100:00100000:1.0:1782222027.245820:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088159b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081703680:12345-0@lo:400: Request processed in 23us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222027.245825:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782222027.245834:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782222027.245838:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1868795081704192:12345-0@lo:400: 00000100:00100000:1.0:1782222027.245855:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1868795081704192:12345-0@lo:400: Request processed in 17us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222027.245860:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782222027.245867:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1782222027.245872:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1868795081704704:12345-0@lo:400: 00000100:00100000:1.0:1782222027.245897:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1868795081704704:12345-0@lo:400: Request processed in 25us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222027.245902:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1782222027.245911:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1782222027.245915:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f917480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1868795081704320:12345-0@lo:400: 00000100:00100000:1.0:1782222027.245932:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f917480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1868795081704320:12345-0@lo:400: Request processed in 17us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222027.245937:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1782222027.245945:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782222027.245949:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1868795081704832:12345-0@lo:400: 00000100:00100000:1.0:1782222027.245965:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1868795081704832:12345-0@lo:400: Request processed in 16us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222027.245970:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782222027.246009:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081703808:0@lo:400: 00010000:00080000:1.0:1782222027.246029:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f087719a680 x1868795081704320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222027.246039:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087719a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1868795081704320:0@lo:400: 00010000:00080000:1.0:1782222027.246048:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0877198e00 x1868795081704832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222027.246056:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1868795081704832:0@lo:400: 00010000:00080000:1.0:1782222027.246064:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07465e1880 x1868795081703680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222027.246072:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081703680:0@lo:400: 00010000:00080000:1.0:1782222027.246079:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f087719b480 x1868795081704192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222027.246092:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087719b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1868795081704192:0@lo:400: 00010000:00080000:1.0:1782222027.246100:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f087719ad80 x1868795081704704/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222027.246108:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087719ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1868795081704704:0@lo:400: 00000100:00100000:0.0:1782222027.246416:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081703552:0@lo:400: 00000100:00100000:0.0:1782222027.246453:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222027.246485:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1868795081704064:0@lo:400: 00000100:00100000:0.0:1782222027.246505:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222027.246520:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087719a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081704576:0@lo:400: 00000100:00100000:0.0:1782222027.246547:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222027.246560:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081705088:0@lo:400: 00000100:00100000:0.0:1782222027.246576:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222027.246588:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1782222027.246593:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877198380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081703936:0@lo:400: 00000100:00100000:0.0:1782222027.246610:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222027.246620:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087719b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081704448:0@lo:400: 00000100:00100000:0.0:1782222027.246635:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222027.246645:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877199880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081704960:0@lo:400: 00000100:00100000:0.0:1782222027.246659:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222027.246683:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081704576 00000100:00100000:0.0:1782222027.246687:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081704576 00000100:00100000:0.0:1782222027.246706:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081705088 00000100:00100000:0.0:1782222027.246708:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081705088 00000100:00100000:0.0:1782222027.246717:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081704448 00000100:00100000:0.0:1782222027.246719:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081704448 00000100:00100000:0.0:1782222027.246728:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081704960 00000100:00100000:0.0:1782222027.246730:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081704960 00000100:00100000:0.0:1782222027.246740:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782222027.246746:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081704576:12345-0@lo:400: 00000100:00100000:0.0:1782222027.246776:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081704576:12345-0@lo:400: Request processed in 30us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222027.246782:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782222027.246792:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782222027.246796:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081705088:12345-0@lo:400: 00000100:00100000:0.0:1782222027.246827:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081705088:12345-0@lo:400: Request processed in 30us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222027.246839:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782222027.246847:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782222027.246852:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081704448:12345-0@lo:400: 00000100:00100000:0.0:1782222027.246871:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081704448:12345-0@lo:400: Request processed in 19us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222027.246877:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782222027.246884:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782222027.246889:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081704960:12345-0@lo:400: 00000100:00100000:0.0:1782222027.246906:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081704960:12345-0@lo:400: Request processed in 17us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222027.246911:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1782222027.246930:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f087719b100 x1868795081704448/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222027.246941:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087719b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081704448:0@lo:400: 00010000:00080000:0.0:1782222027.246948:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0877199880 x1868795081704960/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222027.246955:0:3656:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1782222027.246963:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877199880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081704960:0@lo:400: 00010000:00080000:0.0:1782222027.246972:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f087719a300 x1868795081704576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222027.246979:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087719a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081704576:0@lo:400: 00010000:00080000:0.0:1782222027.246986:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0877199f80 x1868795081705088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222027.247140:0:3656:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1782222027.247156:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081705088:0@lo:400: 00000100:00100000:0.0:1782222027.247187:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081704064 00000100:00100000:0.0:1782222027.247191:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081704064 00000100:00100000:0.0:1782222027.247209:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1782222027.247215:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1868795081704064:12345-0@lo:400: 00000100:00100000:0.0:1782222027.247284:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1868795081704064:12345-0@lo:400: Request processed in 69us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222027.247290:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1782222027.247312:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0877199500 x1868795081704064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222027.247320:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1868795081704064:0@lo:400: 00000100:00100000:3.0:1782222027.247682:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081703936 00000100:00100000:3.0:1782222027.247687:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081703936 00000100:00100000:3.0:1782222027.247724:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782222027.247731:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081703936:12345-0@lo:400: 00000100:00100000:3.0:1782222027.247777:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081703936:12345-0@lo:400: Request processed in 46us (1165us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222027.247783:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782222027.247808:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877198380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081703936:0@lo:400: 00000100:00080000:2.0:1782222027.247882:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782222027.247886:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782222027.247889:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782222027.247892:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782222027.248038:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081703552 00000100:00100000:1.0:1782222027.248042:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081703552 00000100:00100000:1.0:1782222027.248078:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1782222027.248084:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3656:x1868795081703552:12345-0@lo:400: 00000100:00100000:1.0:1782222027.248133:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3656:x1868795081703552:12345-0@lo:400: Request processed in 48us (1678us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222027.248139:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1782222027.248371:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081703552:0@lo:400: 00010000:00010000:0.0:1782222027.311551:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222027.410971:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222027.411119:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060685312 00000100:00100000:0.0:1782222027.411130:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060685312 00000100:00100000:0.0:1782222027.411208:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 9 00000100:00100000:0.0:1782222027.411217:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087719bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+6:6146:x1868795060685312:12345-192.168.203.27@tcp:41: 00000004:00000024:0.0:1782222027.411291:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1782222027.411361:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087719bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+6:6146:x1868795060685312:12345-192.168.203.27@tcp:41: Request processed in 144us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222027.411369:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 9 00000100:00080000:2.0:1782222027.412723:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782222027.415667:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222027.415718:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222027.415809:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060684928 00000100:00100000:1.0:1782222027.415819:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060684928 00000100:00100000:1.0:1782222027.415871:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060685440 00000100:00100000:1.0:1782222027.415875:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060685440 00000100:00100000:1.0:1782222027.415906:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 10 00000100:00100000:1.0:1782222027.415915:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+7:0:x1868795060684928:12345-192.168.203.27@tcp:41: 00000004:00000024:1.0:1782222027.415946:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1782222027.416025:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+7:0:x1868795060684928:12345-192.168.203.27@tcp:41: Request processed in 104us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222027.416033:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 10 00000100:00100000:1.0:1782222027.416051:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 11 00000100:00100000:1.0:1782222027.416057:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+6:6146:x1868795060685440:12345-192.168.203.27@tcp:40: 00000100:00100000:1.0:1782222027.416087:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+6:6146:x1868795060685440:12345-192.168.203.27@tcp:40: Request processed in 29us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222027.416106:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 11 00000100:00100000:3.0:1782222027.429854:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222027.429905:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222027.429939:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222027.429969:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222027.430113:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060685824 00000100:00100000:2.0:1782222027.430123:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060685824 00000100:00100000:2.0:1782222027.430186:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 4 00000100:00100000:2.0:1782222027.430197:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087701a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:77bf2c2c-f408-43f9-ae59-449550631d05+6:6146:x1868795060685824:12345-192.168.203.27@tcp:900: 00000100:00100000:1.0:1782222027.430338:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060685184 00000100:00100000:1.0:1782222027.430343:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060685184 00000100:00100000:1.0:1782222027.430385:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 12 00000100:00100000:1.0:1782222027.430392:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087701b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+6:0:x1868795060685184:12345-192.168.203.27@tcp:41: 00000004:00000024:1.0:1782222027.430418:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1782222027.430737:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060685568 00000100:00100000:0.0:1782222027.430742:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060685568 00000100:00100000:0.0:1782222027.430760:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060685696 00000100:00100000:0.0:1782222027.430763:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060685696 00000100:00100000:0.0:1782222027.430779:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 16 00000100:00100000:0.0:1782222027.430784:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087701a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2386:x1868795060685568:12345-192.168.203.27@tcp:8: 00010000:00080000:0.0:1782222027.430808:0:8442:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 77bf2c2c-f408-43f9-ae59-449550631d05@192.168.203.27@tcp t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:0.0:1782222027.430845:0:8442:0:(genops.c:1406:class_connect()) connect: client 77bf2c2c-f408-43f9-ae59-449550631d05, cookie 0xe2b7cc26e6811232 00002000:00100000:0.0:1782222027.430856:0:8442:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 77bf2c2c-f408-43f9-ae59-449550631d05/ffff8f07415bd000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782222027.430871:0:8442:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782222027.431058:0:8442:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1782222027.431084:0:8442:0:(import.c:65:import_set_state_nolock()) ffff8f07415ba800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782222027.444209:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087701a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:77bf2c2c-f408-43f9-ae59-449550631d05+6:6146:x1868795060685824:12345-192.168.203.27@tcp:900: Request processed in 14002us (14351us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222027.444225:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 4 00000100:00100000:2.0:1782222027.444301:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 17 00000100:00100000:2.0:1782222027.444308:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087701ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2386:x1868795060685696:12345-192.168.203.27@tcp:8: 00010000:00080000:2.0:1782222027.444350:0:8887:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 77bf2c2c-f408-43f9-ae59-449550631d05@192.168.203.27@tcp t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:2.0:1782222027.444380:0:8887:0:(genops.c:1406:class_connect()) connect: client 77bf2c2c-f408-43f9-ae59-449550631d05, cookie 0xe2b7cc26e6811239 00002000:00100000:2.0:1782222027.444394:0:8887:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 77bf2c2c-f408-43f9-ae59-449550631d05/ffff8f0843cab000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782222027.444411:0:8887:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782222027.444592:0:8887:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1782222027.444621:0:8887:0:(import.c:65:import_set_state_nolock()) ffff8f0843caa000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782222027.444666:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087701ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77bf2c2c-f408-43f9-ae59-449550631d05+6:2386:x1868795060685696:12345-192.168.203.27@tcp:8: Request processed in 356us (14696us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222027.444673:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 17 00000100:00080000:2.0:1782222027.444693:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782222027.445742:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087701b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+6:0:x1868795060685184:12345-192.168.203.27@tcp:41: Request processed in 15345us (15831us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222027.445753:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 12 00000100:00100000:3.0:1782222027.454344:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222027.454415:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222027.454493:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222027.454561:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060686208 00000100:00100000:3.0:1782222027.454582:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060686208 00000100:00100000:3.0:1782222027.454628:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 0 00000100:00100000:3.0:1782222027.454638:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+6:6146:x1868795060686208:12345-192.168.203.27@tcp:33: 00000100:00100000:2.0:1782222027.456007:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060686080 00000100:00100000:2.0:1782222027.456024:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060686080 00000100:00100000:2.0:1782222027.456077:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 49 00000100:00100000:2.0:1782222027.456086:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+6:2387:x1868795060686080:12345-192.168.203.27@tcp:400: 00000100:00100000:2.0:1782222027.456160:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+6:2387:x1868795060686080:12345-192.168.203.27@tcp:400: Request processed in 75us (1744us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222027.456168:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 49 00000100:00100000:1.0:1782222027.456441:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060685952 00000100:00100000:1.0:1782222027.456445:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060685952 00000100:00100000:1.0:1782222027.456485:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 196 00000100:00100000:1.0:1782222027.456492:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:2388:x1868795060685952:12345-192.168.203.27@tcp:400: 00000100:00100000:1.0:1782222027.456529:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:2388:x1868795060685952:12345-192.168.203.27@tcp:400: Request processed in 37us (2196us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222027.456536:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 196 00000100:00100000:0.0:1782222027.457425:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087701a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+6:2386:x1868795060685568:12345-192.168.203.27@tcp:8: Request processed in 26635us (27481us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222027.457436:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 16 00000004:00080000:3.0:1782222027.486177:0:6529:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 31445us 00000004:00200000:0.0:1782222027.508933:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1782222027.509136:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+6:6146:x1868795060686208:12345-192.168.203.27@tcp:33: Request processed in 54494us (54637us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222027.509152:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 0 00000100:00100000:1.0:1782222027.755820:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081705216:0@lo:13: 00000100:00100000:1.0:1782222027.755896:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222027.756006:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081705216 00000100:00100000:3.0:1782222027.756022:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081705216 00000100:00100000:3.0:1782222027.756074:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782222027.756083:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081705216:12345-0@lo:13: 00002000:00000024:3.0:1782222027.756106:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222027.756151:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081705216:12345-0@lo:13: Request processed in 70us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222027.756158:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1782222027.756421:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0877019f80 x1868795081705216/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222043 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222027.756438:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081705216:0@lo:13: 00000100:00100000:1.0:1782222027.758795:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782222027.758817:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081705344:0@lo:13: 00000100:00100000:1.0:1782222027.759132:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222027.759267:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081705344 00000100:00100000:3.0:1782222027.759274:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081705344 00000100:00100000:3.0:1782222027.759330:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782222027.759340:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081705344:12345-0@lo:13: 00002000:00000024:3.0:1782222027.759369:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222027.759683:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081705344:12345-0@lo:13: Request processed in 344us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222027.759691:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1782222027.759859:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0877198000 x1868795081705344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222043 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222027.759955:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081705344:0@lo:13: 00000100:00100000:1.0:1782222027.813759:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222027.813857:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060686336 00000100:00100000:2.0:1782222027.813866:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060686336 00000100:00100000:2.0:1782222027.813923:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 13 00000100:00100000:2.0:1782222027.813932:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+6:6190:x1868795060686336:12345-192.168.203.27@tcp:101: 00010000:00010000:2.0:1782222027.813950:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222027.814039:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83400/0xe2b7cc26e6811240 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558332 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222027.814102:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82200/0xe2b7cc26e6811247 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222027.814115:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82200/0xe2b7cc26e6811247 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222027.814128:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82200/0xe2b7cc26e6811247 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782222027.814181:0:8465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782222027.814198:0:8465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782222027.814214:0:8465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82200/0xe2b7cc26e6811247 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222027.814307:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83400/0xe2b7cc26e6811240 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558332 expref: 8 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222027.814324:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82200/0xe2b7cc26e6811247 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558332 expref: 7 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222027.814332:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f087f92bf00) 00010000:00010000:2.0:1782222027.814335:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782222027.814338:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb82200, rc 0) 00000100:00100000:2.0:1782222027.814407:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+7:6190:x1868795060686336:12345-192.168.203.27@tcp:101: Request processed in 475us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222027.814413:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 13 00010000:00010000:2.0:1782222028.330431:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222028.778561:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747503480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081705472:0@lo:41: 00000100:00100000:2.0:1782222028.778630:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222028.778683:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081705472 00000100:00100000:0.0:1782222028.778691:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081705472 00000100:00100000:0.0:1782222028.778739:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1782222028.778749:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081705472:12345-0@lo:41: 00000004:00000024:0.0:1782222028.778780:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1782222028.778832:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081705472:12345-0@lo:41: Request processed in 84us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222028.778839:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1782222028.778875:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747503480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081705472:0@lo:41: 00000100:00100000:3.0:1782222028.779039:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782222028.779048:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087701bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081705600:0@lo:41: 00000100:00100000:3.0:1782222028.779075:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222028.779173:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081705600 00000100:00100000:2.0:1782222028.779178:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081705600 00000100:00100000:2.0:1782222028.779209:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782222028.779216:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081705600:12345-0@lo:41: 00000004:00000024:2.0:1782222028.779252:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1782222028.779295:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081705600:12345-0@lo:41: Request processed in 79us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222028.779301:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1782222028.779960:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087701bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081705600:0@lo:41: 00000100:00100000:2.0:1782222029.292065:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747503480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081705728:0@lo:13: 00000100:00100000:2.0:1782222029.292153:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222029.292408:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081705728 00000100:00100000:0.0:1782222029.292416:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081705728 00000100:00100000:0.0:1782222029.292480:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782222029.292491:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087719aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081705728:12345-0@lo:13: 00002000:00000024:0.0:1782222029.292521:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782222029.292583:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087719aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081705728:12345-0@lo:13: Request processed in 93us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222029.292603:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1782222029.292679:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747503480 x1868795081705728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222045 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222029.292767:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747503480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081705728:0@lo:13: 00000100:00080000:2.0:1782222029.293255:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782222029.293373:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087f914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081705856:0@lo:13: 00000100:00100000:3.0:1782222029.293444:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222029.299768:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081705856 00000100:00100000:2.0:1782222029.299791:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081705856 00000100:00080000:0.0:1782222029.299986:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782222029.300108:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782222029.300124:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081705856:12345-0@lo:13: 00002000:00000024:2.0:1782222029.300366:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782222029.300560:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081705856:12345-0@lo:13: Request processed in 438us (7113us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222029.300569:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1782222029.300682:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f087f914e00 x1868795081705856/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222045 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222029.300722:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087f914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081705856:0@lo:13: 00010000:00010000:1.0:1782222029.355285:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222030.378574:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222030.619539:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222030.626279:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060686464 00000100:00100000:2.0:1782222030.626299:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060686464 00000100:00080000:0.0:1782222030.626491:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782222030.627553:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 14 00000100:00100000:2.0:1782222030.627576:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+7:6242:x1868795060686464:12345-192.168.203.27@tcp:41: 00000004:00000024:2.0:1782222030.627623:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1782222030.627714:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+7:6242:x1868795060686464:12345-192.168.203.27@tcp:41: Request processed in 150us (8191us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222030.627730:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 14 00000100:00100000:0.0:1782222030.646953:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222030.647419:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060686592 00000100:00100000:2.0:1782222030.647432:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060686592 00000100:00100000:2.0:1782222030.647529:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 15 00000100:00100000:2.0:1782222030.647543:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747503480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+6:6242:x1868795060686592:12345-192.168.203.27@tcp:41: 00000004:00000024:2.0:1782222030.647596:0:8465:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1782222030.647686:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747503480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+6:6242:x1868795060686592:12345-192.168.203.27@tcp:41: Request processed in 146us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222030.647694:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 15 00000100:00080000:0.0:1782222030.649000:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782222030.651386:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222030.651640:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060686720 00000100:00100000:0.0:1782222030.651654:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060686720 00000100:00100000:0.0:1782222030.651761:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 18 00000100:00100000:0.0:1782222030.651774:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f915880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:77bf2c2c-f408-43f9-ae59-449550631d05+6:6242:x1868795060686720:12345-192.168.203.27@tcp:13: 00002000:00000024:0.0:1782222030.651823:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782222030.651904:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f915880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:77bf2c2c-f408-43f9-ae59-449550631d05+6:6242:x1868795060686720:12345-192.168.203.27@tcp:13: Request processed in 133us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222030.651913:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 18 00000100:00080000:2.0:1782222030.652640:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782222030.655634:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222030.656016:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060686848 00000100:00100000:0.0:1782222030.656030:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060686848 00000100:00100000:0.0:1782222030.656126:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 19 00000100:00100000:0.0:1782222030.656140:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:77bf2c2c-f408-43f9-ae59-449550631d05+6:6242:x1868795060686848:12345-192.168.203.27@tcp:13: 00002000:00000024:0.0:1782222030.656433:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1782222030.657673:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782222030.666166:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:77bf2c2c-f408-43f9-ae59-449550631d05+6:6242:x1868795060686848:12345-192.168.203.27@tcp:13: Request processed in 10001us (10515us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222030.666188:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 19 00000001:00100000:2.0:1782222030.828773:0:9523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 77bf2c2c-f408-43f9-ae59-449550631d05 00010000:00010000:2.0:1782222031.403334:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1782222031.860540:0:6505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 77bf2c2c-f408-43f9-ae59-449550631d05 00000001:00100000:0.0:1782222031.860573:0:7458:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 77bf2c2c-f408-43f9-ae59-449550631d05 00000100:00100000:2.0:1782222032.368461:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087701aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081705984:0@lo:400: 00000100:00100000:2.0:1782222032.368528:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222032.368672:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1868795081706112:0@lo:400: 00000100:00100000:1.0:1782222032.368706:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222032.368747:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081705984 00000100:00100000:1.0:1782222032.368754:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081705984 00000100:00100000:1.0:1782222032.368795:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1782222032.368803:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3655:x1868795081705984:12345-0@lo:400: 00000100:00100000:0.0:1782222032.370928:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081706112 00000100:00100000:0.0:1782222032.370941:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081706112 00000100:00100000:0.0:1782222032.371020:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782222032.371030:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1868795081706112:12345-0@lo:400: 00000100:00100000:0.0:1782222032.371109:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1868795081706112:12345-0@lo:400: Request processed in 81us (2402us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222032.371132:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782222032.371196:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1868795081706112:0@lo:400: 00000100:00100000:3.0:1782222032.375872:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081706368:0@lo:400: 00000100:00100000:3.0:1782222032.375941:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222032.375976:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087701bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081706880:0@lo:400: 00000100:00100000:3.0:1782222032.376012:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222032.376030:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081707392:0@lo:400: 00000100:00100000:3.0:1782222032.376051:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222032.376074:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1782222032.376080:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087701b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081706240:0@lo:400: 00000100:00100000:3.0:1782222032.376101:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222032.376116:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1868795081706752:0@lo:400: 00000100:00100000:3.0:1782222032.376165:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222032.376185:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1868795081707264:0@lo:400: 00000100:00100000:3.0:1782222032.376207:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222032.376261:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081706368 00000100:00100000:3.0:1782222032.376268:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081706368 00000100:00100000:3.0:1782222032.376312:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081706240 00000100:00100000:3.0:1782222032.376315:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081706240 00000100:00100000:3.0:1782222032.376342:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1782222032.376350:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081706368:12345-0@lo:400: 00000100:00100000:3.0:1782222032.376405:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081706368:12345-0@lo:400: Request processed in 56us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222032.376413:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1782222032.376431:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1782222032.376438:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081706240:12345-0@lo:400: 00000100:00100000:3.0:1782222032.376466:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081706240:12345-0@lo:400: Request processed in 29us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222032.376472:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1782222032.376490:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081706880 00000100:00100000:3.0:1782222032.376493:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081706880 00000100:00100000:3.0:1782222032.376526:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081707392 00000100:00100000:3.0:1782222032.376529:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081707392 00000100:00100000:3.0:1782222032.376546:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782222032.376552:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081706880:12345-0@lo:400: 00000100:00100000:3.0:1782222032.376582:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081706880:12345-0@lo:400: Request processed in 30us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222032.376589:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782222032.376600:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782222032.376606:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081707392:12345-0@lo:400: 00000100:00100000:3.0:1782222032.376630:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081707392:12345-0@lo:400: Request processed in 25us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222032.376636:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782222032.376658:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081706752 00000100:00100000:3.0:1782222032.376662:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081706752 00000100:00100000:3.0:1782222032.376683:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081707264 00000100:00100000:3.0:1782222032.376686:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081707264 00000100:00100000:3.0:1782222032.376712:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1782222032.376717:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1868795081706752:12345-0@lo:400: 00000100:00100000:3.0:1782222032.376747:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1868795081706752:12345-0@lo:400: Request processed in 30us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222032.376753:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1782222032.376763:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1782222032.376769:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1868795081707264:12345-0@lo:400: 00000100:00100000:3.0:1782222032.376807:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1868795081707264:12345-0@lo:400: Request processed in 39us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222032.376812:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1782222032.376828:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782222032.376832:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782222032.376834:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782222032.376862:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087701b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081706240:0@lo:400: 00010000:00080000:3.0:1782222032.376875:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0877019180 x1868795081706752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222032.376885:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1868795081706752:0@lo:400: 00010000:00080000:3.0:1782222032.376895:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474fc000 x1868795081707264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222032.376902:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1868795081707264:0@lo:400: 00000100:00100000:3.0:1782222032.376910:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081706368:0@lo:400: 00010000:00080000:3.0:1782222032.376918:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f087701bb80 x1868795081706880/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222032.376925:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087701bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081706880:0@lo:400: 00010000:00080000:3.0:1782222032.376944:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474fdc00 x1868795081707392/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222032.376951:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081707392:0@lo:400: 00000100:00100000:0.0:1782222032.377301:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087701b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1868795081706624:0@lo:400: 00000100:00100000:0.0:1782222032.377339:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222032.377364:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1868795081707136:0@lo:400: 00000100:00100000:0.0:1782222032.377384:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222032.377398:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1782222032.377404:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1868795081706496:0@lo:400: 00000100:00100000:0.0:1782222032.377424:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222032.377434:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081707008:0@lo:400: 00000100:00100000:0.0:1782222032.377452:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222032.377470:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081707520:0@lo:400: 00000100:00100000:0.0:1782222032.377502:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222032.377537:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081707008 00000100:00100000:0.0:1782222032.377541:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081707008 00000100:00100000:0.0:1782222032.377571:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081707520 00000100:00100000:0.0:1782222032.377575:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081707520 00000100:00100000:0.0:1782222032.377589:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782222032.377594:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081707008:12345-0@lo:400: 00000100:00100000:0.0:1782222032.377630:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081707008:12345-0@lo:400: Request processed in 35us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222032.377636:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782222032.377648:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782222032.377653:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747294a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081707520:12345-0@lo:400: 00000100:00100000:0.0:1782222032.377676:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747294a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081707520:12345-0@lo:400: Request processed in 23us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222032.377687:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782222032.377704:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081706624 00000100:00100000:0.0:1782222032.377708:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081706624 00000100:00100000:0.0:1782222032.377724:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081707136 00000100:00100000:0.0:1782222032.377727:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081707136 00000100:00100000:0.0:1782222032.377736:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081706496 00000100:00100000:0.0:1782222032.377739:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081706496 00000100:00100000:0.0:1782222032.377751:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782222032.377756:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1868795081706624:12345-0@lo:400: 00000100:00100000:0.0:1782222032.377786:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1868795081706624:12345-0@lo:400: Request processed in 29us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222032.377792:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782222032.377802:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782222032.377808:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1868795081707136:12345-0@lo:400: 00000100:00100000:0.0:1782222032.377859:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1868795081707136:12345-0@lo:400: Request processed in 35us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222032.377866:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782222032.377878:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1782222032.377884:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1868795081706496:12345-0@lo:400: 00000100:00100000:0.0:1782222032.377909:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1868795081706496:12345-0@lo:400: Request processed in 26us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222032.377915:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1782222032.377945:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1868795081706496:0@lo:400: 00010000:00080000:0.0:1782222032.377956:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0877019f80 x1868795081707008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222032.377964:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081707008:0@lo:400: 00010000:00080000:0.0:1782222032.377992:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474fea00 x1868795081707520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222032.378000:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081707520:0@lo:400: 00000100:00100000:0.0:1782222032.378010:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087701b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1868795081706624:0@lo:400: 00000100:00100000:0.0:1782222032.378018:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1868795081707136:0@lo:400: 00000100:00080000:0.0:1782222032.378045:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782222032.378048:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782222032.378050:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782222032.384259:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3655:x1868795081705984:12345-0@lo:400: Request processed in 15429us (15704us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222032.384274:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1782222032.384955:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087701aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081705984:0@lo:400: 00010000:00010000:1.0:1782222032.430118:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222032.807805:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222032.808017:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222032.808051:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222032.808083:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222032.808111:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222032.808138:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060687232 00000100:00100000:2.0:1782222032.808147:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060687232 00000100:00100000:2.0:1782222032.808205:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060687104 00000100:00100000:2.0:1782222032.808208:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060687104 00000100:00100000:2.0:1782222032.808231:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 56 00000100:00100000:2.0:1782222032.808272:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+5:2388:x1868795060687232:12345-192.168.203.27@tcp:400: 00000100:00100000:2.0:1782222032.808342:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+5:2388:x1868795060687232:12345-192.168.203.27@tcp:400: Request processed in 71us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222032.808350:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 56 00000100:00100000:2.0:1782222032.808364:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 57 00000100:00100000:2.0:1782222032.808370:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+6:2388:x1868795060687104:12345-192.168.203.27@tcp:400: 00000100:00100000:2.0:1782222032.808394:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+6:2388:x1868795060687104:12345-192.168.203.27@tcp:400: Request processed in 24us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222032.808400:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 57 00000100:00100000:2.0:1782222032.808432:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060687488 00000100:00100000:2.0:1782222032.808436:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060687488 00000100:00100000:2.0:1782222032.808460:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060687360 00000100:00100000:2.0:1782222032.808463:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060687360 00000100:00100000:2.0:1782222032.808482:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 17 00000100:00100000:2.0:1782222032.808487:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087719b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:2388:x1868795060687488:12345-192.168.203.27@tcp:400: 00000100:00100000:2.0:1782222032.808513:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087719b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:2388:x1868795060687488:12345-192.168.203.27@tcp:400: Request processed in 26us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222032.808520:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 17 00000100:00100000:2.0:1782222032.808543:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 18 00000100:00100000:2.0:1782222032.808550:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877198380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77bf2c2c-f408-43f9-ae59-449550631d05+6:2388:x1868795060687360:12345-192.168.203.27@tcp:400: 00000100:00100000:2.0:1782222032.808572:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877198380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77bf2c2c-f408-43f9-ae59-449550631d05+6:2388:x1868795060687360:12345-192.168.203.27@tcp:400: Request processed in 23us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222032.808578:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 18 00000100:00080000:2.0:1782222032.808593:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782222032.808596:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782222032.808598:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782222032.808599:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782222032.810947:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060686976 00000100:00100000:1.0:1782222032.810960:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060686976 00000100:00100000:1.0:1782222032.811030:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 198 00000100:00100000:1.0:1782222032.811039:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:2388:x1868795060686976:12345-192.168.203.27@tcp:400: 00000100:00100000:1.0:1782222032.811105:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:2388:x1868795060686976:12345-192.168.203.27@tcp:400: Request processed in 66us (3310us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222032.811127:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 198 00000001:00100000:0.0:1782222032.884459:0:8436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 77bf2c2c-f408-43f9-ae59-449550631d05 00000100:00100000:1.0:1782222032.884576:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081707648:0@lo:13: 00000100:00100000:1.0:1782222032.884711:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222032.884793:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081707648 00000100:00100000:0.0:1782222032.884800:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081707648 00000100:00100000:0.0:1782222032.885331:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782222032.885342:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f917b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081707648:12345-0@lo:13: 00002000:00000024:0.0:1782222032.885383:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782222032.885435:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f917b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081707648:12345-0@lo:13: Request processed in 95us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222032.885442:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1782222032.885510:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747294700 x1868795081707648/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222048 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222032.885528:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081707648:0@lo:13: 00000100:00100000:3.0:1782222032.885707:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782222032.885719:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081707776:0@lo:13: 00000100:00100000:3.0:1782222032.885750:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222032.905750:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081707776 00000100:00100000:1.0:1782222032.905766:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081707776 00000100:00100000:0.0:1782222032.906101:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782222032.906114:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081707776:12345-0@lo:13: 00000100:00100000:1.0:1782222032.906495:0:8444:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1782222032.906505:0:8444:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:0.0:1782222032.906764:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782222032.906867:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081707776:12345-0@lo:13: Request processed in 756us (21115us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222032.906875:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1782222032.907368:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474fdc00 x1868795081707776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222048 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222032.907391:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081707776:0@lo:13: 00010000:00010000:0.0:1782222033.450736:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222033.900562:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782222033.900584:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081707904:0@lo:41: 00000100:00100000:2.0:1782222033.900646:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222033.900702:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081707904 00000100:00100000:2.0:1782222033.900709:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081707904 00000100:00100000:2.0:1782222033.900749:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1782222033.900766:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081707904:12345-0@lo:41: 00000004:00000024:2.0:1782222033.900796:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1782222033.900837:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081707904:12345-0@lo:41: Request processed in 73us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222033.900844:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1782222033.900885:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081707904:0@lo:41: 00000100:00100000:3.0:1782222033.901446:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782222033.901459:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087f914a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081708032:0@lo:41: 00000100:00100000:3.0:1782222033.901493:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222033.903403:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081708032 00000100:00100000:1.0:1782222033.903414:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081708032 00000100:00100000:1.0:1782222033.903475:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1782222033.903484:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081708032:12345-0@lo:41: 00000004:00000024:1.0:1782222033.903517:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1782222033.903590:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081708032:12345-0@lo:41: Request processed in 106us (2095us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222033.903597:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1782222033.903648:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087f914a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081708032:0@lo:41: 00000001:02000400:0.0:1782222034.389328:0:10195:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1782222034.411274:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782222034.411307:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081708160:0@lo:13: 00000100:00100000:0.0:1782222034.411372:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222034.411432:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081708160 00000100:00100000:0.0:1782222034.411440:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081708160 00000100:00100000:0.0:1782222034.411788:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782222034.411811:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747295c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081708160:12345-0@lo:13: 00002000:00000024:0.0:1782222034.411840:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782222034.411889:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747295c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081708160:12345-0@lo:13: Request processed in 92us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222034.411897:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1782222034.411919:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782222034.411947:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747294000 x1868795081708160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222050 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222034.411977:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081708160:0@lo:13: 00000100:00100000:1.0:1782222034.419227:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782222034.419518:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087f914a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081708288:0@lo:13: 00000100:00100000:1.0:1782222034.419585:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222034.419676:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081708288 00000100:00100000:2.0:1782222034.419684:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081708288 00000100:00100000:2.0:1782222034.419749:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782222034.419757:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f914700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081708288:12345-0@lo:13: 00002000:00000024:2.0:1782222034.419777:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782222034.419822:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f914700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081708288:12345-0@lo:13: Request processed in 65us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222034.419830:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1782222034.419867:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f087f914a80 x1868795081708288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222050 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222034.419886:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087f914a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081708288:0@lo:13: 00000100:00080000:1.0:1782222034.419939:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782222034.475287:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222035.498544:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222036.523447:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782222037.482449:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3654:1868795081708416:0@lo:400: 00000100:00100000:3.0:1782222037.482491:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081708800:0@lo:400: 00000100:00100000:2.0:1782222037.482672:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081708672:0@lo:400: 00000100:00100000:0.0:1782222037.483563:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1868795081708544:0@lo:400: 00000100:00100000:3.0:1782222037.491590:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222037.491696:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081709312:0@lo:400: 00000100:00100000:3.0:1782222037.491740:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222037.495516:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081708800 00000100:00100000:2.0:1782222037.495538:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081708800 00000100:00100000:2.0:1782222037.495775:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1782222037.495789:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081708800:12345-0@lo:400: 00000100:00100000:2.0:1782222037.495902:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081708800:12345-0@lo:400: Request processed in 116us (4324us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222037.495910:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1782222037.495968:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081709312 00000100:00100000:2.0:1782222037.495974:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081709312 00000100:00100000:2.0:1782222037.496014:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782222037.496021:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087701bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081709312:12345-0@lo:400: 00000100:00100000:2.0:1782222037.496059:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087701bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081709312:12345-0@lo:400: Request processed in 38us (4318us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222037.496065:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1782222037.496105:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782222037.496144:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222037.496643:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081708672 00000100:00100000:2.0:1782222037.496648:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081708672 00000100:00100000:2.0:1782222037.496674:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782222037.496681:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081708672:12345-0@lo:400: 00000100:00100000:2.0:1782222037.496716:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081708672:12345-0@lo:400: Request processed in 35us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222037.496722:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1782222037.504886:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474fdc00 x1868795081709312/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222037.504910:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081709312:0@lo:400: 00000100:00100000:3.0:1782222037.504927:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087701b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081709824:0@lo:400: 00000100:00100000:3.0:1782222037.505019:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222037.505160:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081708800:0@lo:400: 00000100:00100000:3.0:1782222037.505172:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1782222037.505181:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1868795081708928:0@lo:400: 00000100:00100000:3.0:1782222037.505209:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222037.505266:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081709440:0@lo:400: 00000100:00100000:3.0:1782222037.505289:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222037.505516:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081709952:0@lo:400: 00000100:00100000:3.0:1782222037.505543:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222037.506183:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081709824 00000100:00100000:1.0:1782222037.506192:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081709824 00000100:00100000:1.0:1782222037.506272:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081709440 00000100:00100000:1.0:1782222037.506276:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081709440 00000100:00100000:1.0:1782222037.506294:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081709952 00000100:00100000:1.0:1782222037.506297:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081709952 00000100:00100000:1.0:1782222037.506313:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782222037.506323:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877018380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081709824:12345-0@lo:400: 00000100:00100000:1.0:1782222037.506405:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877018380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081709824:12345-0@lo:400: Request processed in 83us (1386us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222037.506413:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782222037.506434:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782222037.506440:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087701b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081709440:12345-0@lo:400: 00000100:00100000:1.0:1782222037.506468:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087701b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081709440:12345-0@lo:400: Request processed in 29us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222037.506474:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782222037.506485:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782222037.506490:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081709952:12345-0@lo:400: 00000100:00100000:1.0:1782222037.506530:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081709952:12345-0@lo:400: Request processed in 39us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222037.506536:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782222037.507438:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081708928 00000100:00100000:2.0:1782222037.507447:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081708928 00000100:00100000:2.0:1782222037.507498:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782222037.507508:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1868795081708928:12345-0@lo:400: 00000100:00100000:2.0:1782222037.507573:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1868795081708928:12345-0@lo:400: Request processed in 67us (2362us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222037.507581:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1782222037.507604:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782222037.507610:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782222037.507654:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081708672:0@lo:400: 00000100:00100000:2.0:1782222037.507666:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1868795081709184:0@lo:400: 00000100:00100000:2.0:1782222037.507702:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222037.507744:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081709184 00000100:00100000:2.0:1782222037.507748:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081709184 00000100:00100000:2.0:1782222037.507779:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1782222037.507785:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087719a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1868795081709184:12345-0@lo:400: 00000100:00100000:2.0:1782222037.507835:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087719a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1868795081709184:12345-0@lo:400: Request processed in 49us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222037.507841:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1782222037.507856:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1782222037.507877:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474fca80 x1868795081709184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222037.507888:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1868795081709184:0@lo:400: 00000100:00100000:2.0:1782222037.507895:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087701aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1868795081709696:0@lo:400: 00000100:00100000:2.0:1782222037.507916:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222037.507933:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081709696 00000100:00100000:2.0:1782222037.507936:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081709696 00000100:00100000:2.0:1782222037.507972:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1782222037.507978:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1868795081709696:12345-0@lo:400: 00000100:00100000:2.0:1782222037.508006:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1868795081709696:12345-0@lo:400: Request processed in 28us (88us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222037.508012:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1782222037.508024:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1782222037.508038:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f087701aa00 x1868795081709696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222037.508048:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087701aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1868795081709696:0@lo:400: 00000100:00100000:2.0:1782222037.509877:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1868795081708928:0@lo:400: 00010000:00080000:2.0:1782222037.509899:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474fc700 x1868795081709440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222037.509927:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081709440:0@lo:400: 00010000:00080000:2.0:1782222037.509954:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0877019f80 x1868795081709952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222037.509963:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081709952:0@lo:400: 00010000:00080000:2.0:1782222037.509977:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f087701b480 x1868795081709824/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222037.509986:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087701b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081709824:0@lo:400: 00000100:00100000:2.0:1782222037.510077:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222037.511126:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081708416 00000100:00100000:1.0:1782222037.511138:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081708416 00000100:00100000:1.0:1782222037.511218:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1782222037.511230:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3654:x1868795081708416:12345-0@lo:400: 00000100:00100000:1.0:1782222037.511340:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3654:x1868795081708416:12345-0@lo:400: Request processed in 111us (1261us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222037.511364:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1782222037.511424:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3654:1868795081708416:0@lo:400: 00000100:00100000:0.0:1782222037.515903:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222037.515970:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081708544 00000100:00100000:0.0:1782222037.515981:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081708544 00000100:00100000:0.0:1782222037.516052:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782222037.516063:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1868795081708544:12345-0@lo:400: 00000100:00100000:0.0:1782222037.516130:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1868795081708544:12345-0@lo:400: Request processed in 69us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222037.516138:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782222037.516196:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1868795081708544:0@lo:400: 00000100:00100000:0.0:1782222037.516212:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1868795081709056:0@lo:400: 00000100:00100000:0.0:1782222037.516277:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222037.516299:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081709056 00000100:00100000:0.0:1782222037.516303:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081709056 00000100:00100000:0.0:1782222037.516346:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782222037.516352:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1868795081709056:12345-0@lo:400: 00000100:00100000:0.0:1782222037.516383:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1868795081709056:12345-0@lo:400: Request processed in 32us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222037.516389:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782222037.516418:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1868795081709056:0@lo:400: 00000100:00100000:0.0:1782222037.516427:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1868795081709568:0@lo:400: 00000100:00100000:0.0:1782222037.516449:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222037.516467:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081709568 00000100:00100000:0.0:1782222037.516470:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081709568 00000100:00100000:0.0:1782222037.516492:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782222037.516497:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1868795081709568:12345-0@lo:400: 00000100:00100000:0.0:1782222037.516526:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1868795081709568:12345-0@lo:400: Request processed in 28us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222037.516532:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782222037.516555:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1868795081709568:0@lo:400: 00000100:00080000:3.0:1782222037.516652:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782222037.547630:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222037.926824:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222037.926909:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222037.927003:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222037.927032:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222037.927061:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222037.927098:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060688128 00000100:00100000:2.0:1782222037.927110:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060688128 00000100:00100000:2.0:1782222037.927180:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060688000 00000100:00100000:2.0:1782222037.927184:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060688000 00000100:00100000:2.0:1782222037.927211:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 23 00000100:00100000:2.0:1782222037.927222:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087719ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060688128:12345-192.168.203.27@tcp:400: 00000100:00100000:2.0:1782222037.927340:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087719ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060688128:12345-192.168.203.27@tcp:400: Request processed in 119us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222037.927365:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 23 00000100:00100000:2.0:1782222037.927386:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 24 00000100:00100000:2.0:1782222037.927394:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877198e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060688000:12345-192.168.203.27@tcp:400: 00000100:00100000:2.0:1782222037.927445:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877198e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060688000:12345-192.168.203.27@tcp:400: Request processed in 52us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222037.927452:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 24 00000100:00100000:2.0:1782222037.927475:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060687872 00000100:00100000:2.0:1782222037.927479:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060687872 00000100:00100000:2.0:1782222037.927511:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060687744 00000100:00100000:2.0:1782222037.927514:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060687744 00000100:00100000:2.0:1782222037.927540:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 64 00000100:00100000:2.0:1782222037.927547:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087719b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060687872:12345-192.168.203.27@tcp:400: 00000100:00100000:3.0:1782222037.927802:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 65 00000100:00100000:3.0:1782222037.927813:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087719b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+6:2390:x1868795060687744:12345-192.168.203.27@tcp:400: 00000100:00100000:3.0:1782222037.927844:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087719b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+6:2390:x1868795060687744:12345-192.168.203.27@tcp:400: Request processed in 35us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222037.927851:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 65 00000100:00080000:3.0:1782222037.927871:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782222037.927875:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782222037.927878:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782222037.927880:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782222037.928061:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087719b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060687872:12345-192.168.203.27@tcp:400: Request processed in 513us (1151us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222037.928101:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 64 00000100:00100000:1.0:1782222037.933168:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060687616 00000100:00100000:1.0:1782222037.933191:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060687616 00000100:00100000:1.0:1782222037.933309:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 200 00000100:00100000:1.0:1782222037.933322:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:2390:x1868795060687616:12345-192.168.203.27@tcp:400: 00000100:00100000:1.0:1782222037.933445:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:2390:x1868795060687616:12345-192.168.203.27@tcp:400: Request processed in 125us (6635us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222037.933454:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 200 00000100:00100000:0.0:1782222038.003760:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081710080:0@lo:13: 00000100:00100000:0.0:1782222038.003856:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222038.003916:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782222038.003923:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081710208:0@lo:13: 00000100:00100000:0.0:1782222038.003958:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222038.004005:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081710080 00000100:00100000:0.0:1782222038.004014:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081710080 00000100:00100000:0.0:1782222038.004079:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081710208 00000100:00100000:0.0:1782222038.004083:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081710208 00000100:00100000:0.0:1782222038.004119:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782222038.004128:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747294380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081710080:12345-0@lo:13: 00002000:00000024:0.0:1782222038.004167:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782222038.004221:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747294380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081710080:12345-0@lo:13: Request processed in 93us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222038.004228:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782222038.004276:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782222038.004283:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747295500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081710208:12345-0@lo:13: 00002000:00000024:0.0:1782222038.004294:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782222038.004330:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747295500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081710208:12345-0@lo:13: Request processed in 47us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222038.004336:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1782222038.004380:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747297800 x1868795081710208/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222054 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222038.004401:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081710208:0@lo:13: 00010000:00080000:0.0:1782222038.004414:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474fdc00 x1868795081710080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222054 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222038.004427:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081710080:0@lo:13: 00010000:00010000:1.0:1782222038.571707:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222039.019706:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782222039.019732:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081710336:0@lo:41: 00000100:00100000:3.0:1782222039.019808:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222039.019874:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081710336 00000100:00100000:0.0:1782222039.019881:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081710336 00000100:00100000:0.0:1782222039.019943:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1782222039.019952:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081710336:12345-0@lo:41: 00000004:00000024:0.0:1782222039.019986:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1782222039.020042:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081710336:12345-0@lo:41: Request processed in 90us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222039.020058:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1782222039.020270:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081710336:0@lo:41: 00000100:00100000:3.0:1782222039.022881:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782222039.022905:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081710464:0@lo:41: 00000100:00100000:3.0:1782222039.022976:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222039.023030:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081710464 00000100:00100000:3.0:1782222039.023036:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081710464 00000100:00100000:3.0:1782222039.023076:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1782222039.023083:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081710464:12345-0@lo:41: 00000004:00000024:3.0:1782222039.023116:0:7480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1782222039.023154:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081710464:12345-0@lo:41: Request processed in 72us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222039.023171:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1782222039.023219:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081710464:0@lo:41: 00000100:00100000:0.0:1782222039.530450:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782222039.530474:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081710592:0@lo:13: 00000100:00100000:0.0:1782222039.530538:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222039.530601:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081710592 00000100:00100000:0.0:1782222039.530608:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081710592 00000100:00100000:0.0:1782222039.530657:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782222039.530666:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747296680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081710592:12345-0@lo:13: 00002000:00000024:0.0:1782222039.530695:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782222039.530738:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747296680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081710592:12345-0@lo:13: Request processed in 72us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222039.530745:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1782222039.530764:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782222039.530792:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747297480 x1868795081710592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222055 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222039.530807:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081710592:0@lo:13: 00000100:00100000:3.0:1782222039.531288:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782222039.531299:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081710720:0@lo:13: 00000100:00100000:3.0:1782222039.531330:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222039.531362:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081710720 00000100:00100000:3.0:1782222039.531366:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081710720 00000100:00100000:3.0:1782222039.531394:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782222039.531400:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081710720:12345-0@lo:13: 00002000:00000024:3.0:1782222039.531411:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222039.531440:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081710720:12345-0@lo:13: Request processed in 40us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222039.531446:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1782222039.531471:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474fea00 x1868795081710720/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222055 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222039.531482:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081710720:0@lo:13: 00000100:00080000:0.0:1782222039.531585:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782222039.594748:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782222039.655397:0:10342:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff10bccf70 20000000:00000080:0.0:1782222039.655414:0:10342:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f07465bb000 uarg=0000000000000000 20000000:01000000:0.0:1782222039.655463:0:10342:0:(mgs_llog.c:2004:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1782222039.655466:0:10342:0:(mgs_llog.c:6054:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1782222039.655468:0:10342:0:(mgs_llog.c:6085:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1782222039.655473:0:10342:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1782222039.655477:0:10342:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1782222039.655532:0:10342:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1782222039.655534:0:10342:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1782222039.661479:0:10343:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:2.0:1782222039.661733:0:10342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:2.0:1782222039.661762:0:10342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:2.0:1782222039.661776:0:10342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:2.0:1782222039.661790:0:10342:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1782222039.661793:0:10342:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1782222039.662432:0:10344:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:2.0:1782222039.662837:0:10342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:2.0:1782222039.662865:0:10342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:2.0:1782222039.662882:0:10342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:2.0:1782222039.663505:0:10342:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1782222039.663507:0:10342:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1782222039.667518:0:10345:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1782222039.667832:0:10342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1782222039.667863:0:10342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1782222039.667877:0:10342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:2.0:1782222039.667889:0:10342:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1782222039.667891:0:10342:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1782222039.668535:0:10346:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1782222039.668685:0:10342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1782222039.668724:0:10342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1782222039.668742:0:10342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:2.0:1782222039.668759:0:10342:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1782222039.668762:0:10342:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1782222039.669041:0:10347:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1782222039.669177:0:10342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1782222039.669198:0:10342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1782222039.669212:0:10342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 10000000:01000000:2.0:1782222039.669225:0:10342:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1782222039.669282:0:10342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f087fb82a00/0xe2b7cc26e681124e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222039.669300:0:10342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0875802a00/0xe2b7cc26e68110e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68110e2 expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222039.669309:0:10342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0840030200/0xe2b7cc26e6811113 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e681110c expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222039.669317:0:10342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e6811152 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e681114b expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222039.669325:0:10342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f087fb82600/0xe2b7cc26e6811160 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6811159 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222039.669333:0:10342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0840030600/0xe2b7cc26e681116e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6811167 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222039.669339:0:10342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0875803400/0xe2b7cc26e681118a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6811183 expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222039.669347:0:10342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0840030e00/0xe2b7cc26e68111b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68111ad expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222039.669355:0:10342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0875803c00/0xe2b7cc26e68111d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68111c9 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222039.669374:0:10342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0841459200/0xe2b7cc26e68111fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68111ec expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222039.669385:0:10342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0841458400/0xe2b7cc26e6811208 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75582c2 expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222039.669394:0:10342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0840030000/0xe2b7cc26e681120f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75582c9 expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222039.669402:0:10342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f087fb82a00/0xe2b7cc26e681124e lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222039.669439:0:10342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0840030000/0xe2b7cc26e681120f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75582c9 expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222039.669455:0:10342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f0840030000/0xe2b7cc26e681120f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75582c9 expref: 9 pid: 6521 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222039.669470:0:10342:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087719a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1868795081710848:192.168.203.27@tcp:104: 00010000:00010000:2.0:1782222039.669575:0:10342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0841458400/0xe2b7cc26e6811208 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75582c2 expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222039.669585:0:10342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f0841458400/0xe2b7cc26e6811208 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75582c2 expref: 9 pid: 6519 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222039.669595:0:10342:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087701b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1868795081710976:192.168.203.27@tcp:104: 00010000:00010000:2.0:1782222039.669624:0:10342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0841459200/0xe2b7cc26e68111fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e68111ec expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222039.669643:0:10342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0841459200/0xe2b7cc26e68111fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e68111ec expref: 23 pid: 6519 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222039.669654:0:10342:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877019f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1868795081711104:0@lo:104: 00000100:00100000:2.0:1782222039.669691:0:10342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782222039.669737:0:10342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0875803c00/0xe2b7cc26e68111d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e68111c9 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222039.669745:0:10342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0875803c00/0xe2b7cc26e68111d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e68111c9 expref: 23 pid: 6520 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222039.669753:0:10342:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747649f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1868795081711232:0@lo:104: 00000100:00100000:2.0:1782222039.669774:0:10342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782222039.669796:0:10342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0840030e00/0xe2b7cc26e68111b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e68111ad expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222039.669804:0:10342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0840030e00/0xe2b7cc26e68111b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e68111ad expref: 23 pid: 6520 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222039.669811:0:10342:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747648a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1868795081711360:0@lo:104: 00000100:00100000:2.0:1782222039.669827:0:10342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782222039.669839:0:10342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0875803400/0xe2b7cc26e681118a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e6811183 expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222039.669847:0:10342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0875803400/0xe2b7cc26e681118a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e6811183 expref: 23 pid: 6521 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222039.669854:0:10342:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747648000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1868795081711488:0@lo:104: 00000100:00100000:2.0:1782222039.669882:0:10342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782222039.669905:0:10342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0840030600/0xe2b7cc26e681116e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e6811167 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222039.669913:0:10342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0840030600/0xe2b7cc26e681116e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e6811167 expref: 23 pid: 6520 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222039.669920:0:10342:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747649c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1868795081711616:0@lo:104: 00010000:00010000:2.0:1782222039.669956:0:10342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f087fb82600/0xe2b7cc26e6811160 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e6811159 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222039.669964:0:10342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f087fb82600/0xe2b7cc26e6811160 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e6811159 expref: 23 pid: 6519 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222039.669971:0:10342:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074764aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1868795081711744:0@lo:104: 00010000:00010000:2.0:1782222039.669990:0:10342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e6811152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e681114b expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222039.669997:0:10342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e6811152 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e681114b expref: 23 pid: 6521 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222039.670006:0:10342:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747649180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1868795081711872:0@lo:104: 00010000:00010000:2.0:1782222039.670025:0:10342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0840030200/0xe2b7cc26e6811113 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e681110c expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222039.670033:0:10342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0840030200/0xe2b7cc26e6811113 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e681110c expref: 23 pid: 6521 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222039.670039:0:10342:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074764b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1868795081712000:0@lo:104: 00010000:00010000:2.0:1782222039.670057:0:10342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0875802a00/0xe2b7cc26e68110e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e68110e2 expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222039.670070:0:10342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0875802a00/0xe2b7cc26e68110e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e68110e2 expref: 23 pid: 6521 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222039.670078:0:10342:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747648380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1868795081712128:0@lo:104: 00000100:00100000:2.0:1782222039.670096:0:10342:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087fb75600 going to sleep for 11 seconds 00000100:00100000:3.0:1782222039.670555:0:6510:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782222039.670581:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222039.670593:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222039.670601:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222039.670609:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222039.670617:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222039.670624:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081711104 00000100:00100000:3.0:1782222039.670686:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081711104 00000100:00100000:3.0:1782222039.670724:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081711232 00000100:00100000:3.0:1782222039.670728:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081711232 00000100:00100000:3.0:1782222039.670736:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081711360 00000100:00100000:3.0:1782222039.670739:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081711360 00000100:00100000:3.0:1782222039.670757:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081711488 00000100:00100000:3.0:1782222039.670760:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081711488 00000100:00100000:3.0:1782222039.670769:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081711616 00000100:00100000:3.0:1782222039.670771:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081711616 00000100:00100000:3.0:1782222039.670779:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081711744 00000100:00100000:3.0:1782222039.670781:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081711744 00000100:00100000:3.0:1782222039.670788:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081711872 00000100:00100000:3.0:1782222039.670790:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081711872 00000100:00100000:3.0:1782222039.670797:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081712000 00000100:00100000:3.0:1782222039.670800:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081712000 00000100:00100000:3.0:1782222039.670806:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081712128 00000100:00100000:3.0:1782222039.670808:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081712128 00000100:00100000:3.0:1782222039.670818:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782222039.670825:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087701aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+11:10342:x1868795081711104:12345-0@lo:104: 00010000:00010000:3.0:1782222039.670837:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f087fb82800/0xe2b7cc26e68111ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e68111fa expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.670897:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782222039.670903:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087701aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+11:10342:x1868795081711104:12345-0@lo:104: Request processed in 79us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222039.670910:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782222039.670935:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782222039.670942:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074764bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+10:10342:x1868795081711232:12345-0@lo:104: 00010000:00010000:3.0:1782222039.670949:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e68111c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e68111d0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.670980:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782222039.670985:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074764bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+10:10342:x1868795081711232:12345-0@lo:104: Request processed in 44us (1210us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222039.670991:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782222039.671011:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782222039.671017:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747648700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+9:10342:x1868795081711360:12345-0@lo:104: 00010000:00010000:3.0:1782222039.671024:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f0875803e00/0xe2b7cc26e68111ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e68111b4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.671055:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1782222039.671059:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747648700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+9:10342:x1868795081711360:12345-0@lo:104: Request processed in 43us (1232us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222039.671064:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782222039.671074:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782222039.671079:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdfc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+8:10342:x1868795081711488:12345-0@lo:104: 00010000:00010000:3.0:1782222039.671086:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f0875803a00/0xe2b7cc26e6811183 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e681118a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.671119:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1782222039.671124:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdfc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+8:10342:x1868795081711488:12345-0@lo:104: Request processed in 45us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222039.671130:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782222039.671168:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782222039.671173:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+7:10342:x1868795081711616:12345-0@lo:104: 00010000:00010000:3.0:1782222039.671180:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e6811167 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e681116e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.671205:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1782222039.671210:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+7:10342:x1868795081711616:12345-0@lo:104: Request processed in 38us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222039.671214:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782222039.671232:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782222039.671258:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+6:10342:x1868795081711744:12345-0@lo:104: 00010000:00010000:3.0:1782222039.671265:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f087fb82e00/0xe2b7cc26e6811159 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6811160 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.671379:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1782222039.671387:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f087fb82800/0xe2b7cc26e68111ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e68111fa expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.671395:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb82800 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:1.0:1782222039.671398:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f087fb82800/0xe2b7cc26e68111ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e68111fa expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.671407:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f087fb82800/0xe2b7cc26e68111ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e68111fa expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782222039.671414:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f087fb82800/0xe2b7cc26e68111ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e68111fa expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782222039.671420:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782222039.671454:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f087fb82800/0xe2b7cc26e68111ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e68111fa expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.671467:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782222039.671486:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f087fb82800/0xe2b7cc26e68111ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e68111fa expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.671493:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f087fb82800/0xe2b7cc26e68111ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e68111fa expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.671507:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1782222039.671510:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e68111c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e68111d0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.671516:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0875803000 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:1.0:1782222039.671519:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e68111c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e68111d0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.671526:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e68111c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e68111d0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782222039.671533:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e68111c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e68111d0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782222039.671538:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782222039.671550:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e68111c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e68111d0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.671555:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782222039.671560:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e68111c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e68111d0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.671566:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e68111c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e68111d0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.671581:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782222039.671585:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f0875803e00/0xe2b7cc26e68111ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e68111b4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.671590:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0875803e00 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:1.0:1782222039.671593:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f0875803e00/0xe2b7cc26e68111ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e68111b4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.671601:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f0875803e00/0xe2b7cc26e68111ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e68111b4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782222039.671607:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f0875803e00/0xe2b7cc26e68111ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e68111b4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782222039.671612:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782222039.671626:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f0875803e00/0xe2b7cc26e68111ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e68111b4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.671631:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782222039.671646:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f0875803e00/0xe2b7cc26e68111ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e68111b4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.671654:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f0875803e00/0xe2b7cc26e68111ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e68111b4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.671663:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782222039.671666:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f0875803a00/0xe2b7cc26e6811183 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e681118a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.671682:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0875803a00 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:1.0:1782222039.671685:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f0875803a00/0xe2b7cc26e6811183 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e681118a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.671692:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f0875803a00/0xe2b7cc26e6811183 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e681118a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782222039.671698:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f0875803a00/0xe2b7cc26e6811183 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e681118a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782222039.671703:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782222039.671717:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f0875803a00/0xe2b7cc26e6811183 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e681118a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.671722:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782222039.671727:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f0875803a00/0xe2b7cc26e6811183 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e681118a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.671733:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f0875803a00/0xe2b7cc26e6811183 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e681118a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.671741:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782222039.671744:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e6811167 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e681116e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.671749:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0840031a00 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:1.0:1782222039.671752:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e6811167 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e681116e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.671767:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e6811167 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e681116e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782222039.671773:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e6811167 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e681116e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782222039.671778:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782222039.671791:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e6811167 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e681116e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.671797:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782222039.671801:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e6811167 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e681116e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.671808:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e6811167 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e681116e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.671820:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222039.671822:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222039.671823:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222039.671832:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782222039.671852:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087f914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081712256:0@lo:103: 00000100:00100000:1.0:1782222039.671893:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222039.671923:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087f917800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081712768:0@lo:103: 00000100:00100000:1.0:1782222039.671955:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222039.671975:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782222039.671981:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087f915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081712384:0@lo:103: 00000100:00100000:1.0:1782222039.672000:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222039.672034:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087f916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081712512:0@lo:103: 00000100:00100000:1.0:1782222039.672056:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222039.672072:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782222039.672077:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087f915180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081712640:0@lo:103: 00000100:00100000:1.0:1782222039.672096:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222039.672117:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081712256 00000100:00100000:1.0:1782222039.672121:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081712256 00010000:00010000:1.0:1782222039.672153:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0841459200/0xe2b7cc26e68111fa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e68111ec expref: 24 pid: 6519 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222039.672170:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081712768 00000100:00100000:1.0:1782222039.672173:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081712768 00010000:00010000:1.0:1782222039.672184:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0840030600/0xe2b7cc26e681116e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6811167 expref: 25 pid: 6520 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222039.672192:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081712384 00000100:00100000:1.0:1782222039.672194:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081712384 00010000:00010000:1.0:1782222039.672201:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0875803c00/0xe2b7cc26e68111d0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e68111c9 expref: 26 pid: 6520 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222039.672209:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081712512 00000100:00100000:1.0:1782222039.672211:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081712512 00010000:00010000:1.0:1782222039.672218:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0840030e00/0xe2b7cc26e68111b4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e68111ad expref: 27 pid: 6520 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222039.672226:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081712640 00000100:00100000:1.0:1782222039.672228:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081712640 00010000:00010000:1.0:1782222039.672266:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0875803400/0xe2b7cc26e681118a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6811183 expref: 28 pid: 6521 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222039.672294:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1782222039.672301:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08429a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+28:3653:x1868795081712256:12345-0@lo:103: 00010000:00010000:1.0:1782222039.672319:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222039.672325:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0841459200/0xe2b7cc26e68111fa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e68111ec expref: 28 pid: 6519 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.672335:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0841459200/0xe2b7cc26e68111fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e68111ec expref: 28 pid: 6519 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.672351:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782222039.672379:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08429a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+28:3653:x1868795081712256:12345-0@lo:103: Request processed in 80us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222039.672386:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1782222039.672425:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782222039.672431:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f914380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+27:3653:x1868795081712768:12345-0@lo:103: 00010000:00010000:1.0:1782222039.672438:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222039.672442:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0840030600/0xe2b7cc26e681116e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6811167 expref: 27 pid: 6520 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.672450:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0840030600/0xe2b7cc26e681116e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e6811167 expref: 27 pid: 6520 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.672459:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782222039.672479:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f914380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+27:3653:x1868795081712768:12345-0@lo:103: Request processed in 48us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222039.672485:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782222039.672497:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782222039.672503:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f915500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+26:3653:x1868795081712384:12345-0@lo:103: 00010000:00010000:1.0:1782222039.672510:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222039.672515:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0875803c00/0xe2b7cc26e68111d0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e68111c9 expref: 26 pid: 6520 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.672529:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0875803c00/0xe2b7cc26e68111d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e68111c9 expref: 26 pid: 6520 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.672539:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782222039.672562:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f915500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+26:3653:x1868795081712384:12345-0@lo:103: Request processed in 58us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222039.672567:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782222039.672580:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782222039.672586:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f914a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+25:3655:x1868795081712512:12345-0@lo:103: 00010000:00010000:1.0:1782222039.672593:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222039.672597:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0840030e00/0xe2b7cc26e68111b4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e68111ad expref: 25 pid: 6520 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.672605:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0840030e00/0xe2b7cc26e68111b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e68111ad expref: 25 pid: 6520 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.672614:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782222039.672639:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f914a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+25:3655:x1868795081712512:12345-0@lo:103: Request processed in 53us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222039.672644:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782222039.672655:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782222039.672661:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f914e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3655:x1868795081712640:12345-0@lo:103: 00010000:00010000:1.0:1782222039.672668:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222039.672672:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0875803400/0xe2b7cc26e681118a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6811183 expref: 24 pid: 6521 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.672678:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0875803400/0xe2b7cc26e681118a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e6811183 expref: 24 pid: 6521 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.672693:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782222039.672714:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f914e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3655:x1868795081712640:12345-0@lo:103: Request processed in 53us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222039.672720:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782222039.672781:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087f915180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081712640:0@lo:103: 00000100:00100000:1.0:1782222039.672791:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087f916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081712512:0@lo:103: 00000100:00100000:1.0:1782222039.672815:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087f915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081712384:0@lo:103: 00000100:00100000:1.0:1782222039.672822:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087f914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081712256:0@lo:103: 00000100:00100000:1.0:1782222039.672829:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087f917800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081712768:0@lo:103: 00010000:00010000:2.0:1782222039.673742:0:10342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0841459200/0xe2b7cc26e68111fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e68111ec expref: 23 pid: 6519 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222039.673758:0:10342:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877019f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1868795081711104:0@lo:104: 00010000:00010000:2.0:1782222039.673768:0:10342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0875803c00/0xe2b7cc26e68111d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e68111c9 expref: 22 pid: 6520 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222039.673777:0:10342:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747649f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1868795081711232:0@lo:104: 00010000:00010000:2.0:1782222039.673787:0:10342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0840030e00/0xe2b7cc26e68111b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e68111ad expref: 21 pid: 6520 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222039.673796:0:10342:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747648a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1868795081711360:0@lo:104: 00010000:00010000:2.0:1782222039.673805:0:10342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0875803400/0xe2b7cc26e681118a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e6811183 expref: 20 pid: 6521 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222039.673812:0:10342:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747648000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1868795081711488:0@lo:104: 00010000:00010000:2.0:1782222039.673821:0:10342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0840030600/0xe2b7cc26e681116e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e6811167 expref: 19 pid: 6520 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222039.673829:0:10342:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747649c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1868795081711616:0@lo:104: 00010000:00010000:3.0:1782222039.673964:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782222039.673972:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+6:10342:x1868795081711744:12345-0@lo:104: Request processed in 2714us (3377us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222039.674472:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782222039.674499:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782222039.674508:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+5:10342:x1868795081711872:12345-0@lo:104: 00010000:00010000:3.0:1782222039.674521:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e681114b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6811152 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.674559:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782222039.674564:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+5:10342:x1868795081711872:12345-0@lo:104: Request processed in 59us (3962us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222039.674570:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782222039.674584:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782222039.674590:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+4:10342:x1868795081712000:12345-0@lo:104: 00010000:00010000:3.0:1782222039.674598:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f0875803200/0xe2b7cc26e681110c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6811113 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.674623:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1782222039.674628:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+4:10342:x1868795081712000:12345-0@lo:104: Request processed in 39us (4019us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222039.674634:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782222039.674658:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782222039.674664:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+3:10342:x1868795081712128:12345-0@lo:104: 00010000:00010000:3.0:1782222039.674672:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f0840031600/0xe2b7cc26e68110e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e68110e9 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.674698:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1782222039.674703:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+3:10342:x1868795081712128:12345-0@lo:104: Request processed in 39us (4085us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222039.674708:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1782222039.674727:0:7468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1782222039.674733:0:7468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f087fb82e00/0xe2b7cc26e6811159 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6811160 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.674740:0:7468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb82e00 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:3.0:1782222039.674744:0:7468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f087fb82e00/0xe2b7cc26e6811159 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e6811160 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.674751:0:7468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f087fb82e00/0xe2b7cc26e6811159 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e6811160 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782222039.674757:0:7468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f087fb82e00/0xe2b7cc26e6811159 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e6811160 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782222039.674762:0:7468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782222039.674795:0:7468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f087fb82e00/0xe2b7cc26e6811159 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811160 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.674800:0:7468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782222039.674817:0:7468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f087fb82e00/0xe2b7cc26e6811159 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811160 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.674835:0:7468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f087fb82e00/0xe2b7cc26e6811159 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811160 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.674846:0:7468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1782222039.674849:0:7468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e681114b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6811152 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.674856:0:7468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0840030c00 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:3.0:1782222039.674859:0:7468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e681114b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e6811152 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.674866:0:7468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e681114b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e6811152 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782222039.674872:0:7468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e681114b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e6811152 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782222039.674877:0:7468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782222039.674892:0:7468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e681114b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811152 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.674899:0:7468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782222039.674913:0:7468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e681114b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811152 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.674920:0:7468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e681114b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811152 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.674940:0:7468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782222039.674949:0:7468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f0875803200/0xe2b7cc26e681110c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6811113 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.674955:0:7468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0875803200 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:3.0:1782222039.674958:0:7468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f0875803200/0xe2b7cc26e681110c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e6811113 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.674964:0:7468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f0875803200/0xe2b7cc26e681110c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e6811113 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782222039.674969:0:7468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f0875803200/0xe2b7cc26e681110c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e6811113 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782222039.674974:0:7468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782222039.674988:0:7468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f0875803200/0xe2b7cc26e681110c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811113 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.674993:0:7468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782222039.674998:0:7468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f0875803200/0xe2b7cc26e681110c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811113 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.675006:0:7468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f0875803200/0xe2b7cc26e681110c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811113 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.675015:0:7468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782222039.675017:0:7468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f0840031600/0xe2b7cc26e68110e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e68110e9 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.675023:0:7468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0840031600 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:3.0:1782222039.675026:0:7468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f0840031600/0xe2b7cc26e68110e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e68110e9 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.675042:0:7468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f0840031600/0xe2b7cc26e68110e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e68110e9 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782222039.675048:0:7468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f0840031600/0xe2b7cc26e68110e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e68110e9 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782222039.675053:0:7468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782222039.675067:0:7468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f0840031600/0xe2b7cc26e68110e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e68110e9 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.675073:0:7468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782222039.675078:0:7468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f0840031600/0xe2b7cc26e68110e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e68110e9 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.675084:0:7468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f0840031600/0xe2b7cc26e68110e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e68110e9 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.675098:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222039.675100:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222039.675102:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222039.675173:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081713152:0@lo:103: 00000100:00100000:3.0:1782222039.675207:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222039.675263:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782222039.675269:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081713024:0@lo:103: 00000100:00100000:2.0:1782222039.675558:0:10342:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087719a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1868795081710848:192.168.203.27@tcp:104: 00000100:00100000:2.0:1782222039.675568:0:10342:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087701b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1868795081710976:192.168.203.27@tcp:104: 00000100:00100000:2.0:1782222039.675584:0:10342:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074764aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1868795081711744:0@lo:104: 00000100:00100000:2.0:1782222039.675591:0:10342:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747649180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1868795081711872:0@lo:104: 00000100:00100000:2.0:1782222039.675598:0:10342:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074764b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1868795081712000:0@lo:104: 00000100:00100000:2.0:1782222039.675605:0:10342:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747648380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10342:1868795081712128:0@lo:104: 00010000:00010000:2.0:1782222039.675644:0:10342:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f087fb82a00/0xe2b7cc26e681124e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222039.676373:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3654:1868795081712896:0@lo:103: 00000100:00100000:0.0:1782222039.676412:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222039.676447:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782222039.676452:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3654:1868795081713280:0@lo:103: 00000100:00100000:0.0:1782222039.676471:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782222039.676494:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782222039.676888:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081713152 00000100:00100000:1.0:1782222039.676894:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081713152 00010000:00010000:1.0:1782222039.676924:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0840030200/0xe2b7cc26e6811113 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e681110c expref: 19 pid: 6521 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222039.676957:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081712896 00000100:00100000:1.0:1782222039.676960:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081712896 00010000:00010000:1.0:1782222039.676972:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f087fb82600/0xe2b7cc26e6811160 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6811159 expref: 20 pid: 6519 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222039.676982:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081713280 00000100:00100000:1.0:1782222039.676984:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081713280 00010000:00010000:1.0:1782222039.676993:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0875802a00/0xe2b7cc26e68110e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e68110e2 expref: 21 pid: 6521 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222039.677004:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782222039.677010:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877154e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:3656:x1868795081713152:12345-0@lo:103: 00010000:00010000:1.0:1782222039.677033:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222039.677039:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0840030200/0xe2b7cc26e6811113 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e681110c expref: 21 pid: 6521 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.677050:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0840030200/0xe2b7cc26e6811113 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e681110c expref: 21 pid: 6521 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.677066:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0840030200/0xe2b7cc26e6811113 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e681110c expref: 21 pid: 6521 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.677080:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782222039.677115:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877154e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:3656:x1868795081713152:12345-0@lo:103: Request processed in 104us (1907us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222039.677122:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782222039.677140:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782222039.677145:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747297480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+19:3654:x1868795081712896:12345-0@lo:103: 00010000:00010000:1.0:1782222039.677163:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222039.677168:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f087fb82600/0xe2b7cc26e6811160 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6811159 expref: 19 pid: 6519 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.677176:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f087fb82600/0xe2b7cc26e6811160 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e6811159 expref: 19 pid: 6519 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.677186:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f087fb82600/0xe2b7cc26e6811160 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e6811159 expref: 19 pid: 6519 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.677194:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782222039.677220:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747297480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:3654:x1868795081712896:12345-0@lo:103: Request processed in 75us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222039.677254:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782222039.677267:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782222039.677394:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08429ab050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:3654:x1868795081713280:12345-0@lo:103: 00010000:00010000:1.0:1782222039.677404:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222039.677409:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0875802a00/0xe2b7cc26e68110e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e68110e2 expref: 17 pid: 6521 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.677631:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0875802a00/0xe2b7cc26e68110e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e68110e2 expref: 17 pid: 6521 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.677641:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0875802a00/0xe2b7cc26e68110e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e68110e2 expref: 17 pid: 6521 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.677650:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782222039.677674:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08429ab050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:3654:x1868795081713280:12345-0@lo:103: Request processed in 401us (1202us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222039.677679:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782222039.677755:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3654:1868795081713280:0@lo:103: 00000100:00100000:1.0:1782222039.677765:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3654:1868795081712896:0@lo:103: 00010000:00010000:1.0:1782222039.677786:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222039.691733:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222039.691801:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081713152:0@lo:103: 00000100:00100000:1.0:1782222039.693770:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222039.693848:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222039.693875:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081713024 00000100:00100000:1.0:1782222039.693884:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081713024 00010000:00010000:1.0:1782222039.693919:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e6811152 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e681114b expref: 16 pid: 6521 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222039.693957:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060688256 00000100:00100000:1.0:1782222039.693973:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060688256 00010000:00010000:1.0:1782222039.693988:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0840030000/0xe2b7cc26e681120f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75582c9 expref: 10 pid: 6521 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222039.694000:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060688384 00000100:00100000:1.0:1782222039.694002:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060688384 00010000:00010000:1.0:1782222039.694011:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0841458400/0xe2b7cc26e6811208 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75582c2 expref: 11 pid: 6519 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222039.694024:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782222039.694032:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877155880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:3656:x1868795081713024:12345-0@lo:103: 00010000:00010000:1.0:1782222039.694044:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222039.694050:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e6811152 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e681114b expref: 16 pid: 6521 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.694060:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e6811152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e681114b expref: 16 pid: 6521 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.694077:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e6811152 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e681114b expref: 16 pid: 6521 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.694089:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782222039.694132:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877155880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:3656:x1868795081713024:12345-0@lo:103: Request processed in 101us (2407us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222039.694139:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782222039.694168:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 33 00000100:00100000:1.0:1782222039.694174:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f914380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2ca5b6e-1b2d-4770-b014-03af882e6158+11:2389:x1868795060688256:12345-192.168.203.27@tcp:103: 00010000:00010000:1.0:1782222039.694182:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222039.694186:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0840030000/0xe2b7cc26e681120f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75582c9 expref: 11 pid: 6521 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.694203:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0840030000/0xe2b7cc26e681120f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75582c9 expref: 11 pid: 6521 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.694213:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0840030000/0xe2b7cc26e681120f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75582c9 expref: 11 pid: 6521 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222039.694222:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782222039.694469:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 34 00000100:00100000:3.0:1782222039.694478:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f915500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:2389:x1868795060688384:12345-192.168.203.27@tcp:103: 00010000:00010000:3.0:1782222039.694495:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222039.694500:0:9532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0841458400/0xe2b7cc26e6811208 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75582c2 expref: 10 pid: 6519 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.694509:0:9532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0841458400/0xe2b7cc26e6811208 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75582c2 expref: 10 pid: 6519 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.694519:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0841458400/0xe2b7cc26e6811208 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75582c2 expref: 10 pid: 6519 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.694530:0:9532:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f087fb82a00/0xe2b7cc26e681124e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.694539:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fb82a00/0xe2b7cc26e681124e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.694554:0:9532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f087fb82a00/0xe2b7cc26e681124e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.694562:0:9532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f087fb82a00/0xe2b7cc26e681124e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.694569:0:9532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f087fb82a00/0xe2b7cc26e681124e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.694576:0:9532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f087fb82a00/0xe2b7cc26e681124e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.694583:0:9532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb82a00 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:3.0:1782222039.694587:0:9532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f087fb82a00/0xe2b7cc26e681124e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.694605:0:9532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f087fb82a00/0xe2b7cc26e681124e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.694618:0:9532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f087fb82a00/0xe2b7cc26e681124e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222039.694630:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782222039.694675:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f914380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2ca5b6e-1b2d-4770-b014-03af882e6158+9:2389:x1868795060688256:12345-192.168.203.27@tcp:103: Request processed in 499us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222039.694682:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 33 00010000:00010000:2.0:1782222039.695045:0:10342:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f087fb82a00/0xe2b7cc26e681124e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222039.695056:0:10342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f087fb82a00/0xe2b7cc26e681124e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222039.695062:0:10342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f087fb82a00/0xe2b7cc26e681124e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222039.701422:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f915500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2ca5b6e-1b2d-4770-b014-03af882e6158+8:2389:x1868795060688384:12345-192.168.203.27@tcp:103: Request processed in 6935us (7563us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222039.701438:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 34 00000100:00100000:1.0:1782222039.705771:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081713024:0@lo:103: 00010000:00010000:3.0:1782222040.618953:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782222041.258455:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782222041.258462:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8f08815e6800 from 48 10000000:01000000:1.0:1782222041.258468:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782222041.258517:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875803e00/0xe2b7cc26e6811255 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222041.258529:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f0875803e00/0xe2b7cc26e6811255 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222041.258539:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0875803e00/0xe2b7cc26e6811255 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222041.258563:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087f914a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081713408:0@lo:101: 00000100:00100000:1.0:1782222041.258631:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222041.258683:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074725d000 going to sleep for 11 seconds 00000100:00100000:2.0:1782222041.258893:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081713408 00000100:00100000:2.0:1782222041.258900:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081713408 00000100:00100000:2.0:1782222041.258966:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1782222041.258977:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+15:6523:x1868795081713408:12345-0@lo:101: 00010000:00010000:2.0:1782222041.258991:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222041.259005:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f087fb83400/0xe2b7cc26e681125c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6811255 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222041.259029:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fb83400/0xe2b7cc26e681125c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6811255 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222041.259040:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f087fb83400/0xe2b7cc26e681125c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6811255 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222041.259065:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb83400, rc 0) 00000100:00100000:2.0:1782222041.259115:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:6523:x1868795081713408:12345-0@lo:101: Request processed in 140us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222041.259124:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1782222041.259160:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087f914a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081713408:0@lo:101: 00010000:00010000:1.0:1782222041.259186:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0875803e00/0xe2b7cc26e6811255 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681125c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222041.259194:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0875803e00/0xe2b7cc26e6811255 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e681125c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222041.259276:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087f914a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081713536:0@lo:501: 00000100:00100000:1.0:1782222041.259302:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222041.259329:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074725d000 going to sleep for 11 seconds 00000100:00100000:3.0:1782222041.259460:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081713536 00000100:00100000:3.0:1782222041.259465:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081713536 00000100:00100000:3.0:1782222041.259498:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1782222041.259507:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:6523:x1868795081713536:12345-0@lo:501: 00000100:00100000:3.0:1782222041.259638:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:6523:x1868795081713536:12345-0@lo:501: Request processed in 132us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222041.259645:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1782222041.259724:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087f914a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081713536:0@lo:501: 00000100:00100000:0.0:1782222041.259757:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747297100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081713664:0@lo:503: 00000100:00100000:0.0:1782222041.259798:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222041.259819:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f07464063c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782222041.259861:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081713664 00000100:00100000:2.0:1782222041.259865:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081713664 00000100:00100000:2.0:1782222041.259895:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1782222041.259903:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:6523:x1868795081713664:12345-0@lo:503: 00000100:00100000:2.0:1782222041.259999:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:6523:x1868795081713664:12345-0@lo:503: Request processed in 97us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222041.260005:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1782222041.260098:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747297100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081713664:0@lo:503: 00000100:00100000:0.0:1782222041.260493:0:10360:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747297100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10360:1868795081713792:0@lo:502: 00000100:00100000:0.0:1782222041.260528:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222041.260555:0:10360:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746406840 going to sleep for 11 seconds 00000100:00100000:1.0:1782222041.260602:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081713792 00000100:00100000:1.0:1782222041.260606:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081713792 00000100:00100000:1.0:1782222041.260638:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1782222041.260645:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:10360:x1868795081713792:12345-0@lo:502: 00000100:00100000:1.0:1782222041.260738:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:10360:x1868795081713792:12345-0@lo:502: Request processed in 92us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222041.260745:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1782222041.260855:0:10360:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747297100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10360:1868795081713792:0@lo:502: 00000100:00100000:0.0:1782222041.260896:0:10360:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747297100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10360:1868795081713920:0@lo:502: 00000100:00100000:0.0:1782222041.260939:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222041.260959:0:10360:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746406840 going to sleep for 11 seconds 00000100:00100000:2.0:1782222041.261027:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081713920 00000100:00100000:2.0:1782222041.261031:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081713920 00000100:00100000:2.0:1782222041.261059:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1782222041.261066:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:10360:x1868795081713920:12345-0@lo:502: 00000100:00100000:2.0:1782222041.261134:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+16:10360:x1868795081713920:12345-0@lo:502: Request processed in 68us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222041.261264:0:10360:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747297100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10360:1868795081713920:0@lo:502: 00000040:00080000:0.0:1782222041.261286:0:10360:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1782222041.261609:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1782222041.261630:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782222041.261639:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875803e00/0xe2b7cc26e6811255 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681125c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222041.261650:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f0875803e00/0xe2b7cc26e6811255 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681125c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782222041.261658:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1782222041.261660:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1782222041.261663:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1782222041.261685:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e6811263 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222041.261701:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e6811263 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222041.261711:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e6811263 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222041.261724:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087f914e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081714048:0@lo:101: 00000100:00100000:1.0:1782222041.261755:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222041.261782:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074725de40 going to sleep for 11 seconds 00000100:00100000:3.0:1782222041.261841:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081714048 00000100:00100000:3.0:1782222041.261845:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081714048 00000100:00100000:3.0:1782222041.261878:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1782222041.261886:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:6523:x1868795081714048:12345-0@lo:101: 00010000:00010000:3.0:1782222041.261894:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222041.261905:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0841458400/0xe2b7cc26e681126a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6811263 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222041.261933:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0841458400/0xe2b7cc26e681126a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6811263 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222041.261952:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0841458400/0xe2b7cc26e681126a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6811263 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222041.261959:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0841458400, rc 0) 00000100:00100000:3.0:1782222041.262002:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:6523:x1868795081714048:12345-0@lo:101: Request processed in 116us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222041.262008:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1782222041.262090:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1782222041.262296:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087f914e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081714048:0@lo:101: 00010000:00010000:0.0:1782222041.262312:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e6811263 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681126a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222041.262326:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e6811263 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e681126a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222041.262376:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747297100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081714176:0@lo:501: 00000100:00100000:0.0:1782222041.262402:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222041.262428:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746406840 going to sleep for 11 seconds 00000100:00100000:3.0:1782222041.262473:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081714176 00000100:00100000:3.0:1782222041.262477:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081714176 00000100:00100000:3.0:1782222041.262507:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1782222041.262514:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:6523:x1868795081714176:12345-0@lo:501: 00000100:00100000:3.0:1782222041.262619:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:6523:x1868795081714176:12345-0@lo:501: Request processed in 105us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222041.262625:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1782222041.262726:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747297100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081714176:0@lo:501: 00000100:00100000:0.0:1782222041.262757:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747297100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081714304:0@lo:503: 00000100:00100000:0.0:1782222041.262792:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222041.262817:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746406840 going to sleep for 11 seconds 00000100:00100000:2.0:1782222041.262862:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081714304 00000100:00100000:2.0:1782222041.262866:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081714304 00000100:00100000:2.0:1782222041.262897:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1782222041.262904:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:6523:x1868795081714304:12345-0@lo:503: 00000100:00100000:2.0:1782222041.262992:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:6523:x1868795081714304:12345-0@lo:503: Request processed in 88us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222041.262998:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1782222041.263449:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747297100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081714304:0@lo:503: 00000100:00100000:1.0:1782222041.267391:0:10361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087f917800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10361:1868795081714432:0@lo:502: 00000100:00100000:1.0:1782222041.267479:0:10361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222041.267520:0:10361:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074725d180 going to sleep for 11 seconds 00000100:00100000:2.0:1782222041.267716:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081714432 00000100:00100000:2.0:1782222041.267724:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081714432 00000100:00100000:2.0:1782222041.267780:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1782222041.267789:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:10361:x1868795081714432:12345-0@lo:502: 00000100:00100000:2.0:1782222041.267903:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:10361:x1868795081714432:12345-0@lo:502: Request processed in 114us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222041.267910:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1782222041.270527:0:10361:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087f917800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10361:1868795081714432:0@lo:502: 00000020:01000000:1.0:1782222041.270579:0:10361:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782222041.270590:0:10361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222041.270592:0:10361:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1782222041.270597:0:10361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1782222041.270635:0:10361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087f917800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10361:1868795081714560:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782222041.270717:0:10361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222041.270765:0:10361:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074725d180 going to sleep for 11 seconds 00000100:00100000:2.0:1782222041.276319:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081714560 00000100:00100000:2.0:1782222041.276334:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081714560 00000100:00100000:2.0:1782222041.276416:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1782222041.276426:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:10361:x1868795081714560:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782222041.276591:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:10361:x1868795081714560:12345-0@lo:502:llog_process_th.0 Request processed in 165us (5872us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222041.276599:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1782222041.276886:0:10361:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087f917800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10361:1868795081714560:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782222041.276933:0:10361:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782222041.276941:0:10361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782222041.276943:0:10361:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1782222041.276947:0:10361:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:1.0:1782222041.277350:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1782222041.277386:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1782222041.277397:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e6811263 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681126a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222041.277409:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e6811263 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681126a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782222041.277431:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782222041.277434:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8f087fb98800 from 48 10000000:01000000:1.0:1782222041.277437:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782222041.277468:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875802000/0xe2b7cc26e6811271 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222041.277476:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f0875802000/0xe2b7cc26e6811271 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222041.277485:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0875802000/0xe2b7cc26e6811271 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222041.277507:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087f914000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081714688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782222041.277546:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222041.277578:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074725d000 going to sleep for 11 seconds 00000100:00100000:3.0:1782222041.278072:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081714688 00000100:00100000:3.0:1782222041.278079:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081714688 00000100:00100000:3.0:1782222041.278115:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1782222041.278123:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+17:6523:x1868795081714688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782222041.278135:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222041.278158:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0841459c00/0xe2b7cc26e6811278 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6811271 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222041.278195:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0841459c00/0xe2b7cc26e6811278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6811271 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222041.278205:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0841459c00/0xe2b7cc26e6811278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6811271 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222041.278214:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0841459c00, rc 0) 00000100:00100000:3.0:1782222041.278271:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:6523:x1868795081714688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222041.278278:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1782222041.282222:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087f914000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081714688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782222041.282285:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0875802000/0xe2b7cc26e6811271 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811278 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222041.282299:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0875802000/0xe2b7cc26e6811271 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6811278 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222041.282399:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087f914000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081714816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782222041.282450:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222041.282492:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074725d000 going to sleep for 11 seconds 00000100:00100000:3.0:1782222041.283112:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081714816 00000100:00100000:3.0:1782222041.283119:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081714816 00000100:00100000:3.0:1782222041.283178:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1782222041.283187:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:6523:x1868795081714816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782222041.283358:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:6523:x1868795081714816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 171us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222041.283377:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1782222041.285359:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087f914000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081714816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782222041.285433:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087f914000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081714944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782222041.285505:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222041.285550:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074725d000 going to sleep for 11 seconds 00000100:00100000:2.0:1782222041.285683:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081714944 00000100:00100000:2.0:1782222041.285691:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081714944 00000100:00100000:2.0:1782222041.285735:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1782222041.285744:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:6523:x1868795081714944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782222041.285852:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:6523:x1868795081714944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222041.285870:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1782222041.288291:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087f914000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081714944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782222041.289027:0:10362:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087f914000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10362:1868795081715072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782222041.289085:0:10362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222041.289128:0:10362:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074725d840 going to sleep for 11 seconds 00000100:00100000:2.0:1782222041.289181:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081715072 00000100:00100000:2.0:1782222041.289187:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081715072 00000100:00100000:2.0:1782222041.289257:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1782222041.289266:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:10362:x1868795081715072:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782222041.289377:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:10362:x1868795081715072:12345-0@lo:502:llog_process_th.0 Request processed in 111us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222041.289391:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1782222041.289472:0:10362:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087f914000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10362:1868795081715072:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782222041.289508:0:10362:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877154380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10362:1868795081715200:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782222041.289536:0:10362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222041.289557:0:10362:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746444180 going to sleep for 11 seconds 00000100:00100000:2.0:1782222041.289676:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081715200 00000100:00100000:2.0:1782222041.289680:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081715200 00000100:00100000:2.0:1782222041.289708:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1782222041.289715:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:10362:x1868795081715200:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782222041.289830:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:10362:x1868795081715200:12345-0@lo:502:llog_process_th.0 Request processed in 115us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222041.289837:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1782222041.301048:0:10362:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877154380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10362:1868795081715200:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1782222041.301117:0:10362:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1782222041.301316:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1782222041.301339:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782222041.301350:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875802000/0xe2b7cc26e6811271 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811278 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222041.301360:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f0875802000/0xe2b7cc26e6811271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811278 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782222041.301369:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1782222041.301372:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1782222041.301375:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1782222041.301413:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb83a00/0xe2b7cc26e681127f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222041.301421:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f087fb83a00/0xe2b7cc26e681127f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222041.301429:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f087fb83a00/0xe2b7cc26e681127f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222041.301449:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747648380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081715328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782222041.301519:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222041.301562:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087fb75480 going to sleep for 11 seconds 00000100:00100000:3.0:1782222041.301612:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081715328 00000100:00100000:3.0:1782222041.301619:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081715328 00000100:00100000:3.0:1782222041.301666:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1782222041.301676:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+18:6523:x1868795081715328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782222041.301698:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222041.301710:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0841459600/0xe2b7cc26e6811286 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e681127f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222041.301734:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0841459600/0xe2b7cc26e6811286 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e681127f expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222041.301743:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0841459600/0xe2b7cc26e6811286 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e681127f expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222041.301752:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0841459600, rc 0) 00000100:00100000:3.0:1782222041.301792:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+19:6523:x1868795081715328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222041.301798:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1782222041.302013:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747648380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081715328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782222041.302026:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f087fb83a00/0xe2b7cc26e681127f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811286 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222041.302035:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f087fb83a00/0xe2b7cc26e681127f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6811286 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222041.302088:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087f915c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081715456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782222041.302115:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222041.302148:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074725d900 going to sleep for 11 seconds 00000100:00100000:3.0:1782222041.302195:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081715456 00000100:00100000:3.0:1782222041.302199:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081715456 00000100:00100000:3.0:1782222041.302259:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1782222041.302266:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+19:6523:x1868795081715456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782222041.302377:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+19:6523:x1868795081715456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222041.302385:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1782222041.302729:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087f915c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081715456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782222041.302759:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087f915c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081715584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782222041.302798:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222041.302826:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074725d900 going to sleep for 11 seconds 00000100:00100000:3.0:1782222041.302868:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081715584 00000100:00100000:3.0:1782222041.302872:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081715584 00000100:00100000:3.0:1782222041.302902:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1782222041.302909:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+19:6523:x1868795081715584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782222041.303005:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+19:6523:x1868795081715584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222041.303022:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1782222041.303131:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087f915c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081715584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782222041.304404:0:10363:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087f915c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10363:1868795081715712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782222041.304459:0:10363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222041.304491:0:10363:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074725d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782222041.304561:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081715712 00000100:00100000:3.0:1782222041.304566:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081715712 00000100:00100000:3.0:1782222041.304598:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1782222041.304606:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+19:10363:x1868795081715712:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782222041.304714:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+19:10363:x1868795081715712:12345-0@lo:502:llog_process_th.0 Request processed in 107us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222041.304721:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1782222041.305038:0:10363:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087f915c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10363:1868795081715712:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782222041.305065:0:10363:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782222041.305075:0:10363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782222041.305077:0:10363:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1782222041.305082:0:10363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1782222041.305105:0:10363:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074764b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10363:1868795081715840:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782222041.305152:0:10363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222041.305174:0:10363:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087fb75780 going to sleep for 11 seconds 00000100:00100000:3.0:1782222041.305531:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081715840 00000100:00100000:3.0:1782222041.305536:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081715840 00000100:00100000:3.0:1782222041.305565:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1782222041.305571:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+19:10363:x1868795081715840:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782222041.305661:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+19:10363:x1868795081715840:12345-0@lo:502:llog_process_th.0 Request processed in 89us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222041.305669:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1782222041.305777:0:10363:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074764b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10363:1868795081715840:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782222041.305801:0:10363:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782222041.305806:0:10363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782222041.305807:0:10363:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1782222041.305811:0:10363:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:1.0:1782222041.305969:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1782222041.305990:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1782222041.305999:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb83a00/0xe2b7cc26e681127f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811286 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222041.306010:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f087fb83a00/0xe2b7cc26e681127f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811286 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782222041.306019:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782222041.306021:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8f0849b46800 from 48 10000000:01000000:1.0:1782222041.306024:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782222041.306048:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875802200/0xe2b7cc26e681128d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222041.306057:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f0875802200/0xe2b7cc26e681128d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222041.306065:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0875802200/0xe2b7cc26e681128d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222041.306081:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087f916a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081715968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782222041.306112:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222041.306151:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074725d480 going to sleep for 11 seconds 00000100:00100000:3.0:1782222041.306849:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081715968 00000100:00100000:3.0:1782222041.306856:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081715968 00000100:00100000:3.0:1782222041.307408:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1782222041.307419:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+19:6523:x1868795081715968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782222041.307433:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222041.307449:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0841459200/0xe2b7cc26e6811294 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e681128d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222041.307473:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0841459200/0xe2b7cc26e6811294 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e681128d expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222041.307484:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0841459200/0xe2b7cc26e6811294 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e681128d expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222041.307504:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0841459200, rc 0) 00000100:00100000:3.0:1782222041.307560:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:6523:x1868795081715968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (1446us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222041.307567:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1782222041.307643:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087f916a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081715968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782222041.307660:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0875802200/0xe2b7cc26e681128d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811294 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222041.307670:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0875802200/0xe2b7cc26e681128d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6811294 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222041.307747:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087f916a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081716096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782222041.307780:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222041.316959:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074725d480 going to sleep for 11 seconds 00000100:00100000:0.0:1782222041.317741:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081716096 00000100:00100000:0.0:1782222041.317752:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081716096 00000100:00100000:1.0:1782222041.321969:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1782222041.321984:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:6523:x1868795081716096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782222041.322178:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:6523:x1868795081716096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 191us (14392us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222041.322186:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1782222041.322271:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087f916a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081716096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782222041.322321:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087f916a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081716224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782222041.322371:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222041.322399:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074725d480 going to sleep for 11 seconds 00000100:00100000:1.0:1782222041.322412:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081716224 00000100:00100000:1.0:1782222041.322418:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081716224 00000100:00100000:1.0:1782222041.322438:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1782222041.322443:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:6523:x1868795081716224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782222041.322516:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:6523:x1868795081716224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222041.322522:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1782222041.322560:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087f916a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081716224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782222041.323640:0:10364:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087f916a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10364:1868795081716352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782222041.323685:0:10364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222041.323726:0:10364:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074725d540 going to sleep for 11 seconds 00000100:00100000:0.0:1782222041.323773:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081716352 00000100:00100000:0.0:1782222041.323780:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081716352 00000100:00100000:0.0:1782222041.323806:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1782222041.323813:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0850982850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:10364:x1868795081716352:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782222041.323930:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0850982850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:10364:x1868795081716352:12345-0@lo:502:llog_process_th.0 Request processed in 116us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222041.323937:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1782222041.324708:0:10364:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087f916a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10364:1868795081716352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782222041.324765:0:10364:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087f916a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10364:1868795081716480:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782222041.324804:0:10364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222041.324836:0:10364:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074725d540 going to sleep for 11 seconds 00000100:00100000:0.0:1782222041.324886:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081716480 00000100:00100000:0.0:1782222041.324891:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081716480 00000100:00100000:0.0:1782222041.324931:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1782222041.324938:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:10364:x1868795081716480:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782222041.325023:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:10364:x1868795081716480:12345-0@lo:502:llog_process_th.0 Request processed in 85us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222041.325030:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1782222041.328301:0:10364:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087f916a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10364:1868795081716480:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1782222041.328353:0:10364:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1782222041.328543:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1782222041.328568:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782222041.328579:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875802200/0xe2b7cc26e681128d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811294 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222041.328590:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f0875802200/0xe2b7cc26e681128d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811294 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782222041.328600:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1782222041.328602:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:0.0:1782222041.328605:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1782222041.328644:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0840030000/0xe2b7cc26e681129b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222041.328652:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f0840030000/0xe2b7cc26e681129b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222041.328660:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0840030000/0xe2b7cc26e681129b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222041.328680:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747297100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081716608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782222041.328737:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222041.328769:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f07464060c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782222041.329678:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081716608 00000100:00100000:1.0:1782222041.329688:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081716608 00000100:00100000:1.0:1782222041.329730:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1782222041.329739:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0850980c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:6523:x1868795081716608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782222041.329753:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222041.329768:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0875802a00/0xe2b7cc26e68112a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e681129b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222041.329792:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0875802a00/0xe2b7cc26e68112a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e681129b expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222041.329803:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0875802a00/0xe2b7cc26e68112a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e681129b expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222041.329812:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0875802a00, rc 0) 00000100:00100000:1.0:1782222041.329870:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0850980c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:6523:x1868795081716608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (1132us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222041.329877:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1782222041.329960:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747297100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081716608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782222041.329991:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0840030000/0xe2b7cc26e681129b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68112a2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222041.330000:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0840030000/0xe2b7cc26e681129b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e68112a2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222041.330067:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747297100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081716736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782222041.330095:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222041.330125:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f07464060c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782222041.330359:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081716736 00000100:00100000:1.0:1782222041.330364:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081716736 00000100:00100000:1.0:1782222041.330391:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1782222041.330397:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0850981450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:6523:x1868795081716736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782222041.330515:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0850981450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:6523:x1868795081716736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222041.330522:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1782222041.330582:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747297100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081716736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782222041.330612:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747297100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081716864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782222041.330650:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222041.330675:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f07464060c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782222041.332410:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081716864 00000100:00100000:1.0:1782222041.332421:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081716864 00000100:00100000:1.0:1782222041.332467:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1782222041.332475:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:6523:x1868795081716864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782222041.332631:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:6523:x1868795081716864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (1979us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222041.332641:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1782222041.332741:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747297100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081716864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782222041.335431:0:10365:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747297100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10365:1868795081716992:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782222041.335507:0:10365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222041.335551:0:10365:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746406e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782222041.335737:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081716992 00000100:00100000:1.0:1782222041.335744:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081716992 00000100:00100000:1.0:1782222041.335781:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1782222041.335788:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0850980850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:10365:x1868795081716992:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782222041.335908:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0850980850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:10365:x1868795081716992:12345-0@lo:502:llog_process_th.0 Request processed in 119us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222041.335925:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1782222041.336006:0:10365:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747297100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10365:1868795081716992:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782222041.336044:0:10365:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782222041.336052:0:10365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782222041.336055:0:10365:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1782222041.336061:0:10365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1782222041.336082:0:10365:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747297100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10365:1868795081717120:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782222041.336114:0:10365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222041.336133:0:10365:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746406e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782222041.336349:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081717120 00000100:00100000:3.0:1782222041.336354:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081717120 00000100:00100000:3.0:1782222041.336375:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1782222041.336381:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0850980050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:10365:x1868795081717120:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782222041.336466:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0850980050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:10365:x1868795081717120:12345-0@lo:502:llog_process_th.0 Request processed in 84us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222041.336474:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1782222041.336545:0:10365:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747297100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10365:1868795081717120:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782222041.336567:0:10365:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782222041.336571:0:10365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782222041.336573:0:10365:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1782222041.336577:0:10365:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:3.0:1782222041.336764:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:3.0:1782222041.336785:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1782222041.336794:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0840030000/0xe2b7cc26e681129b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68112a2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222041.336805:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f0840030000/0xe2b7cc26e681129b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68112a2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782222041.336814:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782222041.336817:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8f08490d0000 from 48 10000000:01000000:3.0:1782222041.336819:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782222041.336844:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0841459400/0xe2b7cc26e68112a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222041.336851:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f0841459400/0xe2b7cc26e68112a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222041.336872:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0841459400/0xe2b7cc26e68112a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222041.336886:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877157b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081717248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782222041.336926:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222041.336953:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f07464443c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782222041.336999:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081717248 00000100:00100000:1.0:1782222041.337004:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081717248 00000100:00100000:1.0:1782222041.337036:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1782222041.337043:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0850982c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:6523:x1868795081717248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782222041.337051:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222041.337062:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0875803a00/0xe2b7cc26e68112b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e68112a9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222041.337095:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0875803a00/0xe2b7cc26e68112b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e68112a9 expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222041.337105:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0875803a00/0xe2b7cc26e68112b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68112a9 expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222041.337112:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0875803a00, rc 0) 00000100:00100000:1.0:1782222041.337156:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0850982c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:6523:x1868795081717248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222041.337162:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1782222041.337880:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877157b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081717248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782222041.337895:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0841459400/0xe2b7cc26e68112a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68112b0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222041.337905:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0841459400/0xe2b7cc26e68112a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e68112b0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222041.337988:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877157b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081717376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782222041.338020:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222041.338052:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f07464443c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782222041.338097:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081717376 00000100:00100000:1.0:1782222041.338102:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081717376 00000100:00100000:1.0:1782222041.338133:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1782222041.338149:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0850981050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:6523:x1868795081717376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782222041.338289:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0850981050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:6523:x1868795081717376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222041.338296:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1782222041.338515:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877157b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081717376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782222041.338543:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877157b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081717504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782222041.338579:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222041.338610:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f07464443c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782222041.338653:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081717504 00000100:00100000:0.0:1782222041.338658:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081717504 00000100:00100000:0.0:1782222041.338690:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1782222041.338697:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085541c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:6523:x1868795081717504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782222041.338780:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085541c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:6523:x1868795081717504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222041.338787:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1782222041.339050:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877157b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081717504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782222041.339499:0:10366:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877157b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10366:1868795081717632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782222041.339537:0:10366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222041.339568:0:10366:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746444480 going to sleep for 11 seconds 00000100:00100000:0.0:1782222041.340332:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081717632 00000100:00100000:0.0:1782222041.340339:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081717632 00000100:00100000:0.0:1782222041.340375:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1782222041.340383:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085541e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:10366:x1868795081717632:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782222041.340494:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085541e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:10366:x1868795081717632:12345-0@lo:502:llog_process_th.0 Request processed in 111us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222041.340501:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1782222041.341403:0:10366:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877157b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10366:1868795081717632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782222041.341459:0:10366:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877157b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10366:1868795081717760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782222041.341499:0:10366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222041.341529:0:10366:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746444480 going to sleep for 11 seconds 00000100:00100000:0.0:1782222041.341592:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081717760 00000100:00100000:0.0:1782222041.341597:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081717760 00000100:00100000:0.0:1782222041.341622:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1782222041.341629:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085541d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:10366:x1868795081717760:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782222041.347051:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085541d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:10366:x1868795081717760:12345-0@lo:502:llog_process_th.0 Request processed in 5412us (5540us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222041.347066:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1782222041.351018:0:10366:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877157b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10366:1868795081717760:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1782222041.351088:0:10366:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1782222041.351599:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1782222041.351634:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782222041.351654:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0841459400/0xe2b7cc26e68112a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68112b0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222041.351665:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f0841459400/0xe2b7cc26e68112a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68112b0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782222041.351674:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1782222041.351677:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:0.0:1782222041.351679:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1782222041.351712:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0840030200/0xe2b7cc26e68112b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222041.351720:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f0840030200/0xe2b7cc26e68112b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222041.351729:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0840030200/0xe2b7cc26e68112b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222041.351749:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747297100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081717888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782222041.351803:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222041.351831:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746406cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782222041.351942:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081717888 00000100:00100000:3.0:1782222041.351949:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081717888 00000100:00100000:3.0:1782222041.351997:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1782222041.352006:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085541f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:6523:x1868795081717888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782222041.352020:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222041.352031:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0841459a00/0xe2b7cc26e68112be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e68112b7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222041.352052:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0841459a00/0xe2b7cc26e68112be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e68112b7 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222041.352063:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0841459a00/0xe2b7cc26e68112be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68112b7 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222041.352072:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0841459a00, rc 0) 00000100:00100000:3.0:1782222041.352118:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085541f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:6523:x1868795081717888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222041.352125:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1782222041.353384:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747297100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081717888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782222041.353406:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0840030200/0xe2b7cc26e68112b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68112be expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222041.353416:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0840030200/0xe2b7cc26e68112b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e68112be expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222041.353520:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087f916a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081718016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782222041.353561:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222041.353588:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074725dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1782222041.353662:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081718016 00000100:00100000:3.0:1782222041.353667:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081718016 00000100:00100000:3.0:1782222041.353708:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1782222041.353717:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:6523:x1868795081718016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782222041.353840:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:6523:x1868795081718016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222041.353854:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1782222041.354022:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087f916a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081718016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782222041.354052:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087f916a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081718144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782222041.354090:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222041.354112:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074725dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1782222041.354153:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081718144 00000100:00100000:0.0:1782222041.354157:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081718144 00000100:00100000:0.0:1782222041.354189:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1782222041.354196:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:6523:x1868795081718144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782222041.354320:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:6523:x1868795081718144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 123us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222041.354327:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1782222041.354531:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087f916a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081718144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782222041.354863:0:10367:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087f916a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10367:1868795081718272:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782222041.354899:0:10367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222041.354936:0:10367:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074725d180 going to sleep for 11 seconds 00000100:00100000:0.0:1782222041.354975:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081718272 00000100:00100000:0.0:1782222041.354979:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081718272 00000100:00100000:0.0:1782222041.355010:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1782222041.355017:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:10367:x1868795081718272:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782222041.355089:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:10367:x1868795081718272:12345-0@lo:502:llog_process_th.0 Request processed in 72us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222041.355096:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1782222041.355130:0:10367:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087f916a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10367:1868795081718272:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782222041.355153:0:10367:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782222041.355162:0:10367:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782222041.355165:0:10367:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1782222041.355172:0:10367:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1782222041.355194:0:10367:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747296300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10367:1868795081718400:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782222041.355260:0:10367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222041.355278:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081718400 00000100:00100000:0.0:1782222041.355281:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081718400 00000100:00100000:0.0:1782222041.355299:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1782222041.355304:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:10367:x1868795081718400:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782222041.355358:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:10367:x1868795081718400:12345-0@lo:502:llog_process_th.0 Request processed in 53us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222041.355364:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1782222041.355393:0:10367:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746406b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782222041.355405:0:10367:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747296300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10367:1868795081718400:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782222041.355431:0:10367:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782222041.355436:0:10367:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782222041.355437:0:10367:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1782222041.355442:0:10367:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1782222041.355496:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1782222041.355512:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1782222041.355519:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0840030200/0xe2b7cc26e68112b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68112be expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222041.355529:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f0840030200/0xe2b7cc26e68112b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68112be expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782222041.355537:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1782222041.355539:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8f087805cd40 from 1 10000000:01000000:0.0:1782222041.355542:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1782222041.355564:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0840030600/0xe2b7cc26e68112c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222041.355572:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f0840030600/0xe2b7cc26e68112c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222041.355580:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0840030600/0xe2b7cc26e68112c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222041.355592:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747296300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081718528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782222041.355631:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222041.355941:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081718528 00000100:00100000:1.0:1782222041.355946:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081718528 00000100:00100000:1.0:1782222041.355967:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1782222041.355974:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:6523:x1868795081718528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782222041.355982:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222041.355993:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0875803400/0xe2b7cc26e68112cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e68112c5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222041.356012:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0875803400/0xe2b7cc26e68112cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e68112c5 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222041.356021:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0875803400/0xe2b7cc26e68112cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68112c5 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222041.356041:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0875803400, rc 0) 00000100:00100000:1.0:1782222041.356065:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:6523:x1868795081718528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222041.356071:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1782222041.356472:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746406b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782222041.356488:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747296300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081718528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782222041.356500:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0840030600/0xe2b7cc26e68112c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68112cc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222041.356509:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0840030600/0xe2b7cc26e68112c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e68112cc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222041.356576:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747296300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081718656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782222041.356601:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222041.356661:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746406b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782222041.364819:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081718656 00000100:00100000:1.0:1782222041.364832:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081718656 00000100:00100000:0.0:1782222041.365730:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1782222041.365744:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:6523:x1868795081718656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782222041.365922:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:6523:x1868795081718656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 173us (9311us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782222041.365931:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1782222041.374499:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747296300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081718656:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1782222041.374565:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1782222041.374576:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0840030600/0xe2b7cc26e68112c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68112cc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222041.374587:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f0840030600/0xe2b7cc26e68112c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68112cc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222041.642621:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222042.602698:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081719168:0@lo:400:kworker.0 00000100:00100000:2.0:1782222042.602767:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222042.602811:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087701b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081719680:0@lo:400:kworker.0 00000100:00100000:2.0:1782222042.602832:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222042.602849:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081720192:0@lo:400:kworker.0 00000100:00100000:2.0:1782222042.602867:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222042.602889:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1782222042.602895:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081718784:0@lo:400:kworker.0 00000100:00100000:2.0:1782222042.602933:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222042.602956:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1868795081719296:0@lo:400:kworker.0 00000100:00100000:2.0:1782222042.602975:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222042.603005:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081719808:0@lo:400:kworker.0 00000100:00100000:2.0:1782222042.603025:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222042.603041:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081720320:0@lo:400:kworker.0 00000100:00100000:2.0:1782222042.603061:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222042.603088:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081719680 00000100:00100000:2.0:1782222042.603095:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081719680 00000100:00100000:2.0:1782222042.603138:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081720192 00000100:00100000:2.0:1782222042.603142:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081720192 00000100:00100000:2.0:1782222042.603154:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081719808 00000100:00100000:2.0:1782222042.603157:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081719808 00000100:00100000:2.0:1782222042.603169:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081720320 00000100:00100000:2.0:1782222042.603171:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081720320 00000100:00100000:2.0:1782222042.603185:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782222042.603192:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081719680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222042.603346:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081719680:12345-0@lo:400:kworker.0 Request processed in 153us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222042.603354:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782222042.603372:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782222042.603476:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1868795081718912:0@lo:400:kworker.0 00000100:00100000:0.0:1782222042.603509:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222042.603528:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1868795081719424:0@lo:400:kworker.0 00000100:00100000:0.0:1782222042.603548:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222042.603564:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087701aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1868795081719936:0@lo:400:kworker.0 00000100:00100000:0.0:1782222042.603583:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222042.603599:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1782222042.603605:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081719040:0@lo:400:kworker.0 00000100:00100000:0.0:1782222042.603624:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222042.603640:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1868795081719552:0@lo:400:kworker.0 00000100:00100000:0.0:1782222042.603658:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222042.603668:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1868795081720064:0@lo:400:kworker.0 00000100:00100000:0.0:1782222042.603691:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222042.603710:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081719296 00000100:00100000:0.0:1782222042.603723:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081719296 00000100:00100000:0.0:1782222042.603743:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081718912 00000100:00100000:0.0:1782222042.603746:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081718912 00000100:00100000:0.0:1782222042.603755:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081719424 00000100:00100000:0.0:1782222042.603757:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081719424 00000100:00100000:0.0:1782222042.603768:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081719936 00000100:00100000:0.0:1782222042.603770:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081719936 00000100:00100000:0.0:1782222042.603780:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081719552 00000100:00100000:0.0:1782222042.603781:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081719552 00000100:00100000:0.0:1782222042.603790:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081720064 00000100:00100000:0.0:1782222042.603792:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081720064 00000100:00100000:0.0:1782222042.603802:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782222042.603807:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1868795081719296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222042.603834:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1868795081719296:12345-0@lo:400:kworker.0 Request processed in 27us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222042.603839:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782222042.603849:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1782222042.603855:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1868795081718912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222042.603883:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1868795081718912:12345-0@lo:400:kworker.0 Request processed in 29us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222042.603889:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1782222042.603899:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1782222042.603918:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1868795081719424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222042.603943:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1868795081719424:12345-0@lo:400:kworker.0 Request processed in 39us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222042.603949:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1782222042.603960:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1782222042.603966:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1868795081719936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222042.603998:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1868795081719936:12345-0@lo:400:kworker.0 Request processed in 33us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222042.604004:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1782222042.604013:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1782222042.604018:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1868795081719552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222042.604052:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1868795081719552:12345-0@lo:400:kworker.0 Request processed in 34us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222042.604057:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1782222042.604067:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1782222042.604073:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1868795081720064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222042.604095:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1868795081720064:12345-0@lo:400:kworker.0 Request processed in 23us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222042.604101:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1782222042.604120:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081719168 00000100:00100000:0.0:1782222042.604123:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081719168 00000100:00100000:0.0:1782222042.604146:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081719040 00000100:00100000:0.0:1782222042.604149:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081719040 00000100:00100000:0.0:1782222042.604160:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782222042.604166:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074764b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081719168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222042.604209:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074764b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081719168:12345-0@lo:400:kworker.0 Request processed in 31us (1431us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222042.604216:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782222042.604228:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1782222042.604276:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081719040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222042.604303:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081719040:12345-0@lo:400:kworker.0 Request processed in 70us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222042.604317:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1782222042.604340:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782222042.604347:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081719808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222042.604375:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081719808:12345-0@lo:400:kworker.0 Request processed in 29us (1349us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222042.604390:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782222042.604403:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782222042.604409:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081720320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222042.604435:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081720320:12345-0@lo:400:kworker.0 Request processed in 26us (1373us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222042.604441:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782222042.604474:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081719040:0@lo:400:kworker.0 00010000:00080000:0.0:1782222042.604487:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f087fdb2a00 x1868795081719552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222042.604497:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1868795081719552:0@lo:400:kworker.0 00010000:00080000:0.0:1782222042.604506:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088163ce00 x1868795081720064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222042.604514:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1868795081720064:0@lo:400:kworker.0 00000100:00100000:0.0:1782222042.604523:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1868795081718912:0@lo:400:kworker.0 00000100:00100000:0.0:1782222042.604531:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1868795081719424:0@lo:400:kworker.0 00000100:00100000:0.0:1782222042.604538:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087701aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1868795081719936:0@lo:400:kworker.0 00000100:00080000:0.0:1782222042.604579:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782222042.604588:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782222042.604591:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782222042.604593:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782222042.604622:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1868795081719296:0@lo:400:kworker.0 00010000:00080000:0.0:1782222042.604631:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0877019f80 x1868795081719808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222042.604639:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081719808:0@lo:400:kworker.0 00010000:00080000:0.0:1782222042.604647:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088163df80 x1868795081720320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222042.604654:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081720320:0@lo:400:kworker.0 00000100:00100000:0.0:1782222042.604662:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081719168:0@lo:400:kworker.0 00010000:00080000:0.0:1782222042.604670:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f087701b480 x1868795081719680/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222042.604676:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087701b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081719680:0@lo:400:kworker.0 00000100:00100000:2.0:1782222042.605029:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074764aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081720192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222042.605073:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074764aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081720192:12345-0@lo:400:kworker.0 Request processed in 1695us (2205us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222042.605079:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782222042.605930:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081718784 00000100:00100000:3.0:1782222042.605938:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081718784 00000100:00100000:3.0:1782222042.605983:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1782222042.605991:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3653:x1868795081718784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222042.606033:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3653:x1868795081718784:12345-0@lo:400:kworker.0 Request processed in 44us (3099us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222042.606038:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1782222042.609183:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081718784:0@lo:400:kworker.0 00010000:00080000:0.0:1782222042.611673:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088163d880 x1868795081720192/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222042.611692:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081720192:0@lo:400:kworker.0 00010000:00010000:1.0:1782222042.666534:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222043.048351:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222043.056412:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222043.056612:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060688640 00000100:00100000:2.0:1782222043.056621:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060688640 00000100:00100000:2.0:1782222043.056692:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 72 00000100:00100000:2.0:1782222043.056714:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+6:2389:x1868795060688640:12345-192.168.203.27@tcp:400: 00000100:00100000:2.0:1782222043.056780:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+6:2389:x1868795060688640:12345-192.168.203.27@tcp:400: Request processed in 79us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222043.056800:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 72 00000100:00080000:1.0:1782222043.057304:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782222043.058023:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222043.058071:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222043.058114:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222043.058188:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060688896 00000100:00100000:2.0:1782222043.058211:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060688896 00000100:00100000:2.0:1782222043.058318:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060689024 00000100:00100000:2.0:1782222043.058322:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060689024 00000100:00100000:2.0:1782222043.058349:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 29 00000100:00100000:2.0:1782222043.058360:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747649f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060688896:12345-192.168.203.27@tcp:400: 00000100:00100000:2.0:1782222043.058737:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747649f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060688896:12345-192.168.203.27@tcp:400: Request processed in 376us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222043.058751:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 29 00000100:00100000:2.0:1782222043.058773:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 30 00000100:00100000:2.0:1782222043.058780:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074764b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060689024:12345-192.168.203.27@tcp:400: 00000100:00100000:2.0:1782222043.058807:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074764b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060689024:12345-192.168.203.27@tcp:400: Request processed in 28us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222043.058814:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 30 00000100:00100000:0.0:1782222043.059095:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060688512 00000100:00100000:0.0:1782222043.059119:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060688512 00000100:00100000:0.0:1782222043.059192:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 244 00000100:00100000:0.0:1782222043.059202:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+8:2389:x1868795060688512:12345-192.168.203.27@tcp:400: 00000100:00100000:0.0:1782222043.059286:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+8:2389:x1868795060688512:12345-192.168.203.27@tcp:400: Request processed in 84us (10942us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222043.059306:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 244 00000100:00100000:1.0:1782222043.060883:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060688768 00000100:00100000:1.0:1782222043.060898:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060688768 00000100:00100000:1.0:1782222043.061009:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 73 00000100:00100000:1.0:1782222043.061021:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060688768:12345-192.168.203.27@tcp:400: 00000100:00100000:1.0:1782222043.061105:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060688768:12345-192.168.203.27@tcp:400: Request processed in 86us (3032us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222043.061112:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 73 00000100:00080000:1.0:1782222043.061155:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782222043.061159:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782222043.061178:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782222043.114964:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081720448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782222043.115080:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222043.115143:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782222043.115154:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081720576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782222043.115181:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222043.131735:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081720448 00000100:00100000:3.0:1782222043.131756:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081720448 00000100:00100000:3.0:1782222043.131839:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081720576 00000100:00100000:3.0:1782222043.131843:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081720576 00000100:00100000:3.0:1782222043.131868:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782222043.131880:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f916a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081720448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782222043.131943:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222043.132089:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f916a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081720448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 211us (17008us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222043.132097:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782222043.132120:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1782222043.132282:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747297100 x1868795081720448/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222059 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222043.132313:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081720448:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782222043.135269:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f915c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081720576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782222043.135330:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222043.135708:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f915c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081720576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3578us (20522us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222043.135720:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1782222043.135868:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088163fb80 x1868795081720576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222059 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222043.135895:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081720576:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782222043.692286:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782222044.138468:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782222044.138705:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782222044.138725:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081720832:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782222044.138794:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222044.139171:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081720704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782222044.139670:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222044.139812:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081720832 00000100:00100000:3.0:1782222044.139831:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081720832 00000100:00100000:3.0:1782222044.139873:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081720704 00000100:00100000:3.0:1782222044.139877:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081720704 00000100:00100000:3.0:1782222044.139905:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782222044.139915:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074764a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081720832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782222044.139950:0:7480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1782222044.140005:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074764a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081720832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (1211us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222044.140011:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782222044.140836:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782222044.140855:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081720704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782222044.140967:0:7480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1782222044.141015:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081720704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 166us (1345us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222044.141345:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081720832:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782222044.141401:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081720704:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782222044.141794:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782222044.583448:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222044.583564:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060689152 00000100:00100000:1.0:1782222044.583583:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060689152 00000100:00100000:1.0:1782222044.583686:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 245 00000100:00100000:1.0:1782222044.583699:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+8:6161:x1868795060689152:12345-192.168.203.27@tcp:101: 00010000:00010000:1.0:1782222044.583720:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222044.583743:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0875802400/0xe2b7cc26e68112d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558339 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222044.583780:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0875802400/0xe2b7cc26e68112d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558339 expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222044.583793:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0875802400/0xe2b7cc26e68112d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558339 expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222044.583805:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0875802400, rc 0) 00000100:00100000:1.0:1782222044.586016:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+9:6161:x1868795060689152:12345-192.168.203.27@tcp:101: Request processed in 2301us (2559us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222044.586032:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 245 00000100:00100000:1.0:1782222044.589829:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222044.589966:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060689280 00000100:00100000:0.0:1782222044.589979:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060689280 00000100:00100000:3.0:1782222044.590136:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 246 00000100:00100000:3.0:1782222044.590151:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+9:6161:x1868795060689280:12345-192.168.203.27@tcp:501: 00000100:00100000:3.0:1782222044.592076:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+9:6161:x1868795060689280:12345-192.168.203.27@tcp:501: Request processed in 1912us (2242us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222044.592096:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 246 00000100:00100000:2.0:1782222044.598502:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222044.598659:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060689408 00000100:00100000:1.0:1782222044.598672:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060689408 00000100:00100000:1.0:1782222044.598742:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 247 00000100:00100000:1.0:1782222044.598753:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+9:6161:x1868795060689408:12345-192.168.203.27@tcp:503: 00000100:00100000:1.0:1782222044.598985:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+9:6161:x1868795060689408:12345-192.168.203.27@tcp:503: Request processed in 233us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222044.598995:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 247 00000100:00100000:1.0:1782222044.603053:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222044.603702:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060689536 00000100:00100000:3.0:1782222044.603716:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060689536 00000100:00100000:3.0:1782222044.603791:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 248 00000100:00100000:3.0:1782222044.603802:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+9:6662:x1868795060689536:12345-192.168.203.27@tcp:502: 00000100:00100000:3.0:1782222044.604031:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+9:6662:x1868795060689536:12345-192.168.203.27@tcp:502: Request processed in 230us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222044.606409:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 248 00000100:00100000:2.0:1782222044.608732:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222044.609700:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060689664 00000100:00100000:0.0:1782222044.609717:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060689664 00000100:00100000:0.0:1782222044.609828:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 249 00000100:00100000:0.0:1782222044.609840:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+9:6662:x1868795060689664:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782222044.610047:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+9:6662:x1868795060689664:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 201us (1318us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222044.610058:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 249 00000100:00100000:2.0:1782222044.613204:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222044.619780:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060689792 00000100:00100000:1.0:1782222044.619803:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060689792 00000100:00100000:1.0:1782222044.619905:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 250 00000100:00100000:1.0:1782222044.619919:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+9:6161:x1868795060689792:12345-192.168.203.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782222044.619943:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222044.619964:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0875803c00/0xe2b7cc26e68112da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558340 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222044.620001:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0875803c00/0xe2b7cc26e68112da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558340 expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222044.620014:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0875803c00/0xe2b7cc26e68112da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558340 expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222044.620025:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0875803c00, rc 0) 00000100:00100000:1.0:1782222044.620528:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:6161:x1868795060689792:12345-192.168.203.27@tcp:101:ll_cfg_requeue.0 Request processed in 608us (7339us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222044.620537:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 250 00000100:00100000:3.0:1782222044.623368:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222044.623453:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060689920 00000100:00100000:0.0:1782222044.623466:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060689920 00000100:00100000:0.0:1782222044.623592:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 251 00000100:00100000:0.0:1782222044.623603:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:6161:x1868795060689920:12345-192.168.203.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782222044.623759:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:6161:x1868795060689920:12345-192.168.203.27@tcp:501:ll_cfg_requeue.0 Request processed in 157us (402us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782222044.623768:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 251 00000100:00100000:2.0:1782222044.651544:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081720960:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782222044.651642:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222044.653066:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081720960 00000100:00100000:1.0:1782222044.653107:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081720960 00000100:00100000:1.0:1782222044.653216:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782222044.653231:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074764b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081720960:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1782222044.653288:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1782222044.653316:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782222044.654083:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081721088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782222044.654144:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222044.654210:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081721088 00000100:00100000:0.0:1782222044.654217:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081721088 00000100:00100000:0.0:1782222044.655159:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782222044.655172:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747297800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081721088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782222044.655203:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782222044.655303:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747297800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081721088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222044.655326:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1782222044.655388:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088163c000 x1868795081721088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222060 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222044.655432:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081721088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782222044.656148:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074764b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081720960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2917us (4500us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222044.656158:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1782222044.661663:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782222044.661833:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088163c700 x1868795081720960/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222060 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222044.661864:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081720960:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1782222044.714750:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222045.739406:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782222046.716532:0:10404:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff74b5cd40 20000000:00000080:2.0:1782222046.716548:0:10404:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f0881639000 uarg=0000000000000000 20000000:01000000:2.0:1782222046.716589:0:10404:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1782222046.716594:0:10404:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1782222046.716599:0:10404:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1782222046.719056:0:10405:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1782222046.719209:0:10404:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1782222046.725472:0:10404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1782222046.725508:0:10404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1782222046.725527:0:10404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1782222046.725542:0:10404:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1782222046.725560:0:10404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f0840031600/0xe2b7cc26e68112e1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222046.725577:0:10404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f08427de200/0xe2b7cc26e6810f6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810f68 expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222046.725584:0:10404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0841459800/0xe2b7cc26e6810f8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810f84 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222046.725591:0:10404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0840030800/0xe2b7cc26e6810fdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6810fd8 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222046.725598:0:10404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0841459e00/0xe2b7cc26e6811105 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68110fe expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222046.725607:0:10404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0840031400/0xe2b7cc26e681121d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558301 expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222046.725615:0:10404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f0840031600/0xe2b7cc26e68112e1 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222046.725670:0:10404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0840031400/0xe2b7cc26e681121d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558301 expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222046.725686:0:10404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f0840031400/0xe2b7cc26e681121d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558301 expref: 9 pid: 6519 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222046.725701:0:10404:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747294700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10404:1868795081721216:192.168.203.27@tcp:104: 00010000:00010000:0.0:1782222046.725801:0:10404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0841459e00/0xe2b7cc26e6811105 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e68110fe expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222046.725810:0:10404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0841459e00/0xe2b7cc26e6811105 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e68110fe expref: 23 pid: 6519 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222046.725819:0:10404:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747297480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10404:1868795081721344:0@lo:104: 00000100:00100000:0.0:1782222046.725859:0:10404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222046.725910:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081721344 00000100:00100000:0.0:1782222046.725917:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081721344 00010000:00010000:1.0:1782222046.728555:0:10404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0840030800/0xe2b7cc26e6810fdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e6810fd8 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222046.728574:0:10404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0840030800/0xe2b7cc26e6810fdf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e6810fd8 expref: 23 pid: 6519 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222046.728590:0:10404:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087f917800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10404:1868795081721472:0@lo:104: 00000100:00100000:1.0:1782222046.728643:0:10404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782222046.733265:0:10404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0841459800/0xe2b7cc26e6810f8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e6810f84 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222046.733285:0:10404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0841459800/0xe2b7cc26e6810f8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e6810f84 expref: 23 pid: 6520 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222046.733302:0:10404:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087f914e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10404:1868795081721600:0@lo:104: 00010000:00010000:1.0:1782222046.733358:0:10404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f08427de200/0xe2b7cc26e6810f6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e6810f68 expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222046.733366:0:10404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f08427de200/0xe2b7cc26e6810f6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e6810f68 expref: 23 pid: 6521 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222046.733376:0:10404:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087f914a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10404:1868795081721728:0@lo:104: 00000100:00100000:1.0:1782222046.733412:0:10404:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0851442000 going to sleep for 11 seconds 00000100:00100000:0.0:1782222046.733603:0:6509:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782222046.733630:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222046.733645:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222046.733654:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081721472 00000100:00100000:0.0:1782222046.733660:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081721472 00000100:00100000:0.0:1782222046.733697:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081721600 00000100:00100000:0.0:1782222046.733700:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081721600 00000100:00100000:0.0:1782222046.733712:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081721728 00000100:00100000:0.0:1782222046.733714:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081721728 00000100:00100000:0.0:1782222046.733730:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782222046.733738:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747297100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+6:10404:x1868795081721344:12345-0@lo:104: 00010000:00010000:0.0:1782222046.733751:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f0875803800/0xe2b7cc26e68110fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6811105 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222046.733825:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782222046.733832:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747297100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+6:10404:x1868795081721344:12345-0@lo:104: Request processed in 95us (7973us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222046.733840:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782222046.733859:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782222046.733865:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0746687c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+5:10404:x1868795081721472:12345-0@lo:104: 00010000:00010000:0.0:1782222046.733891:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f0841458a00/0xe2b7cc26e6810fd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810fdf expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222046.733928:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1782222046.733933:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0746687c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+5:10404:x1868795081721472:12345-0@lo:104: Request processed in 69us (5291us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222046.733940:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782222046.733985:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1782222046.733992:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087701b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+4:10404:x1868795081721600:12345-0@lo:104: 00010000:00010000:0.0:1782222046.734000:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f087fb83000/0xe2b7cc26e6810f84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810f8b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222046.734110:0:7468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782222046.734118:0:7468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f0875803800/0xe2b7cc26e68110fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6811105 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222046.734126:0:7468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0875803800 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:2.0:1782222046.734130:0:7468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f0875803800/0xe2b7cc26e68110fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e6811105 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222046.734150:0:7468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f0875803800/0xe2b7cc26e68110fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e6811105 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782222046.734159:0:7468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f0875803800/0xe2b7cc26e68110fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e6811105 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782222046.734165:0:7468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782222046.734194:0:7468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f0875803800/0xe2b7cc26e68110fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811105 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222046.734201:0:7468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782222046.734220:0:7468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f0875803800/0xe2b7cc26e68110fe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811105 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222046.734228:0:7468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f0875803800/0xe2b7cc26e68110fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811105 expref: -99 pid: 9521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222046.734265:0:7468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782222046.734269:0:7468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f0841458a00/0xe2b7cc26e6810fd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810fdf expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222046.734275:0:7468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0841458a00 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:2.0:1782222046.734278:0:7468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f0841458a00/0xe2b7cc26e6810fd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e6810fdf expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222046.734285:0:7468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f0841458a00/0xe2b7cc26e6810fd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e6810fdf expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782222046.734293:0:7468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f0841458a00/0xe2b7cc26e6810fd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e6810fdf expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782222046.734305:0:7468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782222046.734319:0:7468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f0841458a00/0xe2b7cc26e6810fd8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810fdf expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222046.734325:0:7468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782222046.734331:0:7468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f0841458a00/0xe2b7cc26e6810fd8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810fdf expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222046.734337:0:7468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f0841458a00/0xe2b7cc26e6810fd8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810fdf expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222046.734349:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222046.734350:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222046.734352:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222046.734376:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074764a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081721856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782222046.734408:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222046.734438:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782222046.734444:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074764ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081721984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782222046.734464:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222046.734492:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081721856 00000100:00100000:2.0:1782222046.734497:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081721856 00010000:00010000:2.0:1782222046.734518:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0841459e00/0xe2b7cc26e6811105 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e68110fe expref: 24 pid: 6519 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222046.734539:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081721984 00000100:00100000:2.0:1782222046.734542:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081721984 00010000:00010000:2.0:1782222046.734553:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0840030800/0xe2b7cc26e6810fdf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810fd8 expref: 25 pid: 6519 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222046.734584:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782222046.734590:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747648e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+25:3653:x1868795081721856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782222046.734601:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782222046.734606:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0841459e00/0xe2b7cc26e6811105 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e68110fe expref: 25 pid: 6519 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222046.734615:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0841459e00/0xe2b7cc26e6811105 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e68110fe expref: 25 pid: 6519 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222046.734632:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782222046.734658:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747648e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+25:3653:x1868795081721856:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222046.734664:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782222046.734679:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782222046.734684:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747649880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3653:x1868795081721984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782222046.734707:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782222046.734712:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0840030800/0xe2b7cc26e6810fdf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810fd8 expref: 24 pid: 6519 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222046.734721:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0840030800/0xe2b7cc26e6810fdf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e6810fd8 expref: 24 pid: 6519 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222046.734731:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782222046.734753:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747649880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3653:x1868795081721984:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222046.734759:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782222046.734802:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074764ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081721984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782222046.734820:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074764a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081721856:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782222046.734909:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782222046.734916:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087701b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+4:10404:x1868795081721600:12345-0@lo:104: Request processed in 925us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222046.734923:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1782222046.734938:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1782222046.734945:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877019f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+3:10404:x1868795081721728:12345-0@lo:104: 00010000:00010000:0.0:1782222046.734954:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f08427df400/0xe2b7cc26e6810f68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810f6f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222046.734992:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1782222046.734997:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877019f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+3:10404:x1868795081721728:12345-0@lo:104: Request processed in 54us (1351us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222046.735003:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1782222046.735018:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782222046.735023:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f087fb83000/0xe2b7cc26e6810f84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810f8b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222046.735112:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782222046.735117:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f08427df400/0xe2b7cc26e6810f68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6810f6f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222046.735124:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08427df400 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:2.0:1782222046.735127:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f08427df400/0xe2b7cc26e6810f68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e6810f6f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222046.735135:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f08427df400/0xe2b7cc26e6810f68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e6810f6f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782222046.735141:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f08427df400/0xe2b7cc26e6810f68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e6810f6f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782222046.735145:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782222046.735165:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f08427df400/0xe2b7cc26e6810f68 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810f6f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222046.735171:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782222046.735188:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f08427df400/0xe2b7cc26e6810f68 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810f6f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222046.735195:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f08427df400/0xe2b7cc26e6810f68 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810f6f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222046.735206:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222046.735208:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222046.735209:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222046.735218:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074764a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081722112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782222046.735270:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782222046.735309:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222046.735316:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081722112 00000100:00100000:2.0:1782222046.735320:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081722112 00010000:00010000:2.0:1782222046.735337:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f08427de200/0xe2b7cc26e6810f6f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810f68 expref: 24 pid: 6521 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222046.735357:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782222046.735363:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074764ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3655:x1868795081722112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782222046.735371:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782222046.735376:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f08427de200/0xe2b7cc26e6810f6f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810f68 expref: 24 pid: 6521 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222046.735385:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f08427de200/0xe2b7cc26e6810f6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e6810f68 expref: 24 pid: 6521 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222046.735396:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782222046.735420:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074764ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3655:x1868795081722112:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222046.735427:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782222046.735451:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074764a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081722112:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782222046.735510:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83000 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:0.0:1782222046.735513:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f087fb83000/0xe2b7cc26e6810f84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e6810f8b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222046.735521:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f087fb83000/0xe2b7cc26e6810f84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e6810f8b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782222046.735529:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f087fb83000/0xe2b7cc26e6810f84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e6810f8b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782222046.735534:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782222046.735560:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f087fb83000/0xe2b7cc26e6810f84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810f8b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222046.735567:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782222046.735577:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f087fb83000/0xe2b7cc26e6810f84 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810f8b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222046.735584:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f087fb83000/0xe2b7cc26e6810f84 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6810f8b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222046.735609:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222046.735610:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222046.735612:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222046.735694:0:10404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0841459e00/0xe2b7cc26e6811105 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e68110fe expref: 23 pid: 6519 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222046.735705:0:10404:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747297480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10404:1868795081721344:0@lo:104: 00010000:00010000:1.0:1782222046.735718:0:10404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0840030800/0xe2b7cc26e6810fdf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e6810fd8 expref: 22 pid: 6519 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222046.735727:0:10404:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087f917800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10404:1868795081721472:0@lo:104: 00000100:00100000:1.0:1782222046.735736:0:10404:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087f914e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10404:1868795081721600:0@lo:104: 00010000:00010000:1.0:1782222046.735744:0:10404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f08427de200/0xe2b7cc26e6810f6f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e6810f68 expref: 21 pid: 6521 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222046.735754:0:10404:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087f914a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10404:1868795081721728:0@lo:104: 00000100:00100000:2.0:1782222046.735803:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087701aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081722240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782222046.735831:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222046.736116:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081722240 00000100:00100000:1.0:1782222046.736121:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081722240 00010000:00010000:1.0:1782222046.736141:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0841459800/0xe2b7cc26e6810f8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810f84 expref: 21 pid: 6520 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222046.736171:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1782222046.736180:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08429abc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:3656:x1868795081722240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782222046.736189:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222046.736193:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0841459800/0xe2b7cc26e6810f8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6810f84 expref: 21 pid: 6520 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222046.736203:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0841459800/0xe2b7cc26e6810f8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e6810f84 expref: 21 pid: 6520 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222046.736215:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0841459800/0xe2b7cc26e6810f8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e6810f84 expref: 21 pid: 6520 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222046.736260:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782222046.736298:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08429abc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:3656:x1868795081722240:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222046.736306:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782222046.736447:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087701aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081722240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782222046.737616:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222046.737682:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060690048 00000100:00100000:3.0:1782222046.737690:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060690048 00010000:00010000:3.0:1782222046.737717:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0840031400/0xe2b7cc26e681121d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558301 expref: 10 pid: 6519 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222046.737751:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 39 00000100:00100000:3.0:1782222046.737760:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f914380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:2390:x1868795060690048:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782222046.737772:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222046.737777:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0840031400/0xe2b7cc26e681121d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558301 expref: 10 pid: 6519 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222046.737788:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0840031400/0xe2b7cc26e681121d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558301 expref: 10 pid: 6519 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222046.737804:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f0840031600/0xe2b7cc26e68112e1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222046.737813:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0840031600/0xe2b7cc26e68112e1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222046.737830:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f0840031600/0xe2b7cc26e68112e1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222046.737838:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f0840031600/0xe2b7cc26e68112e1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222046.737857:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f0840031600/0xe2b7cc26e68112e1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222046.737865:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f0840031600/0xe2b7cc26e68112e1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222046.737871:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0840031600 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:3.0:1782222046.737886:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f0840031600/0xe2b7cc26e68112e1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222046.737894:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f0840031600/0xe2b7cc26e68112e1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222046.737905:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f0840031600/0xe2b7cc26e68112e1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222046.737916:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782222046.737965:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f914380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:2390:x1868795060690048:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 206us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222046.737974:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 39 00010000:00010000:2.0:1782222046.738122:0:10404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0840031400/0xe2b7cc26e681121d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558301 expref: 9 pid: 6519 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222046.738138:0:10404:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747294700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10404:1868795081721216:192.168.203.27@tcp:104: 00010000:00010000:2.0:1782222046.738181:0:10404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f0840031600/0xe2b7cc26e68112e1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222046.738197:0:10404:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f0840031600/0xe2b7cc26e68112e1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222046.738205:0:10404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f0840031600/0xe2b7cc26e68112e1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222046.738212:0:10404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0840031600/0xe2b7cc26e68112e1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222046.767109:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222047.723400:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1868795081722496:0@lo:400:kworker.0 00000100:00100000:3.0:1782222047.723497:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222047.723539:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1868795081723008:0@lo:400:kworker.0 00000100:00100000:3.0:1782222047.723561:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222047.723578:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1868795081723520:0@lo:400:kworker.0 00000100:00100000:3.0:1782222047.723597:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222047.723626:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1782222047.723651:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3654:1868795081722368:0@lo:400:kworker.0 00000100:00100000:3.0:1782222047.723684:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222047.723713:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1868795081722880:0@lo:400:kworker.0 00000100:00100000:3.0:1782222047.723734:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222047.723747:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081723392:0@lo:400:kworker.0 00000100:00100000:3.0:1782222047.723770:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222047.723785:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081723904:0@lo:400:kworker.0 00000100:00100000:3.0:1782222047.723819:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222047.723855:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081722496 00000100:00100000:3.0:1782222047.723864:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081722496 00000100:00100000:3.0:1782222047.723925:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081723008 00000100:00100000:3.0:1782222047.723928:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081723008 00000100:00100000:3.0:1782222047.723952:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081723520 00000100:00100000:3.0:1782222047.723954:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081723520 00000100:00100000:3.0:1782222047.723965:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081722880 00000100:00100000:3.0:1782222047.723968:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081722880 00000100:00100000:3.0:1782222047.723982:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1782222047.723991:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1868795081722496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222047.724063:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1868795081722496:12345-0@lo:400:kworker.0 Request processed in 72us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222047.724071:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1782222047.724088:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1782222047.724094:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1868795081723008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222047.724121:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1868795081723008:12345-0@lo:400:kworker.0 Request processed in 27us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222047.724127:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1782222047.724137:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1782222047.724150:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1868795081723520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222047.724178:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1868795081723520:12345-0@lo:400:kworker.0 Request processed in 29us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222047.724184:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1782222047.724195:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1782222047.724200:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1868795081722880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222047.724222:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1868795081722880:12345-0@lo:400:kworker.0 Request processed in 22us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222047.724228:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1782222047.724274:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782222047.724307:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1868795081722880:0@lo:400:kworker.0 00000100:00100000:3.0:1782222047.724319:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1868795081722496:0@lo:400:kworker.0 00000100:00100000:3.0:1782222047.724328:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1868795081723008:0@lo:400:kworker.0 00000100:00100000:3.0:1782222047.724336:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1868795081723520:0@lo:400:kworker.0 00000100:00100000:3.0:1782222047.724385:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081722368 00000100:00100000:3.0:1782222047.724388:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081722368 00000100:00100000:3.0:1782222047.724417:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1782222047.724423:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:3654:x1868795081722368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222047.724458:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:3654:x1868795081722368:12345-0@lo:400:kworker.0 Request processed in 34us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222047.724465:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1782222047.724496:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081722624:0@lo:400:kworker.0 00000100:00100000:3.0:1782222047.724524:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222047.724545:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1868795081723136:0@lo:400:kworker.0 00000100:00100000:3.0:1782222047.724573:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222047.724589:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1868795081723648:0@lo:400:kworker.0 00000100:00100000:3.0:1782222047.724607:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222047.724624:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1782222047.724629:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081722752:0@lo:400:kworker.0 00000100:00100000:3.0:1782222047.724648:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222047.724665:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081723264:0@lo:400:kworker.0 00000100:00100000:3.0:1782222047.724685:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222047.724699:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081723776:0@lo:400:kworker.0 00000100:00100000:3.0:1782222047.724720:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222047.724749:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081722624 00000100:00100000:3.0:1782222047.724753:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081722624 00000100:00100000:3.0:1782222047.724776:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081722752 00000100:00100000:3.0:1782222047.724778:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081722752 00000100:00100000:3.0:1782222047.724790:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1782222047.724795:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074751c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081722624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222047.724831:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074751c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081722624:12345-0@lo:400:kworker.0 Request processed in 34us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222047.724837:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1782222047.724847:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1782222047.724853:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074751ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081722752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222047.724905:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074751ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081722752:12345-0@lo:400:kworker.0 Request processed in 52us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222047.724911:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1782222047.724931:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081723392 00000100:00100000:3.0:1782222047.724934:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081723392 00000100:00100000:3.0:1782222047.724967:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081723904 00000100:00100000:3.0:1782222047.724970:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081723904 00000100:00100000:3.0:1782222047.724981:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081723264 00000100:00100000:3.0:1782222047.724983:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081723264 00000100:00100000:3.0:1782222047.724993:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081723776 00000100:00100000:3.0:1782222047.724995:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081723776 00000100:00100000:3.0:1782222047.725007:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782222047.725013:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081723392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222047.725045:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081723392:12345-0@lo:400:kworker.0 Request processed in 32us (1274us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222047.725051:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782222047.725062:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782222047.725067:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074751ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081723904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222047.725093:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074751ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081723904:12345-0@lo:400:kworker.0 Request processed in 26us (1274us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222047.725099:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782222047.725110:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782222047.725115:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074751d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081723264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222047.725143:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074751d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081723264:12345-0@lo:400:kworker.0 Request processed in 28us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222047.725149:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782222047.725158:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782222047.725162:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877153450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081723776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222047.725185:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877153450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081723776:12345-0@lo:400:kworker.0 Request processed in 23us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222047.725190:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782222047.725391:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081723136 00000100:00100000:3.0:1782222047.725401:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081723136 00000100:00100000:3.0:1782222047.725429:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081723648 00000100:00100000:3.0:1782222047.725433:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081723648 00000100:00100000:3.0:1782222047.725447:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1782222047.725453:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074751c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1868795081723136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222047.725483:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074751c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1868795081723136:12345-0@lo:400:kworker.0 Request processed in 30us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222047.725489:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1782222047.725498:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1782222047.725504:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074751dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1868795081723648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222047.725528:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074751dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1868795081723648:12345-0@lo:400:kworker.0 Request processed in 24us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222047.725533:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1782222047.725549:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782222047.725552:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782222047.725554:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782222047.725581:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081722752:0@lo:400:kworker.0 00010000:00080000:3.0:1782222047.725595:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088163e680 x1868795081723264/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222047.725606:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081723264:0@lo:400:kworker.0 00010000:00080000:3.0:1782222047.725615:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088163c700 x1868795081723776/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222047.725622:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081723776:0@lo:400:kworker.0 00000100:00100000:3.0:1782222047.725632:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081722624:0@lo:400:kworker.0 00010000:00080000:3.0:1782222047.725641:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088163f480 x1868795081723136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222047.725657:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1868795081723136:0@lo:400:kworker.0 00010000:00080000:3.0:1782222047.725667:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088163ed80 x1868795081723648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222047.725675:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1868795081723648:0@lo:400:kworker.0 00000100:00100000:3.0:1782222047.725718:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3654:1868795081722368:0@lo:400:kworker.0 00010000:00080000:3.0:1782222047.725731:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088163f100 x1868795081723392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222047.725740:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081723392:0@lo:400:kworker.0 00010000:00080000:3.0:1782222047.725751:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088163c000 x1868795081723904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222047.725759:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081723904:0@lo:400:kworker.0 00010000:00010000:0.0:1782222047.799413:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222048.180682:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222048.180722:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222048.180752:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222048.180785:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222048.180821:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060690304 00000100:00100000:2.0:1782222048.180833:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060690304 00000100:00100000:2.0:1782222048.180906:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060690176 00000100:00100000:2.0:1782222048.180909:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060690176 00000100:00100000:2.0:1782222048.180927:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 253 00000100:00100000:2.0:1782222048.180938:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:6161:x1868795060690304:12345-192.168.203.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782222048.180961:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222048.180987:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f087fb83800/0xe2b7cc26e68112e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558347 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222048.181021:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fb83800/0xe2b7cc26e68112e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558347 expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222048.181037:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f087fb83800/0xe2b7cc26e68112e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558347 expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222048.181065:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb83800, rc 0) 00000100:00100000:2.0:1782222048.181134:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+11:6161:x1868795060690304:12345-192.168.203.27@tcp:101:ll_cfg_requeue.0 Request processed in 197us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222048.181142:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 253 00000100:00100000:2.0:1782222048.181178:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 254 00000100:00100000:2.0:1782222048.181184:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:2387:x1868795060690176:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222048.181211:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:2387:x1868795060690176:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 27us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222048.181218:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 254 00000100:00100000:2.0:1782222048.181273:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060690560 00000100:00100000:2.0:1782222048.181277:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060690560 00000100:00100000:2.0:1782222048.181320:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 80 00000100:00100000:2.0:1782222048.181327:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074764a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+5:2387:x1868795060690560:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222048.181358:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074764a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+5:2387:x1868795060690560:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 32us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222048.181365:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 80 00000100:00100000:2.0:1782222048.181384:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060690816 00000100:00100000:2.0:1782222048.181388:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060690816 00000100:00100000:2.0:1782222048.181415:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 35 00000100:00100000:2.0:1782222048.181421:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+5:2387:x1868795060690816:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222048.181447:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+5:2387:x1868795060690816:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 26us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222048.181474:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 35 00000100:00080000:2.0:1782222048.182205:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782222048.182211:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782222048.195677:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222048.195734:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222048.195814:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060690432 00000100:00100000:3.0:1782222048.195827:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060690432 00000100:00100000:3.0:1782222048.195920:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 81 00000100:00100000:3.0:1782222048.195934:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+6:2388:x1868795060690432:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222048.196036:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+6:2388:x1868795060690432:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 104us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222048.196045:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 81 00000100:00080000:3.0:1782222048.196084:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782222048.197589:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222048.197715:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060690688 00000100:00100000:2.0:1782222048.197726:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060690688 00000100:00100000:2.0:1782222048.197809:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 36 00000100:00100000:2.0:1782222048.197829:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f914a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:2388:x1868795060690688:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222048.197924:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f914a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:2388:x1868795060690688:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 98us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222048.197932:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 36 00000100:00080000:1.0:1782222048.198348:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782222048.200573:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060690944 00000100:00100000:0.0:1782222048.200590:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060690944 00000100:00100000:0.0:1782222048.200657:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 255 00000100:00100000:0.0:1782222048.200666:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:6161:x1868795060690944:12345-192.168.203.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782222048.200879:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:6161:x1868795060690944:12345-192.168.203.27@tcp:501:ll_cfg_requeue.0 Request processed in 212us (5143us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222048.200887:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 255 00000100:00100000:1.0:1782222048.209569:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222048.209658:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060691072 00000100:00100000:0.0:1782222048.209671:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060691072 00000100:00100000:0.0:1782222048.209814:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 256 00000100:00100000:0.0:1782222048.209827:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08672c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:6161:x1868795060691072:12345-192.168.203.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782222048.210035:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08672c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:6161:x1868795060691072:12345-192.168.203.27@tcp:503:ll_cfg_requeue.0 Request processed in 209us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222048.210043:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 256 00000100:00100000:3.0:1782222048.218917:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222048.219276:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060691200 00000100:00100000:1.0:1782222048.219289:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060691200 00000100:00100000:1.0:1782222048.219353:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 257 00000100:00100000:1.0:1782222048.219364:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:6720:x1868795060691200:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782222048.219571:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:6720:x1868795060691200:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 208us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222048.219580:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 257 00000100:00100000:0.0:1782222048.230589:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222048.230735:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060691328 00000100:00100000:1.0:1782222048.230748:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060691328 00000100:00100000:1.0:1782222048.230820:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 258 00000100:00100000:1.0:1782222048.230831:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08672c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:6720:x1868795060691328:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782222048.231024:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08672c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:6720:x1868795060691328:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 193us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222048.231033:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 258 10000000:01000000:1.0:1782222048.240018:0:6523:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782222048.240036:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f08815e6800 from 4 10000000:01000000:1.0:1782222048.240043:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782222048.240107:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875803200/0xe2b7cc26e68112ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222048.240121:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f0875803200/0xe2b7cc26e68112ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222048.240133:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0875803200/0xe2b7cc26e68112ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222048.240167:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087f914e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081724032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782222048.240282:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222048.240337:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b7f3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782222048.240836:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782222048.240854:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087701aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081724160:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782222048.240910:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222048.240953:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081724160 00000100:00100000:0.0:1782222048.240972:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081724160 00000100:00100000:0.0:1782222048.241046:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782222048.241055:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087701ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081724160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782222048.241093:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782222048.241145:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087701ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081724160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222048.241153:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1782222048.241202:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f087701aa00 x1868795081724160/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222064 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222048.241223:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087701aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081724160:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782222048.242153:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081724288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782222048.242204:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222048.242282:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081724288 00000100:00100000:0.0:1782222048.242288:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081724288 00000100:00100000:0.0:1782222048.242326:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782222048.242334:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087701aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081724288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782222048.242355:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782222048.242394:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087701aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081724288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222048.242400:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1782222048.242431:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074751ca80 x1868795081724288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222064 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222048.242448:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081724288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782222048.243962:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081724032 00000100:00100000:2.0:1782222048.243978:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081724032 00000100:00100000:2.0:1782222048.244120:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1782222048.244133:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:6523:x1868795081724032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782222048.244153:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222048.244175:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f087fb82600/0xe2b7cc26e68112f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e68112ef expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222048.244207:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fb82600/0xe2b7cc26e68112f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e68112ef expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222048.244219:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f087fb82600/0xe2b7cc26e68112f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68112ef expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222048.244228:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb82600, rc 0) 00000100:00100000:2.0:1782222048.244336:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:6523:x1868795081724032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 205us (4053us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222048.244343:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1782222048.244405:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087f914e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081724032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782222048.244440:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0875803200/0xe2b7cc26e68112ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68112f6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222048.244450:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0875803200/0xe2b7cc26e68112ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e68112f6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222048.245220:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747648000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081724416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782222048.245400:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222048.245469:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087fb75000 going to sleep for 11 seconds 00000100:00100000:0.0:1782222048.248638:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081724416 00000100:00100000:0.0:1782222048.248658:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081724416 00000100:00100000:2.0:1782222048.250606:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1782222048.250623:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:6523:x1868795081724416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782222048.250883:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:6523:x1868795081724416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 262us (5482us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222048.250891:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1782222048.251145:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747648000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081724416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782222048.251219:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087f917800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081724544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782222048.251317:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222048.251363:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b7f3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782222048.251455:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081724544 00000100:00100000:3.0:1782222048.251465:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081724544 00000100:00100000:3.0:1782222048.251521:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1782222048.251529:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:6523:x1868795081724544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782222048.251638:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:6523:x1868795081724544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222048.251644:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1782222048.251692:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087f917800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081724544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782222048.252462:0:10460:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087f917800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10460:1868795081724672:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782222048.252531:0:10460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222048.252570:0:10460:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b7f3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782222048.252616:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081724672 00000100:00100000:2.0:1782222048.252623:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081724672 00000100:00100000:2.0:1782222048.252667:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1782222048.252675:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:10460:x1868795081724672:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782222048.252796:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:10460:x1868795081724672:12345-0@lo:502:llog_process_th.0 Request processed in 121us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222048.252803:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1782222048.252951:0:10460:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087f917800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10460:1868795081724672:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782222048.252985:0:10460:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782222048.252998:0:10460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222048.253000:0:10460:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1782222048.253008:0:10460:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f08815e6800 00000020:00000080:1.0:1782222048.253011:0:10460:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1782222048.253112:0:10460:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087f917800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10460:1868795081724800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782222048.253156:0:10460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222048.253171:0:10460:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08490a2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782222048.255289:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081724800 00000100:00100000:2.0:1782222048.255306:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081724800 00000100:00100000:2.0:1782222048.255373:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1782222048.255382:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:10460:x1868795081724800:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782222048.255595:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:10460:x1868795081724800:12345-0@lo:502:llog_process_th.0 Request processed in 213us (2437us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222048.255609:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1782222048.255683:0:10460:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087f917800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10460:1868795081724800:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782222048.255725:0:10460:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782222048.255735:0:10460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782222048.255738:0:10460:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1782222048.255743:0:10460:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1782222048.258274:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1782222048.258328:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782222048.258345:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875803200/0xe2b7cc26e68112ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68112f6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222048.258361:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f0875803200/0xe2b7cc26e68112ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68112f6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782222048.258374:0:6523:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782222048.258377:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f087fb98800 from 4 10000000:01000000:0.0:1782222048.258381:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782222048.258433:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e68112fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222048.258441:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e68112fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222048.258454:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e68112fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222048.258497:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087701a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081724928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782222048.258585:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222048.258629:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0851496780 going to sleep for 11 seconds 00000100:00100000:2.0:1782222048.259131:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081724928 00000100:00100000:2.0:1782222048.259141:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081724928 00000100:00100000:2.0:1782222048.260084:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1782222048.260102:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:6523:x1868795081724928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782222048.260122:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222048.260141:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e6811304 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e68112fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222048.260174:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e6811304 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e68112fd expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222048.260187:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e6811304 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68112fd expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222048.260197:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb83200, rc 0) 00000100:00100000:2.0:1782222048.260295:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:6523:x1868795081724928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (1710us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222048.260303:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1782222048.277225:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087701a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081724928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782222048.277277:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e68112fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811304 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222048.277305:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e68112fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6811304 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222048.277405:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747648a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081725056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782222048.277599:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222048.277653:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074725d240 going to sleep for 11 seconds 00000100:00100000:2.0:1782222048.277679:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081725056 00000100:00100000:2.0:1782222048.277686:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081725056 00000100:00100000:2.0:1782222048.277733:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1782222048.277741:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:6523:x1868795081725056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782222048.277891:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:6523:x1868795081725056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 149us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222048.277899:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1782222048.277940:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747648a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081725056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782222048.277973:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747648a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081725184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782222048.278142:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222048.278160:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074725d240 going to sleep for 11 seconds 00000100:00100000:2.0:1782222048.278175:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081725184 00000100:00100000:2.0:1782222048.278178:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081725184 00000100:00100000:2.0:1782222048.278205:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1782222048.278211:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:6523:x1868795081725184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782222048.278318:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:6523:x1868795081725184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222048.278325:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1782222048.278371:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747648a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081725184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782222048.281273:0:10464:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747648a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10464:1868795081725312:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782222048.281363:0:10464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222048.281406:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081725312 00000100:00100000:2.0:1782222048.281413:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081725312 00000100:00100000:2.0:1782222048.281459:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1782222048.281468:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:10464:x1868795081725312:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782222048.282707:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:10464:x1868795081725312:12345-0@lo:502:llog_process_th.0 Request processed in 1231us (1335us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222048.282719:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1782222048.282814:0:10464:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074725df00 going to sleep for 11 seconds 00000100:00100000:2.0:1782222048.282842:0:10464:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747648a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10464:1868795081725312:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782222048.282894:0:10464:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782222048.282907:0:10464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782222048.282910:0:10464:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1782222048.282918:0:10464:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f087fb98800 00000020:00000080:2.0:1782222048.282921:0:10464:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1782222048.283106:0:10464:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747648a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10464:1868795081725440:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782222048.283155:0:10464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222048.283186:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081725440 00000100:00100000:2.0:1782222048.283192:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081725440 00000100:00100000:2.0:1782222048.283259:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1782222048.283269:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:10464:x1868795081725440:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782222048.283341:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:10464:x1868795081725440:12345-0@lo:502:llog_process_th.0 Request processed in 73us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222048.283349:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1782222048.283391:0:10464:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087fb75e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782222048.283403:0:10464:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747648a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10464:1868795081725440:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782222048.283421:0:10464:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782222048.283426:0:10464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782222048.283427:0:10464:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1782222048.283431:0:10464:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1782222048.283533:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1782222048.283557:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782222048.283569:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e68112fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811304 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222048.283581:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e68112fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811304 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782222048.283594:0:6523:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782222048.283597:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f0849b46800 from 4 10000000:01000000:2.0:1782222048.283600:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782222048.283627:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb82a00/0xe2b7cc26e681130b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222048.283636:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f087fb82a00/0xe2b7cc26e681130b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222048.283645:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f087fb82a00/0xe2b7cc26e681130b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222048.283658:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747648a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081725568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782222048.283686:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222048.283701:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074725df00 going to sleep for 11 seconds 00000100:00100000:2.0:1782222048.283717:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081725568 00000100:00100000:2.0:1782222048.283727:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081725568 00000100:00100000:2.0:1782222048.283752:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1782222048.283758:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:6523:x1868795081725568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782222048.283767:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222048.283781:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f087fb82c00/0xe2b7cc26e6811312 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e681130b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222048.283805:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fb82c00/0xe2b7cc26e6811312 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e681130b expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222048.283817:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f087fb82c00/0xe2b7cc26e6811312 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e681130b expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222048.283826:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb82c00, rc 0) 00000100:00100000:2.0:1782222048.283856:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:6523:x1868795081725568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222048.284918:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1782222048.284995:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747648a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081725568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782222048.285732:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f087fb82a00/0xe2b7cc26e681130b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811312 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222048.285750:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f087fb82a00/0xe2b7cc26e681130b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6811312 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222048.285855:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747648a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081725696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782222048.285933:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222048.285984:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074725df00 going to sleep for 11 seconds 00000100:00100000:3.0:1782222048.286120:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081725696 00000100:00100000:3.0:1782222048.286127:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081725696 00000100:00100000:3.0:1782222048.286173:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1782222048.286183:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:6523:x1868795081725696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782222048.286376:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:6523:x1868795081725696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 193us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222048.286383:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1782222048.286431:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747648a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081725696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782222048.286466:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081725824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782222048.286639:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222048.286662:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074725f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782222048.286676:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081725824 00000100:00100000:3.0:1782222048.286680:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081725824 00000100:00100000:3.0:1782222048.286704:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1782222048.286711:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:6523:x1868795081725824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782222048.286795:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:6523:x1868795081725824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222048.286802:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1782222048.286843:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081725824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782222048.287359:0:10465:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074764aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10465:1868795081725952:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782222048.287407:0:10465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222048.287426:0:10465:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074725df00 going to sleep for 11 seconds 00000100:00100000:3.0:1782222048.287560:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081725952 00000100:00100000:3.0:1782222048.287565:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081725952 00000100:00100000:3.0:1782222048.287603:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1782222048.287611:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:10465:x1868795081725952:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782222048.287706:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:10465:x1868795081725952:12345-0@lo:502:llog_process_th.0 Request processed in 95us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222048.287732:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1782222048.287830:0:10465:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074764aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10465:1868795081725952:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782222048.287859:0:10465:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782222048.287883:0:10465:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782222048.287885:0:10465:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1782222048.287893:0:10465:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f0849b46800 00000020:00000080:2.0:1782222048.287896:0:10465:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1782222048.292739:0:10465:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074764aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10465:1868795081726080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782222048.292849:0:10465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222048.292918:0:10465:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087fb75d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782222048.293176:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081726080 00000100:00100000:3.0:1782222048.293186:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081726080 00000100:00100000:3.0:1782222048.293366:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1782222048.293378:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:10465:x1868795081726080:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782222048.293536:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:10465:x1868795081726080:12345-0@lo:502:llog_process_th.0 Request processed in 160us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222048.293545:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1782222048.299265:0:10465:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074764aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10465:1868795081726080:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782222048.299328:0:10465:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782222048.299342:0:10465:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782222048.299345:0:10465:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1782222048.299350:0:10465:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1782222048.299705:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1782222048.299736:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782222048.299752:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb82a00/0xe2b7cc26e681130b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811312 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222048.299767:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f087fb82a00/0xe2b7cc26e681130b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811312 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782222048.299794:0:6523:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782222048.299798:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f08490d0000 from 4 10000000:01000000:0.0:1782222048.299801:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782222048.299847:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e6811319 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222048.299855:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e6811319 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222048.299877:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e6811319 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222048.299907:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087701bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081726208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782222048.299992:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222048.300054:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08514969c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782222048.300310:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081726208 00000100:00100000:2.0:1782222048.300319:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081726208 00000100:00100000:2.0:1782222048.300387:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1782222048.300397:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:6523:x1868795081726208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782222048.300414:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222048.300430:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f087fb83e00/0xe2b7cc26e6811320 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6811319 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222048.300459:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fb83e00/0xe2b7cc26e6811320 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6811319 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222048.300470:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f087fb83e00/0xe2b7cc26e6811320 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6811319 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222048.301175:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb83e00, rc 0) 00000100:00100000:2.0:1782222048.301281:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:6523:x1868795081726208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 883us (1287us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222048.301289:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1782222048.301405:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087701bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081726208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782222048.301427:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e6811319 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811320 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222048.301438:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e6811319 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6811320 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222048.301588:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087701bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081726336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782222048.301621:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222048.301651:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08514969c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782222048.301697:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081726336 00000100:00100000:2.0:1782222048.301703:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081726336 00000100:00100000:2.0:1782222048.301746:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1782222048.301753:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:6523:x1868795081726336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782222048.301895:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:6523:x1868795081726336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222048.301901:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1782222048.301932:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087701bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081726336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782222048.301963:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074764aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081726464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782222048.303306:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222048.303403:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087fb753c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782222048.305420:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081726464 00000100:00100000:0.0:1782222048.305442:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081726464 00000100:00100000:0.0:1782222048.305537:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1782222048.305550:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:6523:x1868795081726464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782222048.305843:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:6523:x1868795081726464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 295us (3825us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222048.305852:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1782222048.305930:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074764aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081726464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782222048.314357:0:10468:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074764aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10468:1868795081726592:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782222048.314463:0:10468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222048.314530:0:10468:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087fb75e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782222048.314555:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081726592 00000100:00100000:0.0:1782222048.314566:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081726592 00000100:00100000:0.0:1782222048.314646:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1782222048.314661:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:10468:x1868795081726592:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782222048.314834:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:10468:x1868795081726592:12345-0@lo:502:llog_process_th.0 Request processed in 177us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222048.314845:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1782222048.314910:0:10468:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074764aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10468:1868795081726592:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782222048.314947:0:10468:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782222048.314959:0:10468:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782222048.314962:0:10468:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1782222048.314977:0:10468:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f08490d0000 00000020:00000080:2.0:1782222048.314980:0:10468:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1782222048.315270:0:10468:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074764aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10468:1868795081726720:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782222048.315314:0:10468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222048.315338:0:10468:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087fb75e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782222048.315466:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081726720 00000100:00100000:0.0:1782222048.315472:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081726720 00000100:00100000:0.0:1782222048.315517:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1782222048.315530:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:10468:x1868795081726720:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782222048.315672:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:10468:x1868795081726720:12345-0@lo:502:llog_process_th.0 Request processed in 144us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222048.315680:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1782222048.315806:0:10468:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074764aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:10468:1868795081726720:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782222048.315835:0:10468:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782222048.315842:0:10468:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782222048.315843:0:10468:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1782222048.315848:0:10468:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1782222048.316002:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1782222048.316029:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782222048.316040:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e6811319 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811320 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222048.316051:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e6811319 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811320 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222048.813788:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222049.259442:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747649f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081726848:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782222049.259512:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222049.259584:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081726848 00000100:00100000:2.0:1782222049.259593:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081726848 00000100:00100000:2.0:1782222049.259655:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1782222049.259665:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074764b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081726848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782222049.259701:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1782222049.259752:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074764b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081726848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222049.259760:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1782222049.259812:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747649f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081726848:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782222049.261527:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782222049.261555:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081726976:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782222049.261630:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222049.265560:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081726976 00000100:00100000:0.0:1782222049.265582:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081726976 00000100:00100000:0.0:1782222049.265666:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782222049.265679:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f914e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081726976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782222049.265734:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1782222049.265874:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f914e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081726976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 182us (4233us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222049.265882:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1782222049.266659:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081726976:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782222049.772766:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782222049.772798:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747649f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081727104:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782222049.772905:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222049.774149:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081727104 00000100:00100000:2.0:1782222049.774165:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081727104 00000100:00100000:2.0:1782222049.774279:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1782222049.774292:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877018380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081727104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782222049.774335:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782222049.774437:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877018380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081727104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 140us (1525us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222049.774446:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1782222049.774540:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782222049.774878:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081727232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782222049.774934:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222049.775120:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081727232 00000100:00100000:0.0:1782222049.775126:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081727232 00000100:00100000:0.0:1782222049.775174:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1782222049.775182:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f917800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081727232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782222049.775197:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782222049.775259:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f917800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081727232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222049.775266:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1782222049.775313:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747649f80 x1868795081727104/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222065 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222049.775335:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747649f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081727104:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1782222049.776102:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782222049.776142:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074751f800 x1868795081727232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222065 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222049.776161:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081727232:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782222049.834578:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222050.858907:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222051.882527:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222052.842518:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081727488:0@lo:400:kworker.0 00000100:00100000:3.0:1782222052.842593:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222052.842648:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1868795081728000:0@lo:400:kworker.0 00000100:00100000:3.0:1782222052.842674:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222052.842696:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1868795081728512:0@lo:400:kworker.0 00000100:00100000:3.0:1782222052.842720:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222052.842760:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1782222052.842766:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081727616:0@lo:400:kworker.0 00000100:00100000:3.0:1782222052.842791:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222052.842815:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1868795081728128:0@lo:400:kworker.0 00000100:00100000:3.0:1782222052.842848:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222052.842867:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1868795081728640:0@lo:400:kworker.0 00000100:00100000:3.0:1782222052.842888:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222052.842916:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081727488 00000100:00100000:3.0:1782222052.842923:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081727488 00000100:00100000:3.0:1782222052.842959:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081728000 00000100:00100000:3.0:1782222052.842962:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081728000 00000100:00100000:3.0:1782222052.842986:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081728512 00000100:00100000:3.0:1782222052.842989:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081728512 00000100:00100000:3.0:1782222052.843001:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081728128 00000100:00100000:3.0:1782222052.843003:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081728128 00000100:00100000:3.0:1782222052.843014:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081728640 00000100:00100000:3.0:1782222052.843017:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081728640 00000100:00100000:3.0:1782222052.843029:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1782222052.843037:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074751ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081727488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222052.843088:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074751ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081727488:12345-0@lo:400:kworker.0 Request processed in 51us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222052.843095:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1782222052.843110:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1782222052.843116:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1868795081728000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222052.843143:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1868795081728000:12345-0@lo:400:kworker.0 Request processed in 27us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222052.843149:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1782222052.843159:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1782222052.843171:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1868795081728512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222052.843202:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1868795081728512:12345-0@lo:400:kworker.0 Request processed in 31us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222052.843208:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1782222052.843220:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1782222052.843226:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b785c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1868795081728128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222052.843272:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b785c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1868795081728128:12345-0@lo:400:kworker.0 Request processed in 47us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222052.843277:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1782222052.843287:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1782222052.843294:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1868795081728640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222052.843318:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1868795081728640:12345-0@lo:400:kworker.0 Request processed in 26us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222052.843324:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1782222052.843347:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081727616 00000100:00100000:3.0:1782222052.843351:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081727616 00000100:00100000:3.0:1782222052.843377:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782222052.843384:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b786a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081727616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222052.843416:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b786a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081727616:12345-0@lo:400:kworker.0 Request processed in 33us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222052.843421:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1782222052.843440:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782222052.843444:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782222052.843474:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081727616:0@lo:400:kworker.0 00010000:00080000:3.0:1782222052.843489:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074751ed80 x1868795081728128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222052.843513:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1868795081728128:0@lo:400:kworker.0 00010000:00080000:3.0:1782222052.843527:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074751fb80 x1868795081728640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222052.843537:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1868795081728640:0@lo:400:kworker.0 00000100:00100000:3.0:1782222052.843551:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081727488:0@lo:400:kworker.0 00000100:00100000:3.0:1782222052.843560:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1868795081728000:0@lo:400:kworker.0 00000100:00100000:3.0:1782222052.843571:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1868795081728512:0@lo:400:kworker.0 00000100:00100000:1.0:1782222052.844283:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081727744:0@lo:400:kworker.0 00000100:00100000:1.0:1782222052.844331:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222052.844368:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081728256:0@lo:400:kworker.0 00000100:00100000:1.0:1782222052.844393:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222052.844421:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081728768:0@lo:400:kworker.0 00000100:00100000:1.0:1782222052.844440:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222052.844459:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1782222052.844466:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081727360:0@lo:400:kworker.0 00000100:00100000:1.0:1782222052.844493:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222052.844522:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1868795081727872:0@lo:400:kworker.0 00000100:00100000:1.0:1782222052.844557:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222052.844575:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081728384:0@lo:400:kworker.0 00000100:00100000:1.0:1782222052.844597:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222052.844612:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081728896:0@lo:400:kworker.0 00000100:00100000:1.0:1782222052.844632:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222052.844659:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081727360 00000100:00100000:1.0:1782222052.844665:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081727360 00000100:00100000:1.0:1782222052.844701:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1782222052.844709:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3655:x1868795081727360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222052.844747:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3655:x1868795081727360:12345-0@lo:400:kworker.0 Request processed in 39us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222052.844753:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1782222052.844782:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081727872 00000100:00100000:1.0:1782222052.844785:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081727872 00000100:00100000:1.0:1782222052.844806:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1782222052.844811:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1868795081727872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222052.844848:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1868795081727872:12345-0@lo:400:kworker.0 Request processed in 37us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222052.844853:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1782222052.845480:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081727360:0@lo:400:kworker.0 00000100:00100000:1.0:1782222052.845500:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1868795081727872:0@lo:400:kworker.0 00000100:00100000:2.0:1782222052.848527:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081727744 00000100:00100000:2.0:1782222052.848540:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081727744 00000100:00100000:2.0:1782222052.848606:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1782222052.848615:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081727744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222052.848703:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081727744:12345-0@lo:400:kworker.0 Request processed in 89us (4371us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222052.848710:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1782222052.848733:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081728256 00000100:00100000:2.0:1782222052.848736:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081728256 00000100:00100000:2.0:1782222052.848760:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081728768 00000100:00100000:2.0:1782222052.848763:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081728768 00000100:00100000:2.0:1782222052.848774:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081728384 00000100:00100000:2.0:1782222052.848777:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081728384 00000100:00100000:2.0:1782222052.848787:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081728896 00000100:00100000:2.0:1782222052.848789:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081728896 00000100:00100000:2.0:1782222052.848803:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782222052.848808:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081728256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222052.848845:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081728256:12345-0@lo:400:kworker.0 Request processed in 37us (4451us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222052.848852:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782222052.848863:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782222052.848868:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081728768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222052.848907:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081728768:12345-0@lo:400:kworker.0 Request processed in 39us (4466us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222052.848913:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782222052.848925:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782222052.848930:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081728384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222052.848957:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081728384:12345-0@lo:400:kworker.0 Request processed in 27us (4360us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222052.848962:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782222052.848982:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782222052.848987:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081728896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222052.849014:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081728896:12345-0@lo:400:kworker.0 Request processed in 28us (4382us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222052.849020:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1782222052.849048:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782222052.849052:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782222052.849088:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074751d880 x1868795081728384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222052.849102:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081728384:0@lo:400:kworker.0 00010000:00080000:2.0:1782222052.849114:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074751d180 x1868795081728896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222052.849122:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081728896:0@lo:400:kworker.0 00000100:00100000:2.0:1782222052.849133:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081727744:0@lo:400:kworker.0 00010000:00080000:2.0:1782222052.849143:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074751ce00 x1868795081728256/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222052.849150:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081728256:0@lo:400:kworker.0 00010000:00080000:2.0:1782222052.849160:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074751f800 x1868795081728768/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222052.849167:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081728768:0@lo:400:kworker.0 00010000:00010000:3.0:1782222052.913381:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222053.322199:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222053.322273:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222053.322298:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222053.322318:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222053.322339:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222053.322367:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060691712 00000100:00100000:3.0:1782222053.322376:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060691712 00000100:00100000:3.0:1782222053.322427:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060691584 00000100:00100000:3.0:1782222053.322430:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060691584 00000100:00100000:3.0:1782222053.322452:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 88 00000100:00100000:3.0:1782222053.322461:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074751f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:2388:x1868795060691712:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222053.322527:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074751f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:2388:x1868795060691712:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 67us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222053.322535:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 88 00000100:00100000:3.0:1782222053.322550:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 89 00000100:00100000:3.0:1782222053.322568:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074751ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+6:2388:x1868795060691584:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222053.322591:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074751ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+6:2388:x1868795060691584:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 24us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222053.322597:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 89 00000100:00100000:3.0:1782222053.322618:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060691840 00000100:00100000:3.0:1782222053.322621:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060691840 00000100:00100000:3.0:1782222053.322642:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060691968 00000100:00100000:3.0:1782222053.322645:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060691968 00000100:00100000:3.0:1782222053.322663:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 18 00000100:00100000:3.0:1782222053.322668:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074751e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+5:2386:x1868795060691840:12345-192.168.203.27@tcp:9:kworker.0 00000020:00000080:3.0:1782222053.322691:0:8442:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6811232 00000100:00080000:3.0:1782222053.322700:0:8442:0:(import.c:65:import_set_state_nolock()) ffff8f07415ba800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782222053.322740:0:8442:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1782222053.322876:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074751e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+2:2386:x1868795060691840:12345-192.168.203.27@tcp:9:kworker.0 Request processed in 207us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222053.322883:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 18 00000100:00100000:3.0:1782222053.322895:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 19 00000100:00100000:3.0:1782222053.322900:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074751d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+5:2386:x1868795060691968:12345-192.168.203.27@tcp:9:kworker.0 00000020:00000080:3.0:1782222053.322913:0:8442:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6811239 00000100:00080000:3.0:1782222053.322918:0:8442:0:(import.c:65:import_set_state_nolock()) ffff8f0843caa000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782222053.322941:0:8442:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1782222053.323002:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074751d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+2:2386:x1868795060691968:12345-192.168.203.27@tcp:9:kworker.0 Request processed in 101us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222053.323009:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 19 00000100:00080000:3.0:1782222053.323027:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782222053.323031:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782222053.323039:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782222053.323041:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1782222053.323201:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222053.323207:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222053.327412:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060691456 00000100:00100000:2.0:1782222053.327426:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060691456 00000100:00100000:2.0:1782222053.327501:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 280 00000100:00100000:2.0:1782222053.327511:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:2388:x1868795060691456:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222053.327601:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:2388:x1868795060691456:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 92us (5451us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222053.327609:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 280 00000100:00100000:0.0:1782222053.357222:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782222053.357258:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087701b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081729024:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782222053.357328:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222053.357375:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081729024 00000100:00100000:0.0:1782222053.357382:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081729024 00000100:00100000:0.0:1782222053.357428:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1782222053.357437:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087701bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081729024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782222053.357467:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782222053.357509:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087701bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081729024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222053.357516:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1782222053.357553:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f087701b800 x1868795081729024/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222069 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222053.357569:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087701b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081729024:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782222053.358196:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081729152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782222053.358227:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222053.358446:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081729152 00000100:00100000:3.0:1782222053.358453:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081729152 00000100:00100000:3.0:1782222053.358487:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782222053.358494:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087701b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081729152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782222053.358506:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222053.358549:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087701b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081729152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222053.358556:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1782222053.358586:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074751d880 x1868795081729152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222069 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222053.358601:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081729152:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782222053.940724:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782222054.149304:0:10704:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg327-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:1.0:1782222054.378554:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081729280:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782222054.378627:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222054.378775:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081729280 00000100:00100000:2.0:1782222054.378784:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081729280 00000100:00100000:2.0:1782222054.378850:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1782222054.378860:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081729280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782222054.378895:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1782222054.378939:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081729280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222054.378946:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1782222054.379171:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081729408:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782222054.379203:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222054.379312:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081729408 00000100:00100000:1.0:1782222054.379317:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081729408 00000100:00100000:1.0:1782222054.379342:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1782222054.379349:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087701a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081729408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782222054.379368:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1782222054.379410:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087701a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081729408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222054.379416:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1782222054.379454:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081729280:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782222054.379563:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081729408:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782222054.890405:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782222054.890437:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081729536:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782222054.890529:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222054.890608:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081729536 00000100:00100000:0.0:1782222054.890618:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081729536 00000100:00100000:0.0:1782222054.890679:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782222054.890690:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747294700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081729536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782222054.890730:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782222054.890787:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747294700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081729536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222054.890794:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1782222054.890826:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782222054.890863:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747294a80 x1868795081729536/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222070 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222054.890885:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081729536:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782222054.891799:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782222054.891826:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081729664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782222054.891882:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222054.891920:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081729664 00000100:00100000:0.0:1782222054.891926:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081729664 00000100:00100000:0.0:1782222054.891994:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1782222054.892002:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747297480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081729664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782222054.892021:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782222054.892064:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747297480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081729664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222054.892070:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1782222054.892088:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782222054.892120:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747294a80 x1868795081729664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222070 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222054.892136:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081729664:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782222054.954488:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222055.978534:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222057.003218:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222057.963556:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081729792:0@lo:400:kworker.0 00000100:00100000:2.0:1782222057.963627:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222057.963864:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782222057.963871:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1868795081729920:0@lo:400:kworker.0 00000100:00100000:2.0:1782222057.963900:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222057.963945:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081729792 00000100:00100000:2.0:1782222057.963952:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081729792 00000100:00100000:2.0:1782222057.963994:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1782222057.964001:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3655:x1868795081729792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222057.964052:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3655:x1868795081729792:12345-0@lo:400:kworker.0 Request processed in 50us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222057.964059:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1782222057.964104:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081729792:0@lo:400:kworker.0 00000100:00100000:1.0:1782222057.964163:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081729920 00000100:00100000:1.0:1782222057.964168:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081729920 00000100:00100000:1.0:1782222057.964205:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1782222057.964211:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1868795081729920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222057.964268:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1868795081729920:12345-0@lo:400:kworker.0 Request processed in 57us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222057.964274:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1782222057.964344:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1868795081729920:0@lo:400:kworker.0 00000100:00100000:1.0:1782222057.964518:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081730048:0@lo:400:kworker.0 00000100:00100000:1.0:1782222057.964548:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222057.964603:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081730048 00000100:00100000:2.0:1782222057.964608:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081730048 00000100:00100000:2.0:1782222057.964634:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1782222057.964652:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081730048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222057.964812:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081730048:12345-0@lo:400:kworker.0 Request processed in 160us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222057.964820:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1782222057.964904:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1868795081730304:0@lo:400:kworker.0 00000100:00100000:2.0:1782222057.964931:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222057.965041:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782222057.965048:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1868795081730432:0@lo:400:kworker.0 00000100:00100000:2.0:1782222057.965071:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222057.965098:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081730304 00000100:00100000:2.0:1782222057.965101:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081730304 00000100:00100000:2.0:1782222057.965125:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081730432 00000100:00100000:2.0:1782222057.965127:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081730432 00000100:00100000:2.0:1782222057.965153:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1782222057.965159:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074764ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1868795081730304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222057.965193:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074764ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1868795081730304:12345-0@lo:400:kworker.0 Request processed in 34us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222057.965199:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1782222057.965209:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1782222057.965215:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1868795081730432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222057.965270:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1868795081730432:12345-0@lo:400:kworker.0 Request processed in 55us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222057.965276:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:2.0:1782222057.965307:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782222057.965345:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1868795081730432:0@lo:400:kworker.0 00000100:00100000:2.0:1782222057.965355:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1868795081730304:0@lo:400:kworker.0 00000100:00100000:1.0:1782222057.965434:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081730048:0@lo:400:kworker.0 00000100:00100000:1.0:1782222057.965445:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782222057.965450:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081730176:0@lo:400:kworker.0 00000100:00100000:1.0:1782222057.965475:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222057.965542:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081730176 00000100:00100000:2.0:1782222057.965547:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081730176 00000100:00100000:2.0:1782222057.965574:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1782222057.965581:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081730176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222057.965617:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081730176:12345-0@lo:400:kworker.0 Request processed in 37us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222057.965624:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1782222057.965821:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081730176:0@lo:400:kworker.0 00000100:00100000:2.0:1782222057.970529:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1868795081730560:0@lo:400:kworker.0 00000100:00100000:2.0:1782222057.970607:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222057.970737:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081730560 00000100:00100000:1.0:1782222057.970745:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081730560 00000100:00100000:1.0:1782222057.970810:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1782222057.970820:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074764bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1868795081730560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222057.973038:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074764bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1868795081730560:12345-0@lo:400:kworker.0 Request processed in 2212us (2423us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222057.973051:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:1.0:1782222057.973095:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1782222057.973271:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074751ed80 x1868795081730560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222057.973286:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1868795081730560:0@lo:400:kworker.0 00000100:00100000:2.0:1782222057.973308:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782222057.973318:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081730688:0@lo:400:kworker.0 00000100:00100000:2.0:1782222057.973368:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222057.973405:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081730688 00000100:00100000:2.0:1782222057.973412:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081730688 00000100:00100000:2.0:1782222057.973454:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1782222057.973462:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081730688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222057.973507:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081730688:12345-0@lo:400:kworker.0 Request processed in 45us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222057.973521:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1782222057.973592:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782222057.973611:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074751f480 x1868795081730688/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222057.973620:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081730688:0@lo:400:kworker.0 00000100:00100000:3.0:1782222057.975155:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782222057.975173:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081730816:0@lo:400:kworker.0 00000100:00100000:3.0:1782222057.975223:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222057.975275:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081730816 00000100:00100000:3.0:1782222057.975281:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081730816 00000100:00100000:3.0:1782222057.975323:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782222057.975330:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074751ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081730816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222057.975373:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074751ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081730816:12345-0@lo:400:kworker.0 Request processed in 43us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222057.975381:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1782222057.975424:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074751f480 x1868795081730816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222057.975437:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081730816:0@lo:400:kworker.0 00000100:00100000:3.0:1782222057.975468:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1868795081730944:0@lo:400:kworker.0 00000100:00100000:3.0:1782222057.975492:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222057.975551:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782222057.975557:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081731328:0@lo:400:kworker.0 00000100:00100000:3.0:1782222057.975579:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222057.975816:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081730944 00000100:00100000:2.0:1782222057.975820:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081730944 00000100:00100000:2.0:1782222057.975862:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1782222057.975869:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074751e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1868795081730944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222057.975908:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074751e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1868795081730944:12345-0@lo:400:kworker.0 Request processed in 40us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222057.975914:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1782222057.975932:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081731200:0@lo:400:kworker.0 00000100:00100000:2.0:1782222057.975955:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222057.975974:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782222057.975979:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1868795081731072:0@lo:400:kworker.0 00000100:00100000:2.0:1782222057.975998:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222057.976028:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1868795081730944:0@lo:400:kworker.0 00000100:00100000:2.0:1782222057.976046:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081731328 00000100:00100000:2.0:1782222057.976049:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081731328 00000100:00100000:2.0:1782222057.976071:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081731200 00000100:00100000:2.0:1782222057.976073:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081731200 00000100:00100000:2.0:1782222057.976089:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782222057.976095:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074751c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081731328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222057.976126:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074751c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081731328:12345-0@lo:400:kworker.0 Request processed in 31us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222057.976138:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782222057.976151:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782222057.976156:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747648e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081731200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222057.976186:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747648e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081731200:12345-0@lo:400:kworker.0 Request processed in 30us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222057.976192:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1782222057.976219:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074751fb80 x1868795081731328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222057.976230:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081731328:0@lo:400:kworker.0 00000100:00080000:2.0:1782222057.976266:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782222057.976270:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782222057.976272:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782222057.976286:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074751d500 x1868795081731200/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222057.976295:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081731200:0@lo:400:kworker.0 00000100:00100000:3.0:1782222057.976384:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081731072 00000100:00100000:3.0:1782222057.976388:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081731072 00000100:00100000:3.0:1782222057.976419:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1782222057.976426:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1868795081731072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222057.976461:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1868795081731072:12345-0@lo:400:kworker.0 Request processed in 36us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222057.976467:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:2.0:1782222057.976515:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1782222057.976532:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074751df80 x1868795081731072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222057.976603:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1868795081731072:0@lo:400:kworker.0 00010000:00010000:0.0:1782222058.027037:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222058.410465:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222058.410511:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222058.410533:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222058.410566:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060692352 00000100:00100000:3.0:1782222058.410575:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060692352 00000100:00100000:3.0:1782222058.410626:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060692224 00000100:00100000:3.0:1782222058.410630:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060692224 00000100:00100000:3.0:1782222058.410651:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 96 00000100:00100000:3.0:1782222058.410660:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074751f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+5:2389:x1868795060692352:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222058.410731:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074751f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+5:2389:x1868795060692352:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 71us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222058.410754:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 96 00000100:00100000:3.0:1782222058.410771:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 97 00000100:00100000:3.0:1782222058.410778:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074751d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+6:2389:x1868795060692224:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222058.410816:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074751d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+6:2389:x1868795060692224:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 38us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222058.410822:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 97 00000100:00100000:2.0:1782222058.411322:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060692096 00000100:00100000:2.0:1782222058.411328:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060692096 00000100:00100000:2.0:1782222058.411367:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 282 00000100:00100000:2.0:1782222058.411375:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:2389:x1868795060692096:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222058.411416:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:2389:x1868795060692096:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 42us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222058.411442:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 282 00000100:00080000:2.0:1782222058.411475:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782222058.411480:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782222058.474383:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782222058.474407:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081731456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782222058.474470:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222058.474517:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081731456 00000100:00100000:1.0:1782222058.474524:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081731456 00000100:00100000:1.0:1782222058.474579:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782222058.474588:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081731456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782222058.474617:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782222058.474658:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081731456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222058.474665:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1782222058.474706:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0849b14000 x1868795081731456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222074 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222058.474722:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081731456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782222058.475044:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074764aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081731584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782222058.475077:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222058.476639:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081731584 00000100:00100000:1.0:1782222058.476651:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081731584 00000100:00100000:1.0:1782222058.476697:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782222058.476706:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074751df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081731584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782222058.476727:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782222058.480272:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074751df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081731584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3558us (5185us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222058.480286:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1782222058.486974:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074764aa00 x1868795081731584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222074 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222058.486999:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074764aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081731584:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1782222058.999531:0:9523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 77bf2c2c-f408-43f9-ae59-449550631d05 00000020:00000080:2.0:1782222058.999545:0:9523:0:(genops.c:906:class_export_put()) final put ffff8f0843cab000/77bf2c2c-f408-43f9-ae59-449550631d05 00000020:00000080:3.0:1782222058.999606:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0843cab000/77bf2c2c-f408-43f9-ae59-449550631d05 for lustre-OST0001 00000020:00000080:3.0:1782222058.999679:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f0843caa000 for lustre-OST0001 00000001:00100000:1.0:1782222059.005647:0:8436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 77bf2c2c-f408-43f9-ae59-449550631d05 00000020:00000080:1.0:1782222059.005656:0:8436:0:(genops.c:906:class_export_put()) final put ffff8f07415bd000/77bf2c2c-f408-43f9-ae59-449550631d05 00000020:00000080:3.0:1782222059.005888:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff8f07415bd000/77bf2c2c-f408-43f9-ae59-449550631d05 for lustre-OST0000 00000020:00000080:3.0:1782222059.005937:0:491:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f07415ba800 for lustre-OST0000 00010000:00010000:0.0:1782222059.051797:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222059.498832:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782222059.498870:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081731712:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782222059.498986:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222059.499156:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081731712 00000100:00100000:2.0:1782222059.499168:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081731712 00000100:00100000:2.0:1782222059.499255:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1782222059.499266:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081731712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782222059.499311:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1782222059.499374:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081731840:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782222059.499386:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081731712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222059.499394:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782222059.499414:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222059.499459:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081731712:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782222059.499630:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081731840 00000100:00100000:0.0:1782222059.499635:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081731840 00000100:00100000:0.0:1782222059.499668:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1782222059.499676:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081731840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782222059.499696:0:7480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1782222059.504586:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081731840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4898us (5160us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222059.504607:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782222059.505010:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081731840:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1782222059.684388:0:10948:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg327-server.virtnet: executing yml_node 00000100:00100000:1.0:1782222060.012197:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081731968:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782222060.012340:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222060.012438:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081731968 00000100:00100000:1.0:1782222060.012449:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081731968 00000100:00100000:1.0:1782222060.012512:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782222060.012536:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081731968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782222060.012573:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782222060.012627:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081731968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222060.012635:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1782222060.012664:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782222060.012869:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0849b14e00 x1868795081731968/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222076 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222060.012890:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081731968:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782222060.013141:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081732096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782222060.013180:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222060.013283:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081732096 00000100:00100000:3.0:1782222060.013288:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081732096 00000100:00100000:3.0:1782222060.013334:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782222060.013343:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747294a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081732096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782222060.013358:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222060.013398:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747294a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081732096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222060.013405:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1782222060.013437:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074751d500 x1868795081732096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222076 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222060.013466:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081732096:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782222060.013623:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782222060.074609:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222061.048099:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081732608:0@lo:400:kworker.0 00000100:00100000:0.0:1782222061.048167:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222061.048218:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081733120:0@lo:400:kworker.0 00000100:00100000:0.0:1782222061.048261:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222061.048286:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081733632:0@lo:400:kworker.0 00000100:00100000:0.0:1782222061.048306:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222061.048330:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1782222061.048335:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081732224:0@lo:400:kworker.0 00000100:00100000:0.0:1782222061.048358:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222061.048378:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1868795081732736:0@lo:400:kworker.0 00000100:00100000:0.0:1782222061.048413:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222061.048432:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081733248:0@lo:400:kworker.0 00000100:00100000:0.0:1782222061.048462:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222061.048480:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081733760:0@lo:400:kworker.0 00000100:00100000:0.0:1782222061.048499:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222061.048525:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1868795081732352:0@lo:400:kworker.0 00000100:00100000:0.0:1782222061.048550:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222061.048564:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1868795081732864:0@lo:400:kworker.0 00000100:00100000:0.0:1782222061.048582:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222061.048594:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1868795081733376:0@lo:400:kworker.0 00000100:00100000:0.0:1782222061.048616:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222061.048635:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1782222061.048639:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081732480:0@lo:400:kworker.0 00000100:00100000:0.0:1782222061.048659:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222061.048672:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1868795081732992:0@lo:400:kworker.0 00000100:00100000:0.0:1782222061.048689:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222061.048698:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1868795081733504:0@lo:400:kworker.0 00000100:00100000:0.0:1782222061.048713:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222061.048737:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081732608 00000100:00100000:0.0:1782222061.048745:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081732608 00000100:00100000:0.0:1782222061.048799:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081732480 00000100:00100000:0.0:1782222061.048803:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081732480 00000100:00100000:0.0:1782222061.048821:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1782222061.048829:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081732608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222061.048881:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081732608:12345-0@lo:400:kworker.0 Request processed in 52us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222061.048888:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1782222061.048914:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1782222061.048920:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081732480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222061.048956:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081732480:12345-0@lo:400:kworker.0 Request processed in 36us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222061.048962:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1782222061.048980:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081733120 00000100:00100000:0.0:1782222061.048983:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081733120 00000100:00100000:0.0:1782222061.049001:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081733632 00000100:00100000:0.0:1782222061.049003:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081733632 00000100:00100000:0.0:1782222061.049023:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081733248 00000100:00100000:0.0:1782222061.049026:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081733248 00000100:00100000:0.0:1782222061.049036:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081733760 00000100:00100000:0.0:1782222061.049038:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081733760 00000100:00100000:0.0:1782222061.049051:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1782222061.049056:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747747100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081733120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222061.049087:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747747100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081733120:12345-0@lo:400:kworker.0 Request processed in 31us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222061.049093:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1782222061.049104:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1782222061.049110:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747746300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081733632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222061.049134:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747746300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081733632:12345-0@lo:400:kworker.0 Request processed in 24us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222061.049139:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1782222061.049148:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1782222061.049153:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081733248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222061.049173:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081733248:12345-0@lo:400:kworker.0 Request processed in 20us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222061.049186:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1782222061.049196:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1782222061.049202:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747745880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081733760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222061.049228:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747745880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081733760:12345-0@lo:400:kworker.0 Request processed in 26us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222061.049254:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1782222061.049273:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081732224 00000100:00100000:0.0:1782222061.049276:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081732224 00000100:00100000:0.0:1782222061.049297:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1782222061.049303:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3653:x1868795081732224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222061.049326:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3653:x1868795081732224:12345-0@lo:400:kworker.0 Request processed in 24us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222061.049332:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1782222061.049355:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081732736 00000100:00100000:0.0:1782222061.049358:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081732736 00000100:00100000:0.0:1782222061.049372:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081732352 00000100:00100000:0.0:1782222061.049374:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081732352 00000100:00100000:0.0:1782222061.049381:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081732864 00000100:00100000:0.0:1782222061.049383:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081732864 00000100:00100000:0.0:1782222061.049393:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081733376 00000100:00100000:0.0:1782222061.049396:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081733376 00000100:00100000:0.0:1782222061.049406:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081732992 00000100:00100000:0.0:1782222061.049409:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081732992 00000100:00100000:0.0:1782222061.049418:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081733504 00000100:00100000:0.0:1782222061.049420:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081733504 00000100:00100000:0.0:1782222061.049430:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1782222061.049435:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1868795081732736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222061.049459:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1868795081732736:12345-0@lo:400:kworker.0 Request processed in 24us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222061.049470:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1782222061.049481:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1782222061.049486:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1868795081732352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222061.049514:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1868795081732352:12345-0@lo:400:kworker.0 Request processed in 28us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222061.049519:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1782222061.049528:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1782222061.049534:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1868795081732864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222061.049562:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1868795081732864:12345-0@lo:400:kworker.0 Request processed in 29us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222061.049568:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1782222061.049577:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1782222061.049583:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1868795081733376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222061.049606:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1868795081733376:12345-0@lo:400:kworker.0 Request processed in 24us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222061.049612:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1782222061.049621:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1782222061.049626:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1868795081732992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222061.049648:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1868795081732992:12345-0@lo:400:kworker.0 Request processed in 23us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222061.049653:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1782222061.049662:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1782222061.049666:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1868795081733504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222061.049685:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1868795081733504:12345-0@lo:400:kworker.0 Request processed in 19us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222061.049695:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:0.0:1782222061.049721:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782222061.049724:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782222061.049727:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782222061.049779:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081732480:0@lo:400:kworker.0 00010000:00080000:0.0:1782222061.049793:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0877155880 x1868795081732992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222061.049803:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1868795081732992:0@lo:400:kworker.0 00010000:00080000:0.0:1782222061.049811:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0877157b80 x1868795081733504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222061.049819:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1868795081733504:0@lo:400:kworker.0 00000100:00100000:0.0:1782222061.049828:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1868795081732352:0@lo:400:kworker.0 00000100:00100000:0.0:1782222061.049835:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1868795081732864:0@lo:400:kworker.0 00000100:00100000:0.0:1782222061.049844:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1868795081733376:0@lo:400:kworker.0 00000100:00100000:0.0:1782222061.049877:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081732224:0@lo:400:kworker.0 00000100:00100000:0.0:1782222061.049886:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1868795081732736:0@lo:400:kworker.0 00010000:00080000:0.0:1782222061.049895:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0877156d80 x1868795081733248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222061.049904:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081733248:0@lo:400:kworker.0 00010000:00080000:0.0:1782222061.049912:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747747480 x1868795081733760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222061.049932:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081733760:0@lo:400:kworker.0 00000100:00100000:0.0:1782222061.049946:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081732608:0@lo:400:kworker.0 00010000:00080000:0.0:1782222061.049955:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0877157480 x1868795081733120/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222061.049963:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081733120:0@lo:400:kworker.0 00010000:00080000:0.0:1782222061.049972:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0877154380 x1868795081733632/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222061.049981:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081733632:0@lo:400:kworker.0 00010000:00010000:2.0:1782222061.098355:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222062.122477:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222063.149893:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222063.529484:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222063.529528:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222063.529563:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222063.529604:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060692736 00000100:00100000:0.0:1782222063.529615:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060692736 00000100:00100000:0.0:1782222063.529686:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060692608 00000100:00100000:0.0:1782222063.529690:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060692608 00000100:00100000:0.0:1782222063.529718:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 104 00000100:00100000:0.0:1782222063.529728:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074751d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060692736:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222063.529774:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060692480 00000100:00100000:1.0:1782222063.529780:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060692480 00000100:00100000:1.0:1782222063.529812:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 284 00000100:00100000:0.0:1782222063.529819:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074751d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060692736:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 89us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222063.529825:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:2390:x1868795060692480:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222063.529858:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:2390:x1868795060692480:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 33us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222063.529865:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 284 00000100:00080000:3.0:1782222063.529879:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782222063.529885:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782222063.531664:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 105 00000100:00100000:2.0:1782222063.531686:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074751fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+6:2390:x1868795060692608:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222063.531793:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074751fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+6:2390:x1868795060692608:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 118us (2228us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222063.531801:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 105 00000100:00100000:0.0:1782222063.533367:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 104 00000100:00100000:2.0:1782222063.594635:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782222063.594660:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081733888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782222063.594729:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222063.594880:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081733888 00000100:00100000:1.0:1782222063.594888:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081733888 00000100:00100000:1.0:1782222063.594953:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782222063.594964:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081733888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782222063.594998:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782222063.595049:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081733888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222063.595057:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1782222063.595070:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0849b14e00 x1868795081733888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222079 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222063.595093:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081733888:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1782222063.598148:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782222063.598436:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081734016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782222063.598522:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222063.598599:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081734016 00000100:00100000:1.0:1782222063.598608:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081734016 00000100:00100000:1.0:1782222063.598678:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1782222063.598687:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747747480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081734016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782222063.598709:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782222063.598771:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747747480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081734016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222063.598779:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1782222063.598820:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747648000 x1868795081734016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222079 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782222063.598846:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782222063.598855:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081734016:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782222064.171815:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222064.622549:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782222064.622581:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081734144:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782222064.622694:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222064.622792:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081734144 00000100:00100000:2.0:1782222064.622802:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081734144 00000100:00100000:1.0:1782222064.623026:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081734272:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782222064.623062:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222064.623096:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081734272 00000100:00100000:1.0:1782222064.623107:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081734272 00000100:00100000:1.0:1782222064.623156:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1782222064.623166:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07465e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081734272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782222064.623224:0:7480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1782222064.623346:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1782222064.623353:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074764aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081734144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782222064.623375:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1782222064.623671:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074764aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081734144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 317us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222064.623678:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1782222064.623736:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07465e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081734272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 570us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222064.623751:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1782222064.624014:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081734272:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782222064.624056:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081734144:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782222065.131176:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782222065.131198:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081734400:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782222065.131280:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222065.131350:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081734400 00000100:00100000:2.0:1782222065.131357:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081734400 00000100:00100000:2.0:1782222065.131407:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1782222065.131415:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081734400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782222065.131446:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782222065.131487:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081734400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222065.131493:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1782222065.131512:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782222065.131539:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07465e0000 x1868795081734400/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222081 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222065.131555:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081734400:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782222065.147164:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081734528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782222065.147256:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222065.147530:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081734528 00000100:00100000:0.0:1782222065.147539:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081734528 00000100:00100000:0.0:1782222065.147599:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1782222065.147608:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07465e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081734528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782222065.147629:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782222065.147684:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07465e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081734528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222065.147692:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1782222065.147719:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782222065.147759:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747746a00 x1868795081734528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222081 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222065.147776:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081734528:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782222065.195225:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782222065.435176:0:11132:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.83 00000100:00100000:2.0:1782222066.158898:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081734656:0@lo:400:kworker.0 00000100:00100000:2.0:1782222066.158988:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222066.159043:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1868795081735168:0@lo:400:kworker.0 00000100:00100000:2.0:1782222066.159072:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222066.159093:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074767a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081735680:0@lo:400:kworker.0 00000100:00100000:1.0:1782222066.160528:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1868795081734784:0@lo:400:kworker.0 00000100:00100000:1.0:1782222066.160583:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222066.160617:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1868795081735296:0@lo:400:kworker.0 00000100:00100000:1.0:1782222066.160638:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222066.160665:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074767b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1868795081735808:0@lo:400:kworker.0 00000100:00100000:1.0:1782222066.160698:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222066.160758:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782222066.160765:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747678e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081736192:0@lo:400:kworker.0 00000100:00100000:1.0:1782222066.160797:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081735040:0@lo:400:kworker.0 00000100:00100000:1.0:1782222066.160820:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222066.160839:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081735552:0@lo:400:kworker.0 00000100:00100000:1.0:1782222066.160865:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081735168 00000100:00100000:1.0:1782222066.160872:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081735168 00000100:00100000:1.0:1782222066.160921:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081734784 00000100:00100000:1.0:1782222066.160925:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081734784 00000100:00100000:2.0:1782222066.161386:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222066.161437:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081734656 00000100:00100000:2.0:1782222066.161441:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081734656 00000100:00100000:2.0:1782222066.161471:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1782222066.161480:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3653:x1868795081734656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222066.161530:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3653:x1868795081734656:12345-0@lo:400:kworker.0 Request processed in 51us (2543us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222066.161537:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1782222066.161568:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081735296 00000100:00100000:2.0:1782222066.161571:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081735296 00000100:00100000:2.0:1782222066.161597:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081735808 00000100:00100000:2.0:1782222066.161600:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081735808 00000100:00100000:2.0:1782222066.161615:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1782222066.161622:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087719b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1868795081735168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222066.161653:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087719b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1868795081735168:12345-0@lo:400:kworker.0 Request processed in 32us (2581us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222066.161660:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1782222066.161687:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1782222066.161693:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747679f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1868795081735296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222066.161720:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747679f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1868795081735296:12345-0@lo:400:kworker.0 Request processed in 27us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222066.161747:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1782222066.161760:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1782222066.161767:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074767bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1868795081735808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222066.161798:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074767bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1868795081735808:12345-0@lo:400:kworker.0 Request processed in 33us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222066.161803:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1782222066.162200:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081734656:0@lo:400:kworker.0 00000100:00100000:2.0:1782222066.162216:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1868795081735168:0@lo:400:kworker.0 00000100:00100000:0.0:1782222066.162317:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081735680 00000100:00100000:0.0:1782222066.162323:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081735680 00000100:00100000:0.0:1782222066.162363:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1782222066.162370:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877198380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081735680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222066.162413:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877198380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081735680:12345-0@lo:400:kworker.0 Request processed in 44us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222066.162420:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1782222066.162518:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074767a680 x1868795081735680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222066.162530:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074767a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081735680:0@lo:400:kworker.0 00000100:00100000:3.0:1782222066.164206:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081734912:0@lo:400:kworker.0 00000100:00100000:3.0:1782222066.164393:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222066.164432:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1868795081735424:0@lo:400:kworker.0 00000100:00100000:3.0:1782222066.164459:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222066.164477:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074767a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1868795081735936:0@lo:400:kworker.0 00000100:00100000:3.0:1782222066.164497:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222066.164531:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081735424 00000100:00100000:3.0:1782222066.164537:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081735424 00000100:00100000:3.0:1782222066.164568:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081735936 00000100:00100000:3.0:1782222066.164571:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081735936 00000100:00100000:3.0:1782222066.164585:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1782222066.164593:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0875aaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1868795081735424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222066.164647:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0875aaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1868795081735424:12345-0@lo:400:kworker.0 Request processed in 54us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222066.164654:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1782222066.164668:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1782222066.164674:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1868795081735936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222066.165058:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081735040 00000100:00100000:2.0:1782222066.165063:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081735040 00000100:00100000:2.0:1782222066.165097:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081734912 00000100:00100000:2.0:1782222066.165100:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081734912 00000100:00100000:2.0:1782222066.165114:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1782222066.165121:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081735040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222066.165160:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081735040:12345-0@lo:400:kworker.0 Request processed in 39us (4339us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222066.165166:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1782222066.165179:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1782222066.165185:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074751f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081734912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222066.165208:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074751f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081734912:12345-0@lo:400:kworker.0 Request processed in 23us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222066.165214:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1782222066.165443:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782222066.165448:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782222066.165461:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222066.165497:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074767ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081736064:0@lo:400:kworker.0 00000100:00100000:1.0:1782222066.165525:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222066.165562:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081735040:0@lo:400:kworker.0 00000100:00100000:1.0:1782222066.165594:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081735552 00000100:00100000:1.0:1782222066.165597:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081735552 00000100:00100000:1.0:1782222066.165622:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081736064 00000100:00100000:1.0:1782222066.165625:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081736064 00000100:00100000:1.0:1782222066.165648:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1782222066.165654:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081735552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222066.165703:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081735552:12345-0@lo:400:kworker.0 Request processed in 49us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222066.165709:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1782222066.165723:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782222066.165729:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747678000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081736064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222066.165766:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747678000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081736064:12345-0@lo:400:kworker.0 Request processed in 37us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222066.165772:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1782222066.165789:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1782222066.165809:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0849b14e00 x1868795081735552/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222066.165821:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081735552:0@lo:400:kworker.0 00010000:00080000:1.0:1782222066.165829:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074767ad80 x1868795081736064/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222066.165837:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074767ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081736064:0@lo:400:kworker.0 00000100:00100000:1.0:1782222066.165859:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222066.165897:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1868795081735296:0@lo:400:kworker.0 00000100:00100000:1.0:1782222066.165908:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074767b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1868795081735808:0@lo:400:kworker.0 00000100:00100000:1.0:1782222066.165924:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081736192 00000100:00100000:1.0:1782222066.165942:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081736192 00000100:00100000:3.0:1782222066.167332:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1868795081735936:12345-0@lo:400:kworker.0 Request processed in 2652us (2828us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222066.167345:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1782222066.167405:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081734912:0@lo:400:kworker.0 00010000:00080000:3.0:1782222066.167420:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07465e0000 x1868795081735424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222066.167429:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1868795081735424:0@lo:400:kworker.0 00010000:00080000:3.0:1782222066.167438:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074767a300 x1868795081735936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222066.167445:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074767a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1868795081735936:0@lo:400:kworker.0 00000100:00100000:1.0:1782222066.168548:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1782222066.168566:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074767ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081736192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222066.168645:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074767ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081736192:12345-0@lo:400:kworker.0 Request processed in 86us (2783us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222066.168652:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1782222066.168674:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1782222066.172363:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747678e00 x1868795081736192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222066.172381:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747678e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081736192:0@lo:400:kworker.0 00000100:00100000:1.0:1782222066.172468:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1782222066.172477:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747679880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1868795081734784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222066.172567:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747679880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1868795081734784:12345-0@lo:400:kworker.0 Request processed in 91us (11982us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222066.172575:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1782222066.172741:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1868795081734784:0@lo:400:kworker.0 00010000:00010000:3.0:1782222066.218642:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222067.243961:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782222068.010204:0:11229:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.83 00010000:00010000:0.0:1782222068.267421:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222068.649164:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222068.649210:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222068.649257:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222068.649283:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060692864 00000100:00100000:3.0:1782222068.649303:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060692864 00000100:00100000:3.0:1782222068.649359:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 286 00000100:00100000:3.0:1782222068.649368:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:2388:x1868795060692864:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222068.649445:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:2388:x1868795060692864:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 78us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222068.649588:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 286 00000100:00100000:3.0:1782222068.649623:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060692992 00000100:00100000:3.0:1782222068.649627:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060692992 00000100:00100000:3.0:1782222068.649661:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060693120 00000100:00100000:3.0:1782222068.649664:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060693120 00000100:00100000:3.0:1782222068.649687:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 112 00000100:00100000:3.0:1782222068.649694:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088159a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+6:2388:x1868795060692992:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222068.649737:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088159a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+6:2388:x1868795060692992:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 43us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222068.649744:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 112 00000100:00100000:3.0:1782222068.649757:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 113 00000100:00100000:3.0:1782222068.649763:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:2388:x1868795060693120:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222068.649786:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:2388:x1868795060693120:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 23us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222068.649792:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 113 00000100:00080000:0.0:1782222068.650750:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782222068.650756:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782222068.715892:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782222068.715919:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081736320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782222068.716008:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222068.716121:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081736320 00000100:00100000:0.0:1782222068.716128:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081736320 00000100:00100000:0.0:1782222068.716179:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1782222068.716189:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081736320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782222068.716219:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782222068.716277:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081736320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222068.716285:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1782222068.716319:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1782222068.716350:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0881598e00 x1868795081736320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222084 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222068.716367:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081736320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782222068.719481:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081736448:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782222068.719551:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222068.719710:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081736448 00000100:00100000:3.0:1782222068.719727:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081736448 00000100:00100000:3.0:1782222068.719839:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782222068.719849:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081736448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782222068.719873:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222068.719924:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081736448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222068.719932:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1782222068.719981:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0881598e00 x1868795081736448/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222084 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222068.720001:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081736448:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1782222068.720593:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782222069.290471:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782222069.738411:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747678e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081736576:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782222069.738479:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782222069.738496:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087719ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081736704:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782222069.738559:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222069.738635:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081736704 00000100:00100000:2.0:1782222069.738642:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081736704 00000100:00100000:2.0:1782222069.738685:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1782222069.738693:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081736704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782222069.738750:0:7480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1782222069.738791:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081736704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222069.738797:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1782222069.738843:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087719ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081736704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782222069.738962:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222069.739346:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081736576 00000100:00100000:2.0:1782222069.739351:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081736576 00000100:00100000:2.0:1782222069.739384:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1782222069.739390:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074767b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081736576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782222069.739410:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1782222069.739459:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074767b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081736576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222069.739466:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1782222069.739566:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747678e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081736576:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782222070.252013:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081736832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782222070.252089:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222070.252163:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081736832 00000100:00100000:3.0:1782222070.252170:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081736832 00000100:00100000:3.0:1782222070.252222:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1782222070.252231:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081736832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782222070.252282:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222070.252326:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081736832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222070.252334:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1782222070.252352:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782222070.252378:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0881598e00 x1868795081736832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222086 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222070.252394:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081736832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782222070.256277:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747679c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081736960:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782222070.256364:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222070.256584:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081736960 00000100:00100000:2.0:1782222070.256592:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081736960 00000100:00100000:2.0:1782222070.257095:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782222070.257104:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081736960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782222070.257126:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782222070.257177:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081736960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222070.257184:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1782222070.257764:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782222070.257797:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747679c00 x1868795081736960/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222086 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222070.257817:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747679c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081736960:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1782222070.315505:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782222070.608694:0:11327:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.83 00000100:00100000:3.0:1782222071.275957:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087719ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081737088:0@lo:400:kworker.0 00000100:00100000:3.0:1782222071.276028:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222071.276084:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1868795081737600:0@lo:400:kworker.0 00000100:00100000:3.0:1782222071.276108:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222071.276124:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081738112:0@lo:400:kworker.0 00000100:00100000:3.0:1782222071.276142:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222071.276156:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081738624:0@lo:400:kworker.0 00000100:00100000:3.0:1782222071.276170:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222071.276188:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1782222071.276192:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081737472:0@lo:400:kworker.0 00000100:00100000:3.0:1782222071.276208:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222071.276220:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081737984:0@lo:400:kworker.0 00000100:00100000:3.0:1782222071.276262:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222071.276274:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081738496:0@lo:400:kworker.0 00000100:00100000:3.0:1782222071.276295:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222071.276315:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081737344:0@lo:400:kworker.0 00000100:00100000:3.0:1782222071.276332:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222071.276342:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1868795081737856:0@lo:400:kworker.0 00000100:00100000:3.0:1782222071.276356:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222071.276366:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1868795081738368:0@lo:400:kworker.0 00000100:00100000:3.0:1782222071.276379:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222071.276390:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1782222071.276401:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087719a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1868795081737216:0@lo:400:kworker.0 00000100:00100000:3.0:1782222071.276433:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222071.276447:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1868795081737728:0@lo:400:kworker.0 00000100:00100000:3.0:1782222071.276466:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222071.276475:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1868795081738240:0@lo:400:kworker.0 00000100:00100000:3.0:1782222071.276492:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222071.276514:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081737600 00000100:00100000:3.0:1782222071.276521:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081737600 00000100:00100000:3.0:1782222071.276555:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081737856 00000100:00100000:3.0:1782222071.276559:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081737856 00000100:00100000:3.0:1782222071.276581:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081738368 00000100:00100000:3.0:1782222071.276584:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081738368 00000100:00100000:3.0:1782222071.276594:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081737216 00000100:00100000:3.0:1782222071.276596:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081737216 00000100:00100000:3.0:1782222071.276606:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081737728 00000100:00100000:3.0:1782222071.276608:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081737728 00000100:00100000:3.0:1782222071.276616:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081738240 00000100:00100000:3.0:1782222071.276618:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081738240 00000100:00100000:3.0:1782222071.276632:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1782222071.276639:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1868795081737600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222071.276684:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1868795081737600:12345-0@lo:400:kworker.0 Request processed in 46us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222071.276691:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1782222071.276715:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1782222071.276724:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1868795081737856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222071.276749:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1868795081737856:12345-0@lo:400:kworker.0 Request processed in 26us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222071.276754:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1782222071.276779:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1782222071.276784:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1868795081738368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222071.276807:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1868795081738368:12345-0@lo:400:kworker.0 Request processed in 23us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222071.276811:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1782222071.276819:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1782222071.276823:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1868795081737216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222071.276840:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1868795081737216:12345-0@lo:400:kworker.0 Request processed in 17us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222071.276844:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1782222071.276851:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1782222071.276855:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1868795081737728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222071.276884:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1868795081737728:12345-0@lo:400:kworker.0 Request processed in 28us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222071.276889:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1782222071.276897:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1782222071.276902:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1868795081738240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222071.276918:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1868795081738240:12345-0@lo:400:kworker.0 Request processed in 16us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222071.276923:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1782222071.276936:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081738112 00000100:00100000:3.0:1782222071.276938:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081738112 00000100:00100000:3.0:1782222071.276951:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081738624 00000100:00100000:3.0:1782222071.276953:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081738624 00000100:00100000:3.0:1782222071.276961:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081737984 00000100:00100000:3.0:1782222071.276963:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081737984 00000100:00100000:3.0:1782222071.276969:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081738496 00000100:00100000:3.0:1782222071.276976:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081738496 00000100:00100000:3.0:1782222071.276993:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1782222071.276998:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081738112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222071.277026:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081738112:12345-0@lo:400:kworker.0 Request processed in 28us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222071.277032:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1782222071.277042:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782222071.277048:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081738624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222071.277071:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081738624:12345-0@lo:400:kworker.0 Request processed in 24us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222071.277076:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782222071.277085:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1782222071.277090:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081737984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222071.277108:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081737984:12345-0@lo:400:kworker.0 Request processed in 19us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222071.277179:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1782222071.277190:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782222071.277195:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081738496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222071.277217:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081738496:12345-0@lo:400:kworker.0 Request processed in 22us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222071.277222:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782222071.277263:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081737472 00000100:00100000:3.0:1782222071.277265:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081737472 00000100:00100000:3.0:1782222071.277283:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081737344 00000100:00100000:3.0:1782222071.277285:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081737344 00000100:00100000:3.0:1782222071.277294:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1782222071.277298:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081737472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222071.277329:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081737472:12345-0@lo:400:kworker.0 Request processed in 31us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222071.277335:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1782222071.277343:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1782222071.277348:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081737344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222071.277365:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081737344:12345-0@lo:400:kworker.0 Request processed in 18us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222071.277370:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1782222071.277385:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782222071.277389:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782222071.277390:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782222071.277416:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087719a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1868795081737216:0@lo:400:kworker.0 00000100:00100000:3.0:1782222071.277426:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1868795081737728:0@lo:400:kworker.0 00000100:00100000:3.0:1782222071.277434:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1868795081738240:0@lo:400:kworker.0 00000100:00100000:3.0:1782222071.277442:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081737344:0@lo:400:kworker.0 00010000:00080000:3.0:1782222071.277453:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07465e0700 x1868795081737856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222071.277462:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1868795081737856:0@lo:400:kworker.0 00010000:00080000:3.0:1782222071.277470:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474d2d80 x1868795081738368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222071.277477:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1868795081738368:0@lo:400:kworker.0 00000100:00100000:3.0:1782222071.277505:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081737472:0@lo:400:kworker.0 00010000:00080000:3.0:1782222071.277522:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07465e1880 x1868795081737984/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222071.277529:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081737984:0@lo:400:kworker.0 00010000:00080000:3.0:1782222071.277537:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474d0e00 x1868795081738496/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222071.277544:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081738496:0@lo:400:kworker.0 00000100:00100000:3.0:1782222071.277552:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1868795081737600:0@lo:400:kworker.0 00010000:00080000:3.0:1782222071.277559:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07465e3800 x1868795081738112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222071.277566:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081738112:0@lo:400:kworker.0 00010000:00080000:3.0:1782222071.277573:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474d1880 x1868795081738624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222071.277579:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081738624:0@lo:400:kworker.0 00000100:00100000:2.0:1782222071.278208:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081737088 00000100:00100000:2.0:1782222071.278215:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081737088 00000100:00100000:2.0:1782222071.278295:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1782222071.278302:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3656:x1868795081737088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222071.278350:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3656:x1868795081737088:12345-0@lo:400:kworker.0 Request processed in 49us (2323us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222071.278355:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1782222071.278449:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087719ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081737088:0@lo:400:kworker.0 00010000:00010000:0.0:1782222071.338598:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222072.364902:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782222072.461144:0:11375:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Jun 23 09:41:09 EDT 2026 00010000:00010000:3.0:1782222073.391720:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222073.768076:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222073.768119:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222073.768166:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222073.768205:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060693504 00000100:00100000:0.0:1782222073.768216:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060693504 00000100:00100000:0.0:1782222073.768334:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060693376 00000100:00100000:0.0:1782222073.768342:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060693376 00000100:00100000:0.0:1782222073.768381:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 120 00000100:00100000:0.0:1782222073.768391:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+5:2389:x1868795060693504:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222073.768474:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+5:2389:x1868795060693504:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 85us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222073.768481:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 120 00000100:00100000:0.0:1782222073.768502:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 121 00000100:00100000:0.0:1782222073.768513:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+6:2389:x1868795060693376:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222073.768547:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+6:2389:x1868795060693376:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 39us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222073.768553:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 121 00000100:00080000:0.0:1782222073.768577:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782222073.768581:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782222073.768860:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060693248 00000100:00100000:2.0:1782222073.768865:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060693248 00000100:00100000:2.0:1782222073.768905:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 288 00000100:00100000:2.0:1782222073.768913:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0850982850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:2389:x1868795060693248:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222073.768941:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0850982850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:2389:x1868795060693248:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 29us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222073.768947:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 288 00000100:00100000:2.0:1782222073.834670:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782222073.834701:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081738752:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782222073.834769:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222073.834896:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081738752 00000100:00100000:3.0:1782222073.834915:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081738752 00000100:00100000:3.0:1782222073.834984:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1782222073.834994:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081738752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782222073.835024:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222073.835069:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081738752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222073.835076:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1782222073.835163:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088163f480 x1868795081738752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222089 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222073.835182:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081738752:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1782222073.835280:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782222073.835554:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081738880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782222073.835587:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222073.837027:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081738880 00000100:00100000:3.0:1782222073.837039:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081738880 00000100:00100000:3.0:1782222073.837099:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1782222073.837108:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081738880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782222073.837129:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222073.837187:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081738880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (1598us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222073.837194:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1782222073.837301:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088163d180 x1868795081738880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222089 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222073.837319:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081738880:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1782222073.837463:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782222074.411288:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222074.862930:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782222074.862957:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081739008:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782222074.863025:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222074.863085:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081739008 00000100:00100000:0.0:1782222074.863092:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081739008 00000100:00100000:0.0:1782222074.863136:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1782222074.863144:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081739008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782222074.863178:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1782222074.863223:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081739008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222074.863255:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1782222074.863303:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081739008:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782222074.864004:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782222074.864018:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081739136:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782222074.864058:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222074.864573:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081739136 00000100:00100000:0.0:1782222074.864581:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081739136 00000100:00100000:0.0:1782222074.864626:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1782222074.864634:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081739136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782222074.864660:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1782222074.864723:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081739136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222074.864730:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1782222074.864827:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081739136:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782222075.386601:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081739264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782222075.386677:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222075.386919:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081739264 00000100:00100000:2.0:1782222075.386936:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081739264 00000100:00100000:2.0:1782222075.387000:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1782222075.387010:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081739264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782222075.387041:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782222075.387089:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081739264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222075.387096:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1782222075.387132:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088163e680 x1868795081739264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222091 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222075.387162:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081739264:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782222075.389016:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782222075.389795:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081739392:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782222075.389863:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222075.390363:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081739392 00000100:00100000:2.0:1782222075.390372:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081739392 00000100:00100000:2.0:1782222075.390432:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1782222075.390442:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081739392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782222075.390466:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782222075.404151:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081739392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 13690us (14267us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222075.404165:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1782222075.404207:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782222075.404860:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0877154a80 x1868795081739392/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222091 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222075.404883:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081739392:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1782222075.435987:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222076.401617:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1868795081739648:0@lo:400:kworker.0 00000100:00100000:3.0:1782222076.401695:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222076.401740:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1868795081740160:0@lo:400:kworker.0 00000100:00100000:3.0:1782222076.401763:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222076.401787:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1868795081740672:0@lo:400:kworker.0 00000100:00100000:3.0:1782222076.401808:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222076.401840:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1782222076.401846:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081739520:0@lo:400:kworker.0 00000100:00100000:3.0:1782222076.401874:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222076.401895:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1868795081740032:0@lo:400:kworker.0 00000100:00100000:3.0:1782222076.401928:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222076.401947:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081740544:0@lo:400:kworker.0 00000100:00100000:3.0:1782222076.401969:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222076.401983:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081741056:0@lo:400:kworker.0 00000100:00100000:3.0:1782222076.402000:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222076.402024:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081739776:0@lo:400:kworker.0 00000100:00100000:3.0:1782222076.402047:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222076.402064:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1868795081740288:0@lo:400:kworker.0 00000100:00100000:3.0:1782222076.402083:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222076.402091:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1868795081740800:0@lo:400:kworker.0 00000100:00100000:3.0:1782222076.402108:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222076.402118:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1782222076.402123:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081739904:0@lo:400:kworker.0 00000100:00100000:3.0:1782222076.402140:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222076.402155:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081740416:0@lo:400:kworker.0 00000100:00100000:3.0:1782222076.402175:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222076.402188:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081740928:0@lo:400:kworker.0 00000100:00100000:3.0:1782222076.402205:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222076.402260:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081739648 00000100:00100000:3.0:1782222076.402267:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081739648 00000100:00100000:3.0:1782222076.402300:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081740160 00000100:00100000:3.0:1782222076.402309:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081740160 00000100:00100000:2.0:1782222076.402468:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081740544 00000100:00100000:2.0:1782222076.402473:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081740544 00000100:00100000:2.0:1782222076.402494:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081741056 00000100:00100000:2.0:1782222076.402497:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081741056 00000100:00100000:2.0:1782222076.402508:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081740416 00000100:00100000:2.0:1782222076.402510:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081740416 00000100:00100000:2.0:1782222076.402519:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081740928 00000100:00100000:2.0:1782222076.402521:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081740928 00000100:00100000:2.0:1782222076.402534:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782222076.402549:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081740544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222076.402605:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081740544:12345-0@lo:400:kworker.0 Request processed in 57us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222076.402612:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782222076.402627:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782222076.402633:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081741056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222076.402668:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081741056:12345-0@lo:400:kworker.0 Request processed in 23us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222076.402675:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782222076.402687:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1782222076.402693:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081740416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222076.402722:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081740416:12345-0@lo:400:kworker.0 Request processed in 28us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222076.402728:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1782222076.402738:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1782222076.402744:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747714380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081740928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222076.402769:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747714380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081740928:12345-0@lo:400:kworker.0 Request processed in 25us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222076.402774:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1782222076.402794:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081740032 00000100:00100000:2.0:1782222076.402798:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081740032 00000100:00100000:2.0:1782222076.402812:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081740288 00000100:00100000:2.0:1782222076.402815:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081740288 00000100:00100000:2.0:1782222076.402826:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081740800 00000100:00100000:2.0:1782222076.402828:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081740800 00000100:00100000:2.0:1782222076.402840:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1782222076.402845:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07465e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1868795081739648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222076.402884:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07465e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1868795081739648:12345-0@lo:400:kworker.0 Request processed in 38us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222076.402890:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1782222076.402904:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1782222076.402910:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087719ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1868795081740160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222076.402935:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087719ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1868795081740160:12345-0@lo:400:kworker.0 Request processed in 26us (1171us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222076.402941:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1782222076.402950:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1782222076.402955:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1868795081740032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222076.402978:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1868795081740032:12345-0@lo:400:kworker.0 Request processed in 22us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222076.402983:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1782222076.402993:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1782222076.402998:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1868795081740288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222076.403021:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1868795081740288:12345-0@lo:400:kworker.0 Request processed in 23us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222076.403026:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1782222076.403035:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1782222076.403040:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1868795081740800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222076.403064:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1868795081740800:12345-0@lo:400:kworker.0 Request processed in 23us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222076.403069:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1782222076.403087:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081739520 00000100:00100000:2.0:1782222076.403090:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081739520 00000100:00100000:2.0:1782222076.403121:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1782222076.403127:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3656:x1868795081739520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222076.403156:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3656:x1868795081739520:12345-0@lo:400:kworker.0 Request processed in 30us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222076.403161:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1782222076.403216:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081739776 00000100:00100000:2.0:1782222076.403219:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081739776 00000100:00100000:2.0:1782222076.403259:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081739904 00000100:00100000:2.0:1782222076.403262:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081739904 00000100:00100000:2.0:1782222076.403276:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1782222076.403281:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081739776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222076.403312:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081739776:12345-0@lo:400:kworker.0 Request processed in 31us (1264us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222076.403318:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1782222076.403329:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1782222076.404187:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081740672 00000100:00100000:3.0:1782222076.404202:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081740672 00000100:00100000:3.0:1782222076.404261:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1782222076.404270:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087719a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1868795081740672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222076.404320:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087719a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1868795081740672:12345-0@lo:400:kworker.0 Request processed in 52us (2511us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222076.404327:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:3.0:1782222076.404508:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782222076.404513:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782222076.404516:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1782222076.404551:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07465e3800 x1868795081740416/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222076.404566:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081740416:0@lo:400:kworker.0 00010000:00080000:3.0:1782222076.404578:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07465e0700 x1868795081740928/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222076.404587:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081740928:0@lo:400:kworker.0 00000100:00100000:3.0:1782222076.404596:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081739776:0@lo:400:kworker.0 00010000:00080000:3.0:1782222076.404606:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088163f480 x1868795081740288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222076.404615:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1868795081740288:0@lo:400:kworker.0 00010000:00080000:3.0:1782222076.404625:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07465e0000 x1868795081740800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222076.404633:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1868795081740800:0@lo:400:kworker.0 00000100:00100000:3.0:1782222076.404695:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081739520:0@lo:400:kworker.0 00000100:00100000:3.0:1782222076.404718:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1868795081740032:0@lo:400:kworker.0 00010000:00080000:3.0:1782222076.404729:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07465e1180 x1868795081740544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222076.404737:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081740544:0@lo:400:kworker.0 00010000:00080000:3.0:1782222076.404748:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07465e3b80 x1868795081741056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222076.404756:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081741056:0@lo:400:kworker.0 00000100:00100000:3.0:1782222076.404767:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1868795081739648:0@lo:400:kworker.0 00000100:00100000:3.0:1782222076.404776:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1868795081740160:0@lo:400:kworker.0 00000100:00100000:3.0:1782222076.404786:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1868795081740672:0@lo:400:kworker.0 00000100:00100000:2.0:1782222076.404862:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081739904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222076.404917:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081739904:12345-0@lo:400:kworker.0 Request processed in 1581us (2775us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222076.404924:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1782222076.406551:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081739904:0@lo:400:kworker.0 00010000:00010000:3.0:1782222076.461211:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222077.482431:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222078.508392:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222078.887688:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222078.887785:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222078.887824:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222078.887875:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060693632 00000100:00100000:0.0:1782222078.887885:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060693632 00000100:00100000:0.0:1782222078.887942:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 290 00000100:00100000:0.0:1782222078.887951:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0850980c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:2387:x1868795060693632:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222078.888021:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0850980c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:2387:x1868795060693632:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 70us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222078.888028:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 290 00000100:00100000:2.0:1782222078.888651:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060693760 00000100:00100000:2.0:1782222078.888657:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060693760 00000100:00100000:2.0:1782222078.888711:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060693888 00000100:00100000:2.0:1782222078.888715:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060693888 00000100:00100000:2.0:1782222078.888739:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 128 00000100:00100000:2.0:1782222078.888747:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+6:2387:x1868795060693760:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222078.888876:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 129 00000100:00100000:1.0:1782222078.888886:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+5:2387:x1868795060693888:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222078.888917:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+5:2387:x1868795060693888:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 33us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222078.888939:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 129 00000100:00100000:2.0:1782222078.888983:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+6:2387:x1868795060693760:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 44us (1110us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222078.889000:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 128 00000100:00080000:3.0:1782222078.889342:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782222078.889348:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782222078.954744:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081741184:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782222078.954811:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222078.955110:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782222078.955120:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081741312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782222078.955153:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222078.955187:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081741184 00000100:00100000:2.0:1782222078.955195:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081741184 00000100:00100000:2.0:1782222078.955286:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081741312 00000100:00100000:2.0:1782222078.955290:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081741312 00000100:00100000:2.0:1782222078.955308:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782222078.955316:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081741184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782222078.955347:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782222078.955360:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1782222078.955368:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081741312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782222078.955378:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782222078.955393:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081741184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222078.955400:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1782222078.955406:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081741312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222078.955423:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1782222078.955665:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747716680 x1868795081741312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222094 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222078.955683:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081741312:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1782222078.955715:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0877156d80 x1868795081741184/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222094 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222078.955727:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081741184:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1782222078.956341:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782222079.532386:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222079.979436:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074767aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081741440:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782222079.979513:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222079.979686:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081741440 00000100:00100000:1.0:1782222079.979695:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081741440 00000100:00100000:1.0:1782222079.979751:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1782222079.979761:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081741440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782222079.979807:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1782222079.979869:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081741440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222079.979876:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1782222079.980079:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074767aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081741440:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782222079.987351:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081741568:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782222079.987432:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222079.987641:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081741568 00000100:00100000:2.0:1782222079.987649:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081741568 00000100:00100000:2.0:1782222079.987703:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1782222079.987712:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081741568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782222079.987745:0:7480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1782222079.987804:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081741568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222079.987812:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1782222079.988024:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081741568:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782222080.490972:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081741696:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782222080.491044:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222080.491119:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081741696 00000100:00100000:3.0:1782222080.491125:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081741696 00000100:00100000:3.0:1782222080.491173:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1782222080.491181:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081741696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782222080.491207:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222080.491268:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081741696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222080.491275:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1782222080.491293:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782222080.491322:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747714e00 x1868795081741696/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222096 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222080.491340:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081741696:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782222080.498068:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081741824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782222080.498151:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222080.498219:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081741824 00000100:00100000:2.0:1782222080.498226:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081741824 00000100:00100000:2.0:1782222080.498312:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1782222080.498322:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081741824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782222080.498346:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782222080.498574:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081741824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 253us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222080.498582:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1782222080.498717:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474d0700 x1868795081741824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222096 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222080.498736:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081741824:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782222080.499352:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782222080.557195:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222081.520956:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1868795081742080:0@lo:400:kworker.0 00000100:00100000:2.0:1782222081.521168:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222081.521215:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1868795081742592:0@lo:400:kworker.0 00000100:00100000:2.0:1782222081.521261:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222081.521285:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1868795081743104:0@lo:400:kworker.0 00000100:00100000:2.0:1782222081.521323:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222081.521349:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1782222081.521355:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081742208:0@lo:400:kworker.0 00000100:00100000:2.0:1782222081.521380:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222081.521404:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1868795081742720:0@lo:400:kworker.0 00000100:00100000:2.0:1782222081.521424:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222081.521438:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1868795081743232:0@lo:400:kworker.0 00000100:00100000:2.0:1782222081.521456:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222081.521483:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081742080 00000100:00100000:2.0:1782222081.521490:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081742080 00000100:00100000:2.0:1782222081.521526:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081742592 00000100:00100000:2.0:1782222081.521529:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081742592 00000100:00100000:2.0:1782222081.521549:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081743104 00000100:00100000:2.0:1782222081.521551:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081743104 00000100:00100000:2.0:1782222081.521575:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081742720 00000100:00100000:2.0:1782222081.521578:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081742720 00000100:00100000:2.0:1782222081.521588:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081743232 00000100:00100000:2.0:1782222081.521590:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081743232 00000100:00100000:2.0:1782222081.521605:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1782222081.521611:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1868795081742080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222081.521673:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1868795081742080:12345-0@lo:400:kworker.0 Request processed in 61us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222081.521681:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1782222081.521698:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1782222081.521703:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1868795081742592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222081.521729:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1868795081742592:12345-0@lo:400:kworker.0 Request processed in 25us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222081.521735:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1782222081.521744:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1782222081.521750:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074774b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1868795081743104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222081.521773:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074774b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1868795081743104:12345-0@lo:400:kworker.0 Request processed in 23us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222081.521778:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1782222081.521787:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1782222081.521792:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074774ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1868795081742720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222081.521815:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074774ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1868795081742720:12345-0@lo:400:kworker.0 Request processed in 23us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222081.521821:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1782222081.521831:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1782222081.521837:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1868795081743232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222081.521976:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081742336:0@lo:400:kworker.0 00000100:00100000:1.0:1782222081.522011:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222081.522030:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081742848:0@lo:400:kworker.0 00000100:00100000:1.0:1782222081.522052:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222081.522068:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081743360:0@lo:400:kworker.0 00000100:00100000:1.0:1782222081.522087:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222081.522106:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1782222081.522113:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081741952:0@lo:400:kworker.0 00000100:00100000:1.0:1782222081.522136:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222081.522157:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1868795081742464:0@lo:400:kworker.0 00000100:00100000:1.0:1782222081.522176:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222081.522186:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081742976:0@lo:400:kworker.0 00000100:00100000:1.0:1782222081.522204:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222081.522220:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081743488:0@lo:400:kworker.0 00000100:00100000:1.0:1782222081.522257:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222081.522294:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081742848 00000100:00100000:1.0:1782222081.522298:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081742848 00000100:00100000:1.0:1782222081.522323:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081743360 00000100:00100000:1.0:1782222081.522326:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081743360 00000100:00100000:1.0:1782222081.522338:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081742976 00000100:00100000:1.0:1782222081.522341:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081742976 00000100:00100000:1.0:1782222081.522350:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081743488 00000100:00100000:1.0:1782222081.522352:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081743488 00000100:00100000:1.0:1782222081.522367:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782222081.522373:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081742848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222081.522409:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081742848:12345-0@lo:400:kworker.0 Request processed in 36us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222081.522415:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782222081.522427:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782222081.522433:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074767b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081743360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222081.522456:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074767b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081743360:12345-0@lo:400:kworker.0 Request processed in 23us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222081.522461:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782222081.522470:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1782222081.522476:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747679500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081742976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222081.522496:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747679500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081742976:12345-0@lo:400:kworker.0 Request processed in 20us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222081.522501:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1782222081.522509:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782222081.522515:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074767b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081743488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222081.522538:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074767b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081743488:12345-0@lo:400:kworker.0 Request processed in 23us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222081.522544:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:1.0:1782222081.522585:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474d2680 x1868795081742976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222081.522599:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081742976:0@lo:400:kworker.0 00010000:00080000:1.0:1782222081.522608:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474d0e00 x1868795081743488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222081.522616:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081743488:0@lo:400:kworker.0 00010000:00080000:1.0:1782222081.522636:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474d3480 x1868795081742848/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222081.522644:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081742848:0@lo:400:kworker.0 00010000:00080000:1.0:1782222081.522652:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474d1880 x1868795081743360/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222081.522659:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081743360:0@lo:400:kworker.0 00000100:00100000:2.0:1782222081.523113:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1868795081743232:12345-0@lo:400:kworker.0 Request processed in 1275us (1654us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222081.523121:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1782222081.523136:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081742464 00000100:00100000:2.0:1782222081.523139:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081742464 00000100:00100000:2.0:1782222081.523157:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1782222081.523163:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1868795081742464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222081.523201:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1868795081742464:12345-0@lo:400:kworker.0 Request processed in 38us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222081.523207:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1782222081.523250:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081742208 00000100:00100000:2.0:1782222081.523254:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081742208 00000100:00100000:2.0:1782222081.523279:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081742336 00000100:00100000:2.0:1782222081.523282:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081742336 00000100:00100000:2.0:1782222081.523294:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1782222081.523299:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074774a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081742208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222081.523330:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074774a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081742208:12345-0@lo:400:kworker.0 Request processed in 30us (1949us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222081.523336:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1782222081.523346:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1782222081.523352:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f084a281850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081742336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222081.523375:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f084a281850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081742336:12345-0@lo:400:kworker.0 Request processed in 24us (1363us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222081.523380:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:2.0:1782222081.523673:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782222081.523678:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782222081.523680:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782222081.523711:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081741952 00000100:00100000:2.0:1782222081.523715:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081741952 00000100:00100000:2.0:1782222081.523748:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1782222081.523755:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0850981450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3653:x1868795081741952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222081.523786:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0850981450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3653:x1868795081741952:12345-0@lo:400:kworker.0 Request processed in 31us (1648us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222081.523792:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1782222081.523836:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081742208:0@lo:400:kworker.0 00000100:00100000:1.0:1782222081.524231:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081741952:0@lo:400:kworker.0 00000100:00100000:1.0:1782222081.524271:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1868795081742464:0@lo:400:kworker.0 00000100:00100000:1.0:1782222081.524280:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081742336:0@lo:400:kworker.0 00010000:00080000:2.0:1782222081.524595:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474d1500 x1868795081742720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222081.524607:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1868795081742720:0@lo:400:kworker.0 00010000:00080000:2.0:1782222081.524629:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474d0a80 x1868795081743232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222081.524638:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1868795081743232:0@lo:400:kworker.0 00000100:00100000:2.0:1782222081.524651:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1868795081742080:0@lo:400:kworker.0 00000100:00100000:2.0:1782222081.524662:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1868795081742592:0@lo:400:kworker.0 00000100:00100000:2.0:1782222081.524673:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1868795081743104:0@lo:400:kworker.0 00010000:00010000:1.0:1782222081.578517:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222082.604946:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222083.626742:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222084.023385:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222084.023435:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222084.023560:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222084.023615:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060694016 00000100:00100000:0.0:1782222084.023627:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060694016 00000100:00100000:0.0:1782222084.027045:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 292 00000100:00100000:0.0:1782222084.027078:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:2390:x1868795060694016:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222084.027198:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:2390:x1868795060694016:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 137us (3826us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222084.027213:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 292 00000100:00100000:0.0:1782222084.027281:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060694144 00000100:00100000:0.0:1782222084.027291:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060694144 00000100:00100000:0.0:1782222084.027349:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060694272 00000100:00100000:0.0:1782222084.027354:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060694272 00000100:00100000:0.0:1782222084.027381:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 136 00000100:00100000:0.0:1782222084.027390:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+6:2389:x1868795060694144:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222084.027438:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+6:2389:x1868795060694144:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 50us (4003us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222084.027446:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 136 00000100:00100000:0.0:1782222084.027461:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 137 00000100:00100000:0.0:1782222084.027530:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060694272:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222084.027560:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060694272:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 94us (4002us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222084.027567:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 137 00000100:00080000:0.0:1782222084.028626:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782222084.028634:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782222084.075174:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782222084.075205:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081743616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782222084.075314:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222084.075395:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081743616 00000100:00100000:0.0:1782222084.075405:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081743616 00000100:00100000:0.0:1782222084.075482:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1782222084.075492:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081743616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782222084.075532:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782222084.075583:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081743616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222084.075591:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1782222084.075625:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1782222084.075675:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0877156300 x1868795081743616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222084.075696:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081743616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782222084.076328:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081743744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782222084.076372:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222084.082649:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081743744 00000100:00100000:3.0:1782222084.082680:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081743744 00000100:00100000:3.0:1782222084.082801:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782222084.082820:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081743744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782222084.082886:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1782222084.083352:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782222084.087596:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081743744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4766us (11205us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222084.087658:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:0.0:1782222084.090802:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747678a80 x1868795081743744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222084.090840:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081743744:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1782222084.657734:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222085.098695:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074767b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081743872:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782222085.099503:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074774a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081744000:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782222085.100715:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222085.100981:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081743872 00000100:00100000:3.0:1782222085.100991:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081743872 00000100:00100000:3.0:1782222085.101038:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1782222085.101047:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081743872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782222085.101084:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1782222085.101146:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081743872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222085.101154:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1782222085.101343:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074767b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081743872:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782222085.101879:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222085.101978:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081744000 00000100:00100000:3.0:1782222085.101986:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081744000 00000100:00100000:3.0:1782222085.102036:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1782222085.102044:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747749880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081744000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782222085.102068:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1782222085.102119:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747749880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081744000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222085.102126:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1782222085.102881:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074774a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081744000:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782222085.610894:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782222085.610926:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081744128:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782222085.610998:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222085.611898:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081744128 00000100:00100000:2.0:1782222085.611914:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081744128 00000100:00100000:2.0:1782222085.612002:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1782222085.612036:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081744128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782222085.612084:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782222085.612181:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081744128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 152us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222085.612190:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782222085.613012:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081744256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782222085.613077:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1782222085.613143:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747715f80 x1868795081744128/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222101 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222085.613163:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081744128:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1782222085.613281:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782222085.613412:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081744256 00000100:00100000:3.0:1782222085.613418:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081744256 00000100:00100000:3.0:1782222085.613482:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1782222085.613492:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081744256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782222085.613517:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222085.613601:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081744256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222085.613609:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1782222085.613719:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782222085.613747:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747714000 x1868795081744256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222101 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222085.613771:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081744256:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782222085.681534:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222086.636741:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081744384:0@lo:400:kworker.0 00000100:00100000:0.0:1782222086.636866:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222086.636952:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081744384 00000100:00100000:1.0:1782222086.636972:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081744384 00000100:00100000:1.0:1782222086.637038:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1782222086.637056:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0850980850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3653:x1868795081744384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222086.641306:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747716300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1868795081744512:0@lo:400:kworker.0 00000100:00100000:3.0:1782222086.641407:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222086.641451:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1868795081745024:0@lo:400:kworker.0 00000100:00100000:3.0:1782222086.641478:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222086.641502:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1868795081745536:0@lo:400:kworker.0 00000100:00100000:3.0:1782222086.641526:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222086.641557:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1782222086.641563:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1868795081744896:0@lo:400:kworker.0 00000100:00100000:3.0:1782222086.641600:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222086.641618:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081745408:0@lo:400:kworker.0 00000100:00100000:3.0:1782222086.641650:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222086.641689:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081745920:0@lo:400:kworker.0 00000100:00100000:3.0:1782222086.641715:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222086.641745:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081744640:0@lo:400:kworker.0 00000100:00100000:3.0:1782222086.643118:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222086.643170:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1868795081745152:0@lo:400:kworker.0 00000100:00100000:3.0:1782222086.643204:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222086.643217:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1868795081745664:0@lo:400:kworker.0 00000100:00100000:3.0:1782222086.643251:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222086.643272:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1782222086.643279:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081744768:0@lo:400:kworker.0 00000100:00100000:3.0:1782222086.643302:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222086.643341:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081745280:0@lo:400:kworker.0 00000100:00100000:3.0:1782222086.643387:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222086.643412:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081745792:0@lo:400:kworker.0 00000100:00100000:3.0:1782222086.643432:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222086.643490:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081744512 00000100:00100000:3.0:1782222086.643501:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081744512 00000100:00100000:3.0:1782222086.643558:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081745024 00000100:00100000:3.0:1782222086.643562:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081745024 00000100:00100000:3.0:1782222086.643603:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081745536 00000100:00100000:3.0:1782222086.643607:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081745536 00000100:00100000:3.0:1782222086.643622:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081744896 00000100:00100000:3.0:1782222086.643626:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081744896 00000100:00100000:3.0:1782222086.643638:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081745152 00000100:00100000:3.0:1782222086.643640:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081745152 00000100:00100000:3.0:1782222086.643651:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081745664 00000100:00100000:3.0:1782222086.643652:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081745664 00000100:00100000:3.0:1782222086.643667:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1782222086.644413:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0850980850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3653:x1868795081744384:12345-0@lo:400:kworker.0 Request processed in 7351us (7538us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222086.644427:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1782222086.644478:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081745408 00000100:00100000:1.0:1782222086.644486:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081745408 00000100:00100000:1.0:1782222086.644527:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081745920 00000100:00100000:1.0:1782222086.644530:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081745920 00000100:00100000:1.0:1782222086.644545:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081745280 00000100:00100000:1.0:1782222086.644548:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081745280 00000100:00100000:1.0:1782222086.644557:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081745792 00000100:00100000:1.0:1782222086.644559:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081745792 00000100:00100000:1.0:1782222086.644574:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782222086.644663:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07465e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081745408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222086.644772:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07465e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081745408:12345-0@lo:400:kworker.0 Request processed in 190us (3120us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222086.644779:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782222086.644791:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1782222086.644798:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07465e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081745920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222086.644828:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07465e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081745920:12345-0@lo:400:kworker.0 Request processed in 31us (3112us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222086.644833:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1782222086.644843:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1782222086.644848:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081745280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222086.644881:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081745280:12345-0@lo:400:kworker.0 Request processed in 33us (1493us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222086.644887:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1782222086.644907:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782222086.644912:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081745792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222086.644940:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081745792:12345-0@lo:400:kworker.0 Request processed in 28us (1506us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222086.644945:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:1.0:1782222086.644993:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088163d180 x1868795081745408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222086.645008:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081745408:0@lo:400:kworker.0 00010000:00080000:1.0:1782222086.645020:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088163f480 x1868795081745920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222086.645027:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081745920:0@lo:400:kworker.0 00000100:00100000:2.0:1782222086.647341:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081744640 00000100:00100000:2.0:1782222086.647360:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081744640 00000100:00100000:2.0:1782222086.648200:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081744768 00000100:00100000:2.0:1782222086.648210:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081744768 00000100:00100000:2.0:1782222086.648279:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1782222086.648292:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07465e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081744640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222086.648430:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07465e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081744640:12345-0@lo:400:kworker.0 Request processed in 139us (5316us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222086.648438:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1782222086.648470:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1782222086.648478:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07465e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081744768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222086.648520:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07465e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081744768:12345-0@lo:400:kworker.0 Request processed in 44us (5217us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222086.648527:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1782222086.649092:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1782222086.649101:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1868795081744512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222086.649113:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07465e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1868795081745024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222086.649414:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1868795081744512:12345-0@lo:400:kworker.0 Request processed in 322us (8006us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222086.649425:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1782222086.649457:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1782222086.649466:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07465e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1868795081745536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222086.649502:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07465e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1868795081745536:12345-0@lo:400:kworker.0 Request processed in 38us (7976us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222086.649509:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1782222086.649524:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1782222086.649531:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07465e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1868795081744896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222086.649602:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07465e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1868795081744896:12345-0@lo:400:kworker.0 Request processed in 70us (8001us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222086.649610:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1782222086.649626:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1782222086.649633:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07465e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1868795081745152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222086.649857:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747716300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1868795081744512:0@lo:400:kworker.0 00000100:00100000:2.0:1782222086.649877:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1868795081745024:0@lo:400:kworker.0 00000100:00100000:2.0:1782222086.649907:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1868795081745536:0@lo:400:kworker.0 00000100:00100000:2.0:1782222086.649953:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1868795081744896:0@lo:400:kworker.0 00000100:00100000:3.0:1782222086.650005:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07465e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1868795081745152:12345-0@lo:400:kworker.0 Request processed in 35us (6462us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222086.650014:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1782222086.650031:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1782222086.650040:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07465e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1868795081745664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222086.650088:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07465e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1868795081745664:12345-0@lo:400:kworker.0 Request processed in 47us (6833us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222086.650095:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1782222086.650124:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07465e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1868795081745024:12345-0@lo:400:kworker.0 Request processed in 312us (7938us total) trans 0 rc 0/0 00000100:00080000:3.0:1782222086.650139:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782222086.650139:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:3.0:1782222086.650150:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782222086.650154:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782222086.650207:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081744384:0@lo:400:kworker.0 00000100:00100000:3.0:1782222086.650215:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081744768:0@lo:400:kworker.0 00010000:00080000:3.0:1782222086.650375:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088163c380 x1868795081745280/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222086.650389:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081745280:0@lo:400:kworker.0 00010000:00080000:3.0:1782222086.650414:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088163e300 x1868795081745792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222086.650424:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081745792:0@lo:400:kworker.0 00000100:00100000:3.0:1782222086.650437:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081744640:0@lo:400:kworker.0 00010000:00080000:3.0:1782222086.650465:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088163c700 x1868795081745152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222086.650475:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1868795081745152:0@lo:400:kworker.0 00010000:00080000:3.0:1782222086.650488:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088163e680 x1868795081745664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222086.650497:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1868795081745664:0@lo:400:kworker.0 00010000:00010000:1.0:1782222086.698632:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222087.728607:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222088.747518:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222089.127137:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222089.127190:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222089.127275:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222089.127453:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060694400 00000100:00100000:1.0:1782222089.127465:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060694400 00000100:00100000:1.0:1782222089.127539:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 294 00000100:00100000:1.0:1782222089.127551:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0850980050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:2389:x1868795060694400:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222089.127650:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0850980050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:2389:x1868795060694400:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 101us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222089.127660:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 294 00000100:00100000:0.0:1782222089.128063:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060694656 00000100:00100000:0.0:1782222089.128070:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060694656 00000100:00100000:0.0:1782222089.128148:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060694528 00000100:00100000:0.0:1782222089.128152:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060694528 00000100:00100000:0.0:1782222089.128180:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 144 00000100:00100000:0.0:1782222089.128188:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+5:2389:x1868795060694656:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222089.128231:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+5:2389:x1868795060694656:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 43us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222089.128265:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 144 00000100:00100000:0.0:1782222089.128279:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 145 00000100:00100000:0.0:1782222089.128286:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+6:2389:x1868795060694528:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222089.128310:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+6:2389:x1868795060694528:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 25us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222089.128316:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 145 00000100:00080000:3.0:1782222089.129056:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782222089.129063:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782222089.195742:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782222089.195870:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074767aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081746176:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782222089.195966:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222089.196376:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081746176 00000100:00100000:2.0:1782222089.196401:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081746176 00000100:00100000:2.0:1782222089.196487:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1782222089.196500:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747679c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081746176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782222089.196542:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782222089.196630:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747679c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081746176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 132us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222089.196638:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:2.0:1782222089.196695:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074767aa00 x1868795081746176/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222105 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222089.197161:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074767aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081746176:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1782222089.197497:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782222089.202700:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081746048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782222089.202823:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222089.203579:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081746048 00000100:00100000:0.0:1782222089.203592:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081746048 00000100:00100000:0.0:1782222089.203685:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782222089.203696:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081746048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782222089.203737:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782222089.203822:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081746048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222089.203838:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1782222089.205254:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1782222089.205385:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0877155180 x1868795081746048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222105 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222089.205427:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081746048:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782222089.776067:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222090.219619:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074774a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081746304:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782222090.219688:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222090.219761:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081746304 00000100:00100000:2.0:1782222090.219769:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081746304 00000100:00100000:2.0:1782222090.219814:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1782222090.219823:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081746304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782222090.219855:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1782222090.219897:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081746304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222090.219905:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1782222090.219973:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074774a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081746304:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782222090.222026:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782222090.222043:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074774a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081746432:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782222090.222098:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222090.222137:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081746432 00000100:00100000:2.0:1782222090.222144:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081746432 00000100:00100000:2.0:1782222090.222183:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1782222090.222191:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074774bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081746432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782222090.222270:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1782222090.222314:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074774bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081746432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222090.222322:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1782222090.222358:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074774a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081746432:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1782222090.470666:0:12004:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 09:41:28 (1782222088) === 00000100:00100000:0.0:1782222090.730982:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782222090.731002:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081746560:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782222090.731069:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222090.731626:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081746560 00000100:00100000:2.0:1782222090.731635:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081746560 00000100:00100000:2.0:1782222090.731693:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1782222090.731704:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081746560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782222090.731738:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782222090.731796:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081746560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222090.731803:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:2.0:1782222090.731866:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0877154380 x1868795081746560/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222106 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222090.731884:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081746560:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1782222090.731928:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782222090.734603:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081746688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782222090.734884:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222090.744378:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081746688 00000100:00100000:0.0:1782222090.744406:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081746688 00000100:00100000:0.0:1782222090.744475:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1782222090.744496:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074774a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081746688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782222090.744523:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782222090.744622:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074774a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081746688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (9738us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222090.744630:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:0.0:1782222090.744676:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0877157480 x1868795081746688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222106 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222090.744695:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081746688:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782222090.745336:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782222090.794761:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222091.005718:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222091.005929:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060694784 00000100:00100000:1.0:1782222091.005939:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060694784 00000100:00100000:1.0:1782222091.005995:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 295 00000100:00100000:1.0:1782222091.006006:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0850982c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:8734:x1868795060694784:12345-192.168.203.27@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782222091.006023:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222091.006040:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f074744d800/0xe2b7cc26e6811327 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x558f77f2f755834e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222091.006068:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f074744d800/0xe2b7cc26e6811327 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755834e expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222091.006079:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f074744d800/0xe2b7cc26e6811327 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755834e expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222091.006087:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744d800, rc 0) 00000100:00100000:1.0:1782222091.006143:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0850982c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+11:8734:x1868795060694784:12345-192.168.203.27@tcp:101:mount.lustre.0 Request processed in 139us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222091.006150:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 295 00000100:00100000:0.0:1782222091.008035:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222091.008115:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060694912 00000100:00100000:3.0:1782222091.008124:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060694912 00000100:00100000:3.0:1782222091.008174:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 296 00000100:00100000:3.0:1782222091.008184:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0850981050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+11:8734:x1868795060694912:12345-192.168.203.27@tcp:501:mount.lustre.0 00000100:00100000:3.0:1782222091.008348:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0850981050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+11:8734:x1868795060694912:12345-192.168.203.27@tcp:501:mount.lustre.0 Request processed in 166us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222091.008357:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 296 00000100:00100000:3.0:1782222091.011098:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222091.011200:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060695040 00000100:00100000:2.0:1782222091.011209:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060695040 00000100:00100000:2.0:1782222091.011290:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 297 00000100:00100000:2.0:1782222091.011300:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085541c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+11:8734:x1868795060695040:12345-192.168.203.27@tcp:503:mount.lustre.0 00000100:00100000:2.0:1782222091.011444:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085541c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+11:8734:x1868795060695040:12345-192.168.203.27@tcp:503:mount.lustre.0 Request processed in 145us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222091.011451:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 297 00000100:00100000:0.0:1782222091.015066:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222091.019589:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060695168 00000100:00100000:1.0:1782222091.019603:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060695168 00000100:00100000:1.0:1782222091.019683:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 298 00000100:00100000:1.0:1782222091.019694:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085541e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+11:8738:x1868795060695168:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782222091.019882:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085541e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+11:8738:x1868795060695168:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 189us (4824us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222091.019891:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 298 00000100:00100000:0.0:1782222091.055000:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222091.056003:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060695296 00000100:00100000:3.0:1782222091.056016:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060695296 00000100:00100000:3.0:1782222091.056077:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 299 00000100:00100000:3.0:1782222091.056087:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085541d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+11:8738:x1868795060695296:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782222091.056279:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085541d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+11:8738:x1868795060695296:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 193us (1287us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222091.056287:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 299 00000100:00100000:3.0:1782222091.066350:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222091.066454:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060695424 00000100:00100000:2.0:1782222091.066466:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060695424 00000100:00100000:2.0:1782222091.066520:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 300 00000100:00100000:2.0:1782222091.066530:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085541f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+11:8738:x1868795060695424:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782222091.066682:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085541f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+11:8738:x1868795060695424:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 153us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222091.066691:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 300 00000100:00100000:0.0:1782222091.080341:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222091.080663:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060695552 00000100:00100000:1.0:1782222091.080688:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060695552 00000100:00100000:1.0:1782222091.080769:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 301 00000100:00100000:1.0:1782222091.080785:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+11:8734:x1868795060695552:12345-192.168.203.27@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782222091.080802:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222091.080819:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f074744cc00/0xe2b7cc26e681132e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x558f77f2f755837f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222091.080847:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f074744cc00/0xe2b7cc26e681132e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755837f expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222091.080859:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f074744cc00/0xe2b7cc26e681132e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755837f expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222091.080868:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744cc00, rc 0) 00000100:00100000:1.0:1782222091.080926:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+12:8734:x1868795060695552:12345-192.168.203.27@tcp:101:mount.lustre.0 Request processed in 148us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222091.080932:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 301 00000100:00100000:0.0:1782222091.084681:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222091.085575:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060695680 00000100:00100000:3.0:1782222091.085586:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060695680 00000100:00100000:3.0:1782222091.085958:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 302 00000100:00100000:3.0:1782222091.085970:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+12:8734:x1868795060695680:12345-192.168.203.27@tcp:256:mount.lustre.0 20000000:01000000:3.0:1782222091.085996:0:6521:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1782222091.086022:0:6521:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1782222091.086026:0:6521:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1782222091.086030:0:6521:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1782222091.086033:0:6521:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1782222091.086035:0:6521:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1782222091.088138:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+12:8734:x1868795060695680:12345-192.168.203.27@tcp:256:mount.lustre.0 Request processed in 2160us (3517us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222091.088152:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 302 00000100:00100000:0.0:1782222091.091401:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222091.091612:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060695808 00000100:00100000:2.0:1782222091.091679:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060695808 00000100:00100000:2.0:1782222091.092103:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 303 00000100:00100000:2.0:1782222091.092114:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+12:8734:x1868795060695808:12345-192.168.203.27@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782222091.092133:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222091.092152:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f087fb82800/0xe2b7cc26e6811335 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558386 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222091.092182:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fb82800/0xe2b7cc26e6811335 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558386 expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222091.092215:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f087fb82800/0xe2b7cc26e6811335 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558386 expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222091.092225:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb82800, rc 0) 00000100:00100000:2.0:1782222091.092315:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:8734:x1868795060695808:12345-192.168.203.27@tcp:101:mount.lustre.0 Request processed in 202us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222091.092321:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 303 00000100:00100000:0.0:1782222091.094602:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222091.095206:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060695936 00000100:00100000:1.0:1782222091.095217:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060695936 00000100:00100000:1.0:1782222091.095275:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 304 00000100:00100000:1.0:1782222091.095284:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:8734:x1868795060695936:12345-192.168.203.27@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782222091.095440:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:8734:x1868795060695936:12345-192.168.203.27@tcp:501:mount.lustre.0 Request processed in 156us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222091.095448:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 304 00000100:00100000:2.0:1782222091.098160:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222091.098297:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060696064 00000100:00100000:1.0:1782222091.098307:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060696064 00000100:00100000:1.0:1782222091.098389:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 305 00000100:00100000:1.0:1782222091.098399:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:8734:x1868795060696064:12345-192.168.203.27@tcp:503:mount.lustre.0 00000100:00100000:1.0:1782222091.098594:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:8734:x1868795060696064:12345-192.168.203.27@tcp:503:mount.lustre.0 Request processed in 195us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222091.098602:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 305 00000100:00100000:0.0:1782222091.102207:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222091.102357:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060696192 00000100:00100000:1.0:1782222091.102369:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060696192 00000100:00100000:1.0:1782222091.102424:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 306 00000100:00100000:1.0:1782222091.102433:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:8742:x1868795060696192:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782222091.102588:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:8742:x1868795060696192:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 155us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222091.102596:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 306 00000100:00100000:3.0:1782222091.107222:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222091.119658:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060696320 00000100:00100000:1.0:1782222091.119674:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060696320 00000100:00100000:1.0:1782222091.119746:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 307 00000100:00100000:1.0:1782222091.119756:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:8742:x1868795060696320:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782222091.120150:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:8742:x1868795060696320:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 394us (12935us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222091.120158:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 307 00000100:00100000:3.0:1782222091.126657:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222091.126700:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222091.126741:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222091.127030:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060696448 00000100:00100000:2.0:1782222091.127039:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060696448 00000100:00100000:2.0:1782222091.127080:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060696704 00000100:00100000:2.0:1782222091.127083:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060696704 00000100:00100000:2.0:1782222091.127092:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060697088 00000100:00100000:2.0:1782222091.127094:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060697088 00000100:00100000:2.0:1782222091.127132:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 146 00000100:00100000:2.0:1782222091.127142:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+6:2390:x1868795060697088:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222091.127210:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+6:2390:x1868795060697088:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 69us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222091.127218:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 146 00000100:00100000:2.0:1782222091.127265:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 16 00000100:00100000:2.0:1782222091.127271:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2386:x1868795060696448:12345-192.168.203.27@tcp:38:mount.lustre.0 00010000:00080000:2.0:1782222091.127293:0:6526:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from eb78d98d-0650-4da4-8eeb-708f911905dd@192.168.203.27@tcp t0 exp 0000000000000000 cur 290 last 0 00000020:00000080:2.0:1782222091.127326:0:6526:0:(genops.c:1406:class_connect()) connect: client eb78d98d-0650-4da4-8eeb-708f911905dd, cookie 0xe2b7cc26e681133c 00000004:00100000:2.0:1782222091.127350:0:6526:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1782222091.127455:0:6526:0:(import.c:65:import_set_state_nolock()) ffff8f074769d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782222091.127500:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+6:2386:x1868795060696448:12345-192.168.203.27@tcp:38:mount.lustre.0 Request processed in 227us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222091.127507:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 16 00000100:00100000:2.0:1782222091.127523:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 17 00000100:00100000:2.0:1782222091.127527:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2386:x1868795060696704:12345-192.168.203.27@tcp:38:mount.lustre.0 00010000:00080000:2.0:1782222091.127544:0:6526:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from eb78d98d-0650-4da4-8eeb-708f911905dd@192.168.203.27@tcp t0 exp 0000000000000000 cur 290 last 0 00000020:00000080:2.0:1782222091.127582:0:6526:0:(genops.c:1406:class_connect()) connect: client eb78d98d-0650-4da4-8eeb-708f911905dd, cookie 0xe2b7cc26e6811343 00000004:00100000:2.0:1782222091.127594:0:6526:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1782222091.127650:0:6526:0:(import.c:65:import_set_state_nolock()) ffff8f0747698800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782222091.127674:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+6:2386:x1868795060696704:12345-192.168.203.27@tcp:38:mount.lustre.0 Request processed in 145us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222091.127681:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 17 00000100:00080000:2.0:1782222091.127718:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782222091.128395:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222091.128842:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060697216 00000100:00100000:2.0:1782222091.128851:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060697216 00000100:00100000:2.0:1782222091.128915:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 147 00000100:00100000:2.0:1782222091.128924:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060697216:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222091.128986:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060697216:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 63us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222091.128993:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 147 00000100:00080000:1.0:1782222091.129307:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782222091.139332:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222091.139425:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060696960 00000100:00100000:1.0:1782222091.139435:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060696960 00000100:00100000:1.0:1782222091.139515:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 18 00000100:00100000:1.0:1782222091.139526:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb78d98d-0650-4da4-8eeb-708f911905dd+6:8734:x1868795060696960:12345-192.168.203.27@tcp:41:mount.lustre.0 00000004:00000024:1.0:1782222091.139595:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1782222091.139692:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb78d98d-0650-4da4-8eeb-708f911905dd+6:8734:x1868795060696960:12345-192.168.203.27@tcp:41:mount.lustre.0 Request processed in 167us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222091.139927:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 18 00000100:00080000:2.0:1782222091.140476:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782222091.142964:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222091.143005:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222091.143038:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222091.143120:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060697344 00000100:00100000:3.0:1782222091.143129:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060697344 00000100:00100000:3.0:1782222091.143182:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060696832 00000100:00100000:3.0:1782222091.143186:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060696832 00000100:00100000:3.0:1782222091.143222:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060696576 00000100:00100000:3.0:1782222091.143225:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060696576 00000100:00100000:3.0:1782222091.143267:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 19 00000100:00100000:3.0:1782222091.143276:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb78d98d-0650-4da4-8eeb-708f911905dd+7:8734:x1868795060697344:12345-192.168.203.27@tcp:40:mount.lustre.0 00000100:00100000:3.0:1782222091.143351:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb78d98d-0650-4da4-8eeb-708f911905dd+7:8734:x1868795060697344:12345-192.168.203.27@tcp:40:mount.lustre.0 Request processed in 75us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222091.143358:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 19 00000100:00100000:3.0:1782222091.143376:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 20 00000100:00100000:3.0:1782222091.143382:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb78d98d-0650-4da4-8eeb-708f911905dd+6:0:x1868795060696832:12345-192.168.203.27@tcp:41:mount.lustre.0 00000004:00000024:3.0:1782222091.143401:0:8465:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1782222091.143448:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb78d98d-0650-4da4-8eeb-708f911905dd+6:0:x1868795060696832:12345-192.168.203.27@tcp:41:mount.lustre.0 Request processed in 67us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222091.143454:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 20 00000100:00100000:3.0:1782222091.143464:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 21 00000100:00100000:3.0:1782222091.143469:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb78d98d-0650-4da4-8eeb-708f911905dd+6:0:x1868795060696576:12345-192.168.203.27@tcp:41:mount.lustre.0 00000004:00000024:3.0:1782222091.143480:0:8465:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1782222091.143509:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb78d98d-0650-4da4-8eeb-708f911905dd+6:0:x1868795060696576:12345-192.168.203.27@tcp:41:mount.lustre.0 Request processed in 40us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222091.143514:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 21 00000100:00080000:2.0:1782222091.143588:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782222091.151141:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222091.151186:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222091.151220:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222091.151358:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060697472 00000100:00100000:1.0:1782222091.151367:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060697472 00000100:00100000:1.0:1782222091.151410:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060697600 00000100:00100000:1.0:1782222091.151413:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060697600 00000100:00100000:1.0:1782222091.151431:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 20 00000100:00100000:1.0:1782222091.151438:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2386:x1868795060697472:12345-192.168.203.27@tcp:8:mount.lustre.0 00010000:00080000:1.0:1782222091.151472:0:8443:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from eb78d98d-0650-4da4-8eeb-708f911905dd@192.168.203.27@tcp t0 exp 0000000000000000 cur 290 last 0 00000020:00000080:1.0:1782222091.151505:0:8443:0:(genops.c:1406:class_connect()) connect: client eb78d98d-0650-4da4-8eeb-708f911905dd, cookie 0xe2b7cc26e681134a 00002000:00100000:1.0:1782222091.151516:0:8443:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli eb78d98d-0650-4da4-8eeb-708f911905dd/ffff8f0881597800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782222091.151528:0:8443:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1782222091.151924:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 21 00000100:00100000:3.0:1782222091.151931:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2386:x1868795060697600:12345-192.168.203.27@tcp:8:mount.lustre.0 00010000:00080000:3.0:1782222091.151949:0:8887:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from eb78d98d-0650-4da4-8eeb-708f911905dd@192.168.203.27@tcp t0 exp 0000000000000000 cur 290 last 0 00000020:00000080:3.0:1782222091.151981:0:8887:0:(genops.c:1406:class_connect()) connect: client eb78d98d-0650-4da4-8eeb-708f911905dd, cookie 0xe2b7cc26e6811351 00002000:00100000:3.0:1782222091.151986:0:8887:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli eb78d98d-0650-4da4-8eeb-708f911905dd/ffff8f08815e2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782222091.152003:0:8887:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782222091.152047:0:8887:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1782222091.152076:0:8887:0:(import.c:65:import_set_state_nolock()) ffff8f08815e1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782222091.152137:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb78d98d-0650-4da4-8eeb-708f911905dd+6:2386:x1868795060697600:12345-192.168.203.27@tcp:8:mount.lustre.0 Request processed in 205us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222091.152145:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 21 00002000:00080000:1.0:1782222091.152203:0:8443:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1782222091.152220:0:8443:0:(import.c:65:import_set_state_nolock()) ffff8f0881594000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782222091.152277:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb78d98d-0650-4da4-8eeb-708f911905dd+6:2386:x1868795060697472:12345-192.168.203.27@tcp:8:mount.lustre.0 Request processed in 838us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222091.152284:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 20 00000100:00100000:2.0:1782222091.152464:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060697728 00000100:00100000:2.0:1782222091.152476:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060697728 00000100:00100000:2.0:1782222091.152511:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 5 00000100:00100000:2.0:1782222091.152519:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:eb78d98d-0650-4da4-8eeb-708f911905dd+6:8734:x1868795060697728:12345-192.168.203.27@tcp:900:mount.lustre.0 00000100:00100000:2.0:1782222091.152569:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:eb78d98d-0650-4da4-8eeb-708f911905dd+6:8734:x1868795060697728:12345-192.168.203.27@tcp:900:mount.lustre.0 Request processed in 51us (1438us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222091.152576:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 5 00000100:00100000:0.0:1782222091.156180:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222091.156274:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060697856 00000100:00100000:3.0:1782222091.156284:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060697856 00000100:00100000:3.0:1782222091.156341:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 1 00000100:00100000:3.0:1782222091.156351:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+6:8734:x1868795060697856:12345-192.168.203.27@tcp:33:mount.lustre.0 00000004:00200000:3.0:1782222091.156444:0:6529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1782222091.156528:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+6:8734:x1868795060697856:12345-192.168.203.27@tcp:33:mount.lustre.0 Request processed in 178us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222091.156536:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 1 00000100:00100000:0.0:1782222091.756665:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747678e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081746816:0@lo:400:kworker.0 00000100:00100000:0.0:1782222091.756747:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222091.756864:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081746816 00000100:00100000:2.0:1782222091.756872:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081746816 00000100:00100000:2.0:1782222091.756937:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1782222091.756946:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3656:x1868795081746816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222091.757308:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074767a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081746944:0@lo:400:kworker.0 00000100:00100000:3.0:1782222091.757352:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222091.757379:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782222091.757385:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074767a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081747072:0@lo:400:kworker.0 00000100:00100000:3.0:1782222091.757412:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222091.757445:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081747072 00000100:00100000:3.0:1782222091.757449:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081747072 00000100:00100000:3.0:1782222091.757477:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1782222091.757483:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081747072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222091.757536:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081747072:12345-0@lo:400:kworker.0 Request processed in 52us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222091.757542:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1782222091.757600:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074767a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081747072:0@lo:400:kworker.0 00000100:00100000:3.0:1782222091.757626:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081746944 00000100:00100000:3.0:1782222091.757629:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081746944 00000100:00100000:3.0:1782222091.757661:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1782222091.757667:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081746944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222091.757704:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081746944:12345-0@lo:400:kworker.0 Request processed in 36us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222091.757710:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1782222091.757735:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074767a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081746944:0@lo:400:kworker.0 00000100:00100000:3.0:1782222091.757751:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074767aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081747200:0@lo:400:kworker.0 00000100:00100000:3.0:1782222091.757775:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222091.757816:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081747200 00000100:00100000:3.0:1782222091.757820:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081747200 00000100:00100000:3.0:1782222091.757841:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1782222091.757847:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081747200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222091.757881:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081747200:12345-0@lo:400:kworker.0 Request processed in 33us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222091.757887:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1782222091.757911:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074767aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081747200:0@lo:400:kworker.0 00000100:00100000:2.0:1782222091.758308:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3656:x1868795081746816:12345-0@lo:400:kworker.0 Request processed in 1361us (1559us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222091.758316:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1782222091.758540:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782222091.758626:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1868795081747456:0@lo:400:kworker.0 00000100:00100000:2.0:1782222091.758656:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222091.758676:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782222091.758682:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074767aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1868795081747584:0@lo:400:kworker.0 00000100:00100000:2.0:1782222091.758704:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222091.758744:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081747456 00000100:00100000:2.0:1782222091.758748:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081747456 00000100:00100000:2.0:1782222091.758782:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081747584 00000100:00100000:2.0:1782222091.758785:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081747584 00000100:00100000:2.0:1782222091.758804:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1782222091.758810:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747749c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1868795081747456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222091.758848:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747749c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1868795081747456:12345-0@lo:400:kworker.0 Request processed in 37us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222091.758854:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1782222091.758875:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1782222091.758882:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074774aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1868795081747584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222091.758911:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074774aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1868795081747584:12345-0@lo:400:kworker.0 Request processed in 30us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222091.758917:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:2.0:1782222091.758933:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782222091.758937:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782222091.758957:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074767aa00 x1868795081747584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222091.758969:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074767aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1868795081747584:0@lo:400:kworker.0 00000100:00100000:2.0:1782222091.759001:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1868795081747456:0@lo:400:kworker.0 00000100:00100000:0.0:1782222091.759408:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747678e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081746816:0@lo:400:kworker.0 00000100:00100000:0.0:1782222091.759423:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782222091.759429:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074767a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081747712:0@lo:400:kworker.0 00000100:00100000:0.0:1782222091.759469:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222091.759596:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081747712 00000100:00100000:2.0:1782222091.759601:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081747712 00000100:00100000:2.0:1782222091.759638:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1782222091.759645:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081747712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222091.759685:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081747712:12345-0@lo:400:kworker.0 Request processed in 40us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222091.759691:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:0.0:1782222091.759762:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074767a300 x1868795081747712/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222091.759773:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074767a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081747712:0@lo:400:kworker.0 00000100:00100000:3.0:1782222091.759849:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074767b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1868795081747328:0@lo:400:kworker.0 00000100:00100000:3.0:1782222091.759879:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222091.759993:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081747328 00000100:00100000:2.0:1782222091.759998:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081747328 00000100:00100000:2.0:1782222091.760031:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1782222091.760038:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1868795081747328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222091.760073:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1868795081747328:12345-0@lo:400:kworker.0 Request processed in 35us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222091.760079:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1782222091.760220:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074767b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1868795081747328:0@lo:400:kworker.0 00000100:00100000:0.0:1782222091.760703:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074767a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081747840:0@lo:400:kworker.0 00000100:00100000:0.0:1782222091.760737:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222091.760855:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747678e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081748224:0@lo:400:kworker.0 00000100:00100000:3.0:1782222091.760882:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222091.760949:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081747840 00000100:00100000:3.0:1782222091.760954:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081747840 00000100:00100000:3.0:1782222091.760979:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081748224 00000100:00100000:3.0:1782222091.760981:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081748224 00000100:00100000:3.0:1782222091.761005:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1782222091.761011:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081747840:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1782222091.761083:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782222091.761106:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074767a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1868795081748096:0@lo:400:kworker.0 00000100:00100000:2.0:1782222091.761133:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222091.761153:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782222091.761158:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074767b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1868795081747968:0@lo:400:kworker.0 00000100:00100000:2.0:1782222091.761177:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222091.761206:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081748096 00000100:00100000:2.0:1782222091.761210:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081748096 00000100:00100000:2.0:1782222091.761252:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081747968 00000100:00100000:2.0:1782222091.761255:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081747968 00000100:00100000:2.0:1782222091.761277:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1782222091.761282:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1868795081748096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222091.761340:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1868795081748096:12345-0@lo:400:kworker.0 Request processed in 56us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222091.761346:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1782222091.761359:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1782222091.761365:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074774b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1868795081747968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222091.761390:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074774b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1868795081747968:12345-0@lo:400:kworker.0 Request processed in 26us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222091.761396:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:2.0:1782222091.761410:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782222091.761413:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782222091.761431:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074767b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1868795081747968:0@lo:400:kworker.0 00010000:00080000:2.0:1782222091.761443:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074767a300 x1868795081748096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222091.761452:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074767a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1868795081748096:0@lo:400:kworker.0 00000100:00100000:2.0:1782222091.761477:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1782222091.761489:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081748224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222091.761524:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081748224:12345-0@lo:400:kworker.0 Request processed in 35us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222091.761530:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:2.0:1782222091.761587:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747678e00 x1868795081748224/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222091.761595:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747678e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081748224:0@lo:400:kworker.0 00000100:00100000:2.0:1782222091.762044:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782222091.762055:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081748352:0@lo:400:kworker.0 00000100:00100000:2.0:1782222091.762086:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222091.762158:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081747840:12345-0@lo:400:kworker.0 Request processed in 1146us (1420us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222091.762166:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1782222091.762181:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081748352 00000100:00100000:3.0:1782222091.762184:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081748352 00000100:00100000:3.0:1782222091.762223:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1782222091.762229:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747748380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081748352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222091.762281:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747748380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081748352:12345-0@lo:400:kworker.0 Request processed in 52us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222091.762288:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1782222091.762443:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1782222091.762485:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747678a80 x1868795081748352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222091.762494:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081748352:0@lo:400:kworker.0 00010000:00080000:0.0:1782222091.762611:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074767a680 x1868795081747840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222091.762621:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074767a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081747840:0@lo:400:kworker.0 00010000:00010000:2.0:1782222091.818594:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222092.842386:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222093.869635:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222094.314619:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074767aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081748480:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782222094.314696:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222094.314859:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081748480 00000100:00100000:0.0:1782222094.314867:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081748480 00000100:00100000:0.0:1782222094.314936:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1782222094.314946:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877381850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081748480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782222094.314976:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782222094.315023:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877381850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081748480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222094.315030:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1782222094.315270:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1782222094.315302:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074767aa00 x1868795081748480/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222110 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222094.315319:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074767aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081748480:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782222094.315655:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081748608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782222094.315692:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222094.316814:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081748608 00000100:00100000:2.0:1782222094.316827:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081748608 00000100:00100000:2.0:1782222094.316941:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1782222094.316951:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081748608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782222094.316974:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1782222094.317114:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782222094.317159:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081748608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 209us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222094.317181:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:3.0:1782222094.317260:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747747480 x1868795081748608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222110 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222094.317291:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081748608:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782222094.892197:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222095.338729:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081748736:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782222095.338846:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222095.338943:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782222095.338951:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081748864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782222095.339004:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222095.339104:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081748736 00000100:00100000:0.0:1782222095.339114:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081748736 00000100:00100000:0.0:1782222095.339174:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081748864 00000100:00100000:0.0:1782222095.339177:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081748864 00000100:00100000:0.0:1782222095.339197:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1782222095.339207:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081748736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782222095.339282:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1782222095.339353:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081748736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 147us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222095.339361:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1782222095.339392:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1782222095.339399:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081748864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782222095.339420:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1782222095.339449:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081748864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 51us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222095.339455:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1782222095.339503:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081748864:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782222095.339517:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081748736:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782222095.854894:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782222095.854929:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081748992:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782222095.855025:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222095.855305:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081748992 00000100:00100000:0.0:1782222095.855316:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081748992 00000100:00100000:0.0:1782222095.855397:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1782222095.855410:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074774b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081748992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782222095.855449:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782222095.855506:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074774b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081748992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222095.855524:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1782222095.855784:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782222095.855835:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747746a00 x1868795081748992/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222111 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222095.855860:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081748992:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782222095.856424:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782222095.856441:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081749120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782222095.856497:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222095.856558:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081749120 00000100:00100000:1.0:1782222095.856564:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081749120 00000100:00100000:1.0:1782222095.856615:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1782222095.856623:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074767aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081749120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782222095.856665:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782222095.856913:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074767aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081749120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 289us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222095.856921:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1782222095.859095:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782222095.863262:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747781f80 x1868795081749120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222111 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222095.863305:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081749120:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782222095.915683:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222096.302651:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222096.302847:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222096.303006:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222096.303059:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222096.303082:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222096.303143:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060698624 00000100:00100000:1.0:1782222096.303156:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060698624 00000100:00100000:1.0:1782222096.303292:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 73 00000100:00100000:1.0:1782222096.303305:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074774a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb78d98d-0650-4da4-8eeb-708f911905dd+6:2389:x1868795060698624:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222096.303402:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074774a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb78d98d-0650-4da4-8eeb-708f911905dd+6:2389:x1868795060698624:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 99us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222096.303411:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 73 00000100:00100000:1.0:1782222096.303443:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060697984 00000100:00100000:1.0:1782222096.303447:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060697984 00000100:00100000:1.0:1782222096.303476:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 309 00000100:00100000:1.0:1782222096.303482:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2389:x1868795060697984:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222096.303521:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2389:x1868795060697984:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 29us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222096.303528:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 309 00000100:00080000:1.0:1782222096.303714:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782222096.304636:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060698112 00000100:00100000:0.0:1782222096.304648:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060698112 00000100:00100000:0.0:1782222096.304732:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060698368 00000100:00100000:0.0:1782222096.304736:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060698368 00000100:00100000:0.0:1782222096.304765:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 154 00000100:00100000:0.0:1782222096.304775:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074774a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+6:2389:x1868795060698112:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222096.304855:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074774a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+6:2389:x1868795060698112:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 80us (2219us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222096.304862:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 154 00000100:00100000:0.0:1782222096.304879:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 155 00000100:00100000:0.0:1782222096.304887:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747749500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb78d98d-0650-4da4-8eeb-708f911905dd+6:2389:x1868795060698368:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222096.304928:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747749500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb78d98d-0650-4da4-8eeb-708f911905dd+6:2389:x1868795060698368:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 43us (2082us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222096.304934:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 155 00000100:00100000:2.0:1782222096.306228:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00080000:1.0:1782222096.306343:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782222096.306379:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060698240 00000100:00100000:1.0:1782222096.306389:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060698240 00000100:00100000:2.0:1782222096.306394:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222096.306458:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060698496 00000100:00100000:2.0:1782222096.306462:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060698752 00000100:00100000:1.0:1782222096.306463:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060698496 00000100:00100000:2.0:1782222096.306469:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060698752 00000100:00100000:1.0:1782222096.306488:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 156 00000100:00100000:1.0:1782222096.306502:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:2389:x1868795060698240:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222096.306561:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 74 00000100:00100000:2.0:1782222096.306572:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747716d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb78d98d-0650-4da4-8eeb-708f911905dd+6:2389:x1868795060698752:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222096.306747:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 157 00000100:00100000:3.0:1782222096.306758:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb78d98d-0650-4da4-8eeb-708f911905dd+6:2389:x1868795060698496:12345-192.168.203.27@tcp:400:kworker.0 00000100:00080000:0.0:1782222096.306809:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782222096.306813:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782222096.306844:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747716d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb78d98d-0650-4da4-8eeb-708f911905dd+6:2389:x1868795060698752:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 273us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222096.306853:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 74 00000100:00100000:3.0:1782222096.309295:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb78d98d-0650-4da4-8eeb-708f911905dd+6:2389:x1868795060698496:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 2519us (3055us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222096.309329:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 157 00000100:00100000:1.0:1782222096.309465:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:2389:x1868795060698240:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 119us (3533us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222096.309475:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 156 00000100:00100000:1.0:1782222096.874644:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782222096.874686:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747679c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081749248:0@lo:400:kworker.0 00000100:00100000:1.0:1782222096.874793:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222096.874874:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081749248 00000100:00100000:1.0:1782222096.874883:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081749248 00000100:00100000:1.0:1782222096.874943:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1782222096.874953:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3656:x1868795081749248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222096.875015:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3656:x1868795081749248:12345-0@lo:400:kworker.0 Request processed in 63us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222096.875022:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1782222096.875081:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747679c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081749248:0@lo:400:kworker.0 00000100:00100000:1.0:1782222096.875121:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747679c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1868795081749376:0@lo:400:kworker.0 00000100:00100000:1.0:1782222096.875150:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222096.875198:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782222096.875206:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081749504:0@lo:400:kworker.0 00000100:00100000:1.0:1782222096.875274:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222096.875319:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074767a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081749632:0@lo:400:kworker.0 00000100:00100000:1.0:1782222096.875345:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222096.875387:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782222096.875393:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1868795081749760:0@lo:400:kworker.0 00000100:00100000:1.0:1782222096.875417:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222096.875453:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1868795081749888:0@lo:400:kworker.0 00000100:00100000:1.0:1782222096.875499:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222096.875548:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782222096.875553:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1868795081750016:0@lo:400:kworker.0 00000100:00100000:1.0:1782222096.875576:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222096.875602:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081749376 00000100:00100000:1.0:1782222096.875606:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081749376 00000100:00100000:1.0:1782222096.875630:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081749760 00000100:00100000:1.0:1782222096.875632:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081749760 00000100:00100000:1.0:1782222096.875644:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081749888 00000100:00100000:1.0:1782222096.875646:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081749888 00000100:00100000:1.0:1782222096.875666:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081750016 00000100:00100000:1.0:1782222096.875668:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081750016 00000100:00100000:1.0:1782222096.875682:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1782222096.875688:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074767a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1868795081749376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222096.875729:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074767a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1868795081749376:12345-0@lo:400:kworker.0 Request processed in 41us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222096.875736:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1782222096.875752:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1782222096.875757:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1868795081749760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222096.875782:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1868795081749760:12345-0@lo:400:kworker.0 Request processed in 25us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222096.875788:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1782222096.875798:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1782222096.875804:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1868795081749888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222096.875826:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1868795081749888:12345-0@lo:400:kworker.0 Request processed in 23us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222096.875831:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1782222096.875849:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1782222096.875856:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1868795081750016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222096.875888:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1868795081750016:12345-0@lo:400:kworker.0 Request processed in 32us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222096.875894:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00010000:00080000:1.0:1782222096.875923:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088163e300 x1868795081750016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222096.875936:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1868795081750016:0@lo:400:kworker.0 00000100:00100000:1.0:1782222096.875963:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1868795081749888:0@lo:400:kworker.0 00000100:00100000:1.0:1782222096.875972:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1868795081749760:0@lo:400:kworker.0 00000100:00100000:1.0:1782222096.875980:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747679c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1868795081749376:0@lo:400:kworker.0 00000100:00100000:1.0:1782222096.876014:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081750144:0@lo:400:kworker.0 00000100:00100000:1.0:1782222096.876039:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222096.876067:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081750144 00000100:00100000:1.0:1782222096.876070:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081750144 00000100:00100000:1.0:1782222096.876096:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1782222096.876102:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081750144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222096.876134:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081750144:12345-0@lo:400:kworker.0 Request processed in 32us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222096.876140:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:1.0:1782222096.876164:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088163f800 x1868795081750144/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222096.876174:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081750144:0@lo:400:kworker.0 00000100:00100000:1.0:1782222096.876209:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782222096.876217:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081750272:0@lo:400:kworker.0 00000100:00100000:1.0:1782222096.876269:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222096.876307:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1868795081750400:0@lo:400:kworker.0 00000100:00100000:1.0:1782222096.876329:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222096.876351:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081750400 00000100:00100000:1.0:1782222096.876355:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081750400 00000100:00100000:1.0:1782222096.876374:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1782222096.876380:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1868795081750400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222096.876411:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1868795081750400:12345-0@lo:400:kworker.0 Request processed in 31us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222096.876417:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1782222096.876439:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1868795081750400:0@lo:400:kworker.0 00000100:00100000:1.0:1782222096.876469:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782222096.876475:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1868795081750528:0@lo:400:kworker.0 00000100:00100000:1.0:1782222096.876498:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222096.876528:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081750528 00000100:00100000:1.0:1782222096.876532:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081750528 00000100:00100000:1.0:1782222096.876550:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1782222096.876556:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1868795081750528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222096.876585:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1868795081750528:12345-0@lo:400:kworker.0 Request processed in 29us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222096.876591:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00010000:00080000:1.0:1782222096.876611:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088163d500 x1868795081750528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222096.876620:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1868795081750528:0@lo:400:kworker.0 00000100:00100000:1.0:1782222096.876656:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081750656:0@lo:400:kworker.0 00000100:00100000:1.0:1782222096.876681:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222096.876709:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081750272 00000100:00100000:1.0:1782222096.876712:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081750272 00000100:00100000:1.0:1782222096.876731:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081750656 00000100:00100000:1.0:1782222096.876733:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081750656 00000100:00100000:1.0:1782222096.876750:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1782222096.876757:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081750272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222096.876788:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081750272:12345-0@lo:400:kworker.0 Request processed in 32us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222096.876795:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1782222096.876805:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1782222096.876811:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747679c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081750656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222096.876838:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747679c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081750656:12345-0@lo:400:kworker.0 Request processed in 27us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222096.876843:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:1.0:1782222096.876867:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088163d500 x1868795081750656/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222096.876876:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081750656:0@lo:400:kworker.0 00010000:00080000:1.0:1782222096.876895:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088163f800 x1868795081750272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222096.876902:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081750272:0@lo:400:kworker.0 00000100:00100000:1.0:1782222096.876929:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782222096.876934:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081750784:0@lo:400:kworker.0 00000100:00100000:1.0:1782222096.876955:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222096.876981:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081750784 00000100:00100000:1.0:1782222096.876985:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081750784 00000100:00100000:1.0:1782222096.877006:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1782222096.877012:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081750784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222096.877042:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081750784:12345-0@lo:400:kworker.0 Request processed in 30us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222096.877048:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:1.0:1782222096.877070:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088163f800 x1868795081750784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222096.877078:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081750784:0@lo:400:kworker.0 00000100:00100000:0.0:1782222096.877898:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081749504 00000100:00100000:0.0:1782222096.877913:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081749504 00000100:00100000:0.0:1782222096.877984:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081749632 00000100:00100000:0.0:1782222096.877989:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081749632 00000100:00100000:3.0:1782222096.878005:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1782222096.878027:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081749504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222096.878108:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081749504:12345-0@lo:400:kworker.0 Request processed in 87us (2833us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222096.879684:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081749504:0@lo:400:kworker.0 00000100:00100000:0.0:1782222096.886552:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1782222096.886578:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074767b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081749632:12345-0@lo:400:kworker.0 00000001:00100000:1.0:1782222096.886675:0:6505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of eb78d98d-0650-4da4-8eeb-708f911905dd 00000100:00100000:0.0:1782222096.886703:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074767b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081749632:12345-0@lo:400:kworker.0 Request processed in 135us (11354us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222096.886714:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:0.0:1782222096.886754:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782222096.886760:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782222096.886763:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782222096.887019:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074767a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081749632:0@lo:400:kworker.0 00000001:00100000:2.0:1782222096.889210:0:9523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of eb78d98d-0650-4da4-8eeb-708f911905dd 00000100:00100000:3.0:1782222096.889628:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000001:00100000:0.0:1782222096.892862:0:7458:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of eb78d98d-0650-4da4-8eeb-708f911905dd 00000001:00100000:1.0:1782222096.906375:0:8436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of eb78d98d-0650-4da4-8eeb-708f911905dd 00010000:00010000:2.0:1782222096.938398:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782222097.410130:0:12197:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg327-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1782222097.962535:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222098.987553:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222099.435477:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782222099.435509:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081750912:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782222099.435576:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222099.435712:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081750912 00000100:00100000:1.0:1782222099.435720:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081750912 00000100:00100000:1.0:1782222099.435785:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782222099.435795:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081750912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782222099.435824:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782222099.435925:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081750912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 132us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222099.435931:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1782222099.436112:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1782222099.436146:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088163f800 x1868795081750912/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222115 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222099.436165:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081750912:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782222099.436848:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782222099.445289:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081751040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782222099.445630:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222099.447976:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081751040 00000100:00100000:2.0:1782222099.447989:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081751040 00000100:00100000:2.0:1782222099.448131:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1782222099.448142:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081751040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782222099.448169:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782222099.448276:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081751040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (2646us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222099.448284:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:3.0:1782222099.448414:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747744700 x1868795081751040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222115 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222099.448438:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081751040:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1782222099.449540:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782222100.015078:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222100.461851:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782222100.461873:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081751168:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782222100.461906:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782222100.461919:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081751296:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782222100.461946:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222100.461978:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222100.462025:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081751168 00000100:00100000:0.0:1782222100.462033:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081751168 00000100:00100000:0.0:1782222100.462081:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081751296 00000100:00100000:0.0:1782222100.462085:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081751296 00000100:00100000:0.0:1782222100.462101:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1782222100.462109:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081751168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782222100.462140:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1782222100.462185:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081751168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222100.462191:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1782222100.462207:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1782222100.462213:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081751296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782222100.462372:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1782222100.462410:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081751296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 196us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222100.462416:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1782222100.462459:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081751168:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782222100.468576:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081751296:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782222100.977150:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081751424:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782222100.977342:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222100.977444:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081751552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782222100.977793:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222100.984795:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081751424 00000100:00100000:2.0:1782222100.984807:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081751424 00000100:00100000:3.0:1782222100.984933:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081751552 00000100:00100000:3.0:1782222100.984944:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081751552 00000100:00100000:3.0:1782222100.984970:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1782222100.984979:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081751424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782222100.985011:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222100.985086:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081751424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (7744us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222100.985094:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1782222100.985111:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1782222100.985117:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081751552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782222100.985127:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222100.985157:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081751552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (7364us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222100.985164:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:3.0:1782222100.985204:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747745500 x1868795081751424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222116 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222100.985257:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081751424:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1782222100.985294:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747783b80 x1868795081751552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222116 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222100.985306:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081751552:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782222100.985804:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782222101.037879:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222101.422622:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222101.422668:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222101.422692:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222101.422705:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060699008 00000100:00100000:3.0:1782222101.422716:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060699008 00000100:00100000:0.0:1782222101.422719:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222101.422736:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222101.422752:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222101.422769:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060699264 00000100:00100000:3.0:1782222101.422772:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060699264 00000100:00100000:0.0:1782222101.422772:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222101.422785:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060699136 00000100:00100000:3.0:1782222101.422788:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060699136 00000100:00100000:0.0:1782222101.422791:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060699392 00000100:00100000:0.0:1782222101.422794:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060699392 00000100:00100000:3.0:1782222101.422804:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 164 00000100:00100000:3.0:1782222101.422826:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+6:2390:x1868795060699008:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222101.422913:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+6:2390:x1868795060699008:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 88us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222101.426139:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 164 00000100:00100000:0.0:1782222101.426147:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 165 00000100:00100000:0.0:1782222101.426162:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2390:x1868795060699264:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222101.426163:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 166 00000100:00100000:3.0:1782222101.426171:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07465e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060699136:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222101.426251:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2390:x1868795060699264:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 94us (3581us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222101.426259:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 165 00000100:00100000:0.0:1782222101.426272:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 167 00000100:00100000:0.0:1782222101.426279:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2390:x1868795060699392:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222101.426305:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2390:x1868795060699392:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 27us (3552us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222101.426312:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 167 00000100:00100000:0.0:1782222101.426345:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060699520 00000100:00100000:0.0:1782222101.426352:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060699520 00000100:00100000:1.0:1782222101.426376:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060698880 00000100:00100000:1.0:1782222101.426380:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060698880 00000100:00100000:0.0:1782222101.426386:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060699648 00000100:00100000:0.0:1782222101.426388:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060699648 00000100:00100000:1.0:1782222101.426405:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 311 00000100:00100000:0.0:1782222101.426405:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 79 00000100:00100000:0.0:1782222101.426411:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07465e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2390:x1868795060699520:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222101.426412:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2390:x1868795060698880:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222101.426440:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2390:x1868795060698880:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 29us (3719us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222101.426440:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07465e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2390:x1868795060699520:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 28us (3746us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222101.426447:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 311 00000100:00100000:0.0:1782222101.426447:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 79 00000100:00100000:0.0:1782222101.426458:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 80 00000100:00100000:0.0:1782222101.426463:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2390:x1868795060699648:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222101.426497:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2390:x1868795060699648:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 34us (3724us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222101.426504:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 80 00000100:00100000:3.0:1782222101.427173:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07465e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060699136:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 998us (4431us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222101.427181:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 166 00000100:00080000:3.0:1782222101.427203:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782222101.427206:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782222101.427492:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782222101.427497:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782222101.996380:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1868795081751808:0@lo:400:kworker.0 00000100:00100000:3.0:1782222101.996433:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3654:1868795081751680:0@lo:400:kworker.0 00000100:00100000:1.0:1782222101.996449:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222101.996479:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222101.996508:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1868795081752192:0@lo:400:kworker.0 00000100:00100000:1.0:1782222101.996508:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1868795081752320:0@lo:400:kworker.0 00000100:00100000:3.0:1782222101.996529:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222101.996535:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081751936:0@lo:400:kworker.0 00000100:00100000:3.0:1782222101.996547:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081752704:0@lo:400:kworker.0 00000100:00100000:1.0:1782222101.996559:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222101.996564:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222101.996574:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1868795081752448:0@lo:400:kworker.0 00000100:00100000:3.0:1782222101.996576:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081753216:0@lo:400:kworker.0 00000100:00100000:3.0:1782222101.996593:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222101.996593:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222101.996607:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1868795081752960:0@lo:400:kworker.0 00000100:00100000:3.0:1782222101.996614:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1782222101.996618:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081752064:0@lo:400:kworker.0 00000100:00100000:1.0:1782222101.996625:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222101.996635:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222101.996648:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081752576:0@lo:400:kworker.0 00000100:00100000:1.0:1782222101.996653:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081751808 00000100:00100000:1.0:1782222101.996659:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081751808 00000100:00100000:3.0:1782222101.996681:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222101.996691:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081752192 00000100:00100000:1.0:1782222101.996693:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081752192 00000100:00100000:3.0:1782222101.996696:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081753088:0@lo:400:kworker.0 00000100:00100000:1.0:1782222101.996704:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081752448 00000100:00100000:1.0:1782222101.996706:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081752448 00000100:00100000:3.0:1782222101.996713:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222101.996728:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081752960 00000100:00100000:1.0:1782222101.996730:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081752960 00000100:00100000:3.0:1782222101.996736:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081752704 00000100:00100000:3.0:1782222101.996738:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081752704 00000100:00100000:1.0:1782222101.996745:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1782222101.996753:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1868795081751808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222101.996754:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081753216 00000100:00100000:3.0:1782222101.996756:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081753216 00000100:00100000:3.0:1782222101.996767:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081752576 00000100:00100000:3.0:1782222101.996770:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081752576 00000100:00100000:3.0:1782222101.996777:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081753088 00000100:00100000:3.0:1782222101.996779:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081753088 00000100:00100000:3.0:1782222101.996791:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1782222101.996796:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081752704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222101.996800:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1868795081751808:12345-0@lo:400:kworker.0 Request processed in 48us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222101.996806:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1782222101.996825:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1782222101.996827:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081752704:12345-0@lo:400:kworker.0 Request processed in 32us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222101.996833:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1782222101.996837:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1868795081752192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222101.996843:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1782222101.996848:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081753216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222101.996863:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1868795081752192:12345-0@lo:400:kworker.0 Request processed in 26us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222101.996868:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1782222101.996880:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1782222101.996885:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081753216:12345-0@lo:400:kworker.0 Request processed in 37us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222101.996886:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1868795081752448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222101.996891:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1782222101.996901:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1782222101.996907:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747782a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081752576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222101.996911:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1868795081752448:12345-0@lo:400:kworker.0 Request processed in 26us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222101.996916:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1782222101.996927:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1782222101.996931:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747782a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081752576:12345-0@lo:400:kworker.0 Request processed in 25us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222101.996932:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1868795081752960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222101.996937:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1782222101.996946:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1782222101.996953:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1868795081752960:12345-0@lo:400:kworker.0 Request processed in 22us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222101.996957:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081753088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222101.996959:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1782222101.996975:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081751680 00000100:00100000:1.0:1782222101.996978:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081751680 00000100:00100000:3.0:1782222101.996984:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081753088:12345-0@lo:400:kworker.0 Request processed in 28us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222101.996989:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1782222101.997000:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1782222101.997005:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081751936 00000100:00100000:1.0:1782222101.997005:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3654:x1868795081751680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222101.997008:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081751936 00000100:00100000:3.0:1782222101.997027:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081752064 00000100:00100000:3.0:1782222101.997030:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081752064 00000100:00100000:1.0:1782222101.997031:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3654:x1868795081751680:12345-0@lo:400:kworker.0 Request processed in 26us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222101.997037:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1782222101.997041:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1782222101.997046:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081751936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222101.997066:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1782222101.997073:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081752064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222101.997087:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081751936:12345-0@lo:400:kworker.0 Request processed in 41us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222101.997094:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1782222101.997095:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081752064:12345-0@lo:400:kworker.0 Request processed in 23us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222101.997109:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1782222101.997130:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782222101.997132:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081752064:0@lo:400:kworker.0 00000100:00080000:1.0:1782222101.997134:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1782222101.997144:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474d1500 x1868795081752576/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222101.997153:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081751936:0@lo:400:kworker.0 00000100:00100000:3.0:1782222101.997154:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081752576:0@lo:400:kworker.0 00010000:00080000:3.0:1782222101.997163:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474d0700 x1868795081753088/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1782222101.997163:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474d0a80 x1868795081752448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222101.997172:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081753088:0@lo:400:kworker.0 00000100:00100000:1.0:1782222101.997172:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1868795081752448:0@lo:400:kworker.0 00000100:00100000:3.0:1782222101.997180:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3654:1868795081751680:0@lo:400:kworker.0 00010000:00080000:1.0:1782222101.997180:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474d3800 x1868795081752960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222101.997188:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1868795081752192:0@lo:400:kworker.0 00000100:00100000:1.0:1782222101.997188:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1868795081752960:0@lo:400:kworker.0 00010000:00080000:3.0:1782222101.997196:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474d2a00 x1868795081752704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222101.997210:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222101.997216:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081752704:0@lo:400:kworker.0 00000100:00100000:1.0:1782222101.997226:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1868795081752832:0@lo:400:kworker.0 00010000:00080000:3.0:1782222101.997227:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474d1880 x1868795081753216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222101.997269:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222101.997272:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081753216:0@lo:400:kworker.0 00000100:00100000:1.0:1782222101.997291:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1868795081751808:0@lo:400:kworker.0 00000100:00100000:1.0:1782222101.997306:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081752320 00000100:00100000:1.0:1782222101.997309:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081752320 00000100:00100000:1.0:1782222101.997348:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081752832 00000100:00100000:1.0:1782222101.997351:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081752832 00000100:00100000:1.0:1782222101.997367:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1782222101.997373:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1868795081752320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222101.997407:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1868795081752320:12345-0@lo:400:kworker.0 Request processed in 33us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222101.997414:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1782222101.997426:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1782222101.997438:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1868795081752832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222101.997467:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1868795081752832:12345-0@lo:400:kworker.0 Request processed in 29us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222101.997484:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1782222101.997561:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1868795081752320:0@lo:400:kworker.0 00000100:00100000:1.0:1782222101.997571:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1868795081752832:0@lo:400:kworker.0 00000100:00080000:3.0:1782222101.997695:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782222102.061043:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222103.087655:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222104.111564:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222104.554563:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782222104.554588:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081753344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782222104.554654:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222104.554775:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081753344 00000100:00100000:0.0:1782222104.554784:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081753344 00000100:00100000:0.0:1782222104.554855:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1782222104.554865:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081753344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782222104.554895:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782222104.554939:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081753344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222104.554946:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:2.0:1782222104.554963:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0877157b80 x1868795081753344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222120 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222104.554982:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081753344:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1782222104.555002:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782222104.555623:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081753472:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782222104.555714:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222104.555869:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081753472 00000100:00100000:0.0:1782222104.555875:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081753472 00000100:00100000:0.0:1782222104.555927:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1782222104.555942:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747716680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081753472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782222104.555959:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782222104.556007:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747716680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081753472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222104.556014:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1782222104.556070:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1782222104.556130:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0849b14000 x1868795081753472/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222120 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222104.556145:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081753472:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1782222105.133293:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782222105.578733:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782222105.578837:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081753600:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782222105.578906:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222105.579074:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081753600 00000100:00100000:0.0:1782222105.579082:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081753600 00000100:00100000:0.0:1782222105.579174:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1782222105.579184:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081753600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782222105.579216:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1782222105.579285:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081753600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222105.579293:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1782222105.579412:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081753600:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782222105.579663:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081753728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782222105.579822:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222105.579891:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081753728 00000100:00100000:1.0:1782222105.579897:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081753728 00000100:00100000:1.0:1782222105.579938:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1782222105.579947:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081753728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782222105.579968:0:7480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1782222105.580335:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081753728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 387us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222105.580342:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1782222105.580405:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081753728:0@lo:41:osp-pre-0-1.0 00000020:00000004:1.0:1782222105.846894:0:12514:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782222105.847176:0:12514:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1782222106.097647:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081753856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782222106.097717:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222106.097771:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782222106.097777:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081753984:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782222106.097796:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222106.097832:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081753856 00000100:00100000:3.0:1782222106.097839:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081753856 00000100:00100000:3.0:1782222106.097885:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081753984 00000100:00100000:3.0:1782222106.097889:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081753984 00000100:00100000:3.0:1782222106.097906:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1782222106.097914:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081753856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782222106.097953:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222106.097998:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081753856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222106.098005:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1782222106.098021:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1782222106.098027:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081753984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782222106.098036:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222106.098058:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081753984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 32us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222106.098063:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1782222106.098081:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782222106.098109:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747783480 x1868795081753984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222122 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222106.098126:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081753984:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1782222106.098138:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747781500 x1868795081753856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222122 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222106.098150:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081753856:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782222106.156833:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222106.534030:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222106.534117:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222106.534151:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222106.534176:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222106.534194:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222106.534213:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222106.534274:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222106.534284:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060699776 00000100:00100000:2.0:1782222106.534293:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060699776 00000100:00100000:0.0:1782222106.534296:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060700032 00000100:00100000:0.0:1782222106.534298:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060700032 00000100:00100000:0.0:1782222106.534330:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060700288 00000100:00100000:0.0:1782222106.534333:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060700288 00000100:00100000:2.0:1782222106.534338:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 313 00000100:00100000:0.0:1782222106.534345:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060699904 00000100:00100000:2.0:1782222106.534346:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2387:x1868795060699776:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222106.534346:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060699904 00000100:00100000:0.0:1782222106.534356:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060700160 00000100:00100000:0.0:1782222106.534358:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060700160 00000100:00100000:0.0:1782222106.534382:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 174 00000100:00100000:0.0:1782222106.534388:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:2387:x1868795060700032:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222106.534426:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2387:x1868795060699776:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 80us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222106.534427:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:2387:x1868795060700032:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 40us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222106.534433:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 174 00000100:00100000:2.0:1782222106.534434:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 313 00000100:00100000:0.0:1782222106.534460:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 175 00000100:00100000:0.0:1782222106.534466:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2387:x1868795060700288:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222106.534489:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2387:x1868795060700288:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 24us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222106.534495:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 175 00000100:00100000:0.0:1782222106.534506:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 176 00000100:00100000:0.0:1782222106.534511:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+6:2387:x1868795060699904:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222106.534531:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+6:2387:x1868795060699904:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 20us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222106.534536:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 176 00000100:00100000:0.0:1782222106.534546:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 177 00000100:00100000:0.0:1782222106.534552:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2387:x1868795060700160:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222106.534573:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2387:x1868795060700160:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 22us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222106.534579:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 177 00000100:00100000:3.0:1782222106.534953:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060700544 00000100:00100000:3.0:1782222106.534958:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060700544 00000100:00100000:3.0:1782222106.534994:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060700416 00000100:00100000:3.0:1782222106.534997:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060700416 00000100:00100000:3.0:1782222106.535029:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 85 00000100:00100000:3.0:1782222106.535036:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2387:x1868795060700544:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222106.535073:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2387:x1868795060700544:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 37us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222106.535089:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 85 00000100:00100000:3.0:1782222106.535102:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 86 00000100:00100000:3.0:1782222106.535108:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2387:x1868795060700416:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222106.535134:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2387:x1868795060700416:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 26us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222106.535139:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 86 00000100:00080000:3.0:1782222106.535155:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782222106.535159:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782222106.535161:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782222106.535163:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782222107.120865:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081754112:0@lo:400:kworker.0 00000100:00100000:1.0:1782222107.120925:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222107.120967:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1868795081754624:0@lo:400:kworker.0 00000100:00100000:1.0:1782222107.120987:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222107.121003:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081755136:0@lo:400:kworker.0 00000100:00100000:1.0:1782222107.121021:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222107.121033:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081755648:0@lo:400:kworker.0 00000100:00100000:1.0:1782222107.121048:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222107.121068:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1782222107.121072:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081754240:0@lo:400:kworker.0 00000100:00100000:1.0:1782222107.121087:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222107.121101:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1868795081754752:0@lo:400:kworker.0 00000100:00100000:1.0:1782222107.121119:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222107.121133:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1868795081755264:0@lo:400:kworker.0 00000100:00100000:1.0:1782222107.121168:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222107.121206:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081754368:0@lo:400:kworker.0 00000100:00100000:1.0:1782222107.121231:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222107.121275:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1868795081754880:0@lo:400:kworker.0 00000100:00100000:1.0:1782222107.121295:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222107.121305:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1868795081755392:0@lo:400:kworker.0 00000100:00100000:1.0:1782222107.121323:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222107.121335:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1782222107.121340:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081754496:0@lo:400:kworker.0 00000100:00100000:1.0:1782222107.121358:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222107.121380:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081755008:0@lo:400:kworker.0 00000100:00100000:1.0:1782222107.121399:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222107.121413:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081755520:0@lo:400:kworker.0 00000100:00100000:1.0:1782222107.121430:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222107.121473:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081754112 00000100:00100000:1.0:1782222107.121481:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081754112 00000100:00100000:1.0:1782222107.121527:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1782222107.121535:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3653:x1868795081754112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222107.121580:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3653:x1868795081754112:12345-0@lo:400:kworker.0 Request processed in 45us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222107.121587:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1782222107.121620:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081754624 00000100:00100000:1.0:1782222107.121624:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081754624 00000100:00100000:1.0:1782222107.121641:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081754240 00000100:00100000:1.0:1782222107.121643:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081754240 00000100:00100000:1.0:1782222107.121653:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081754752 00000100:00100000:1.0:1782222107.121655:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081754752 00000100:00100000:1.0:1782222107.121676:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081755264 00000100:00100000:1.0:1782222107.121679:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081755264 00000100:00100000:1.0:1782222107.121689:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081754880 00000100:00100000:1.0:1782222107.121691:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081754880 00000100:00100000:1.0:1782222107.121700:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081755392 00000100:00100000:1.0:1782222107.121702:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081755392 00000100:00100000:1.0:1782222107.121713:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1782222107.121718:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1868795081754624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222107.121748:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1868795081754624:12345-0@lo:400:kworker.0 Request processed in 29us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222107.121754:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1782222107.121767:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1782222107.121778:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081754240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222107.121806:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081754240:12345-0@lo:400:kworker.0 Request processed in 28us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222107.121812:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1782222107.121825:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1782222107.121831:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1868795081754752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222107.121855:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1868795081754752:12345-0@lo:400:kworker.0 Request processed in 25us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222107.121861:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1782222107.121872:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1782222107.121877:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1868795081755264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222107.121899:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1868795081755264:12345-0@lo:400:kworker.0 Request processed in 22us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222107.121905:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1782222107.121914:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1782222107.121919:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1868795081754880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222107.121947:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1868795081754880:12345-0@lo:400:kworker.0 Request processed in 27us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222107.121953:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1782222107.121964:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1782222107.121970:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1868795081755392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222107.121996:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1868795081755392:12345-0@lo:400:kworker.0 Request processed in 26us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222107.122002:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1782222107.122020:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081755136 00000100:00100000:1.0:1782222107.122029:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081755136 00000100:00100000:1.0:1782222107.122046:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081755648 00000100:00100000:1.0:1782222107.122049:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081755648 00000100:00100000:1.0:1782222107.122059:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081755008 00000100:00100000:1.0:1782222107.122061:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081755008 00000100:00100000:1.0:1782222107.122070:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081755520 00000100:00100000:1.0:1782222107.122072:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081755520 00000100:00100000:1.0:1782222107.122085:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1782222107.122090:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081755136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222107.122119:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081755136:12345-0@lo:400:kworker.0 Request processed in 28us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222107.122125:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1782222107.122134:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1782222107.122140:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081755648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222107.122163:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081755648:12345-0@lo:400:kworker.0 Request processed in 24us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222107.122168:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1782222107.122178:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1782222107.122183:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081755008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222107.122204:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081755008:12345-0@lo:400:kworker.0 Request processed in 21us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222107.122209:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1782222107.122219:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1782222107.122224:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747531f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081755520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222107.122271:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747531f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081755520:12345-0@lo:400:kworker.0 Request processed in 47us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222107.122277:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1782222107.122314:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081754368 00000100:00100000:1.0:1782222107.122318:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081754368 00000100:00100000:1.0:1782222107.122338:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081754496 00000100:00100000:1.0:1782222107.122340:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081754496 00000100:00100000:1.0:1782222107.122352:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1782222107.122357:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081754368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222107.122388:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081754368:12345-0@lo:400:kworker.0 Request processed in 30us (1156us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222107.122394:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1782222107.122404:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1782222107.122409:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081754496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222107.122449:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081754496:12345-0@lo:400:kworker.0 Request processed in 39us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222107.122455:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1782222107.122502:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081754240:0@lo:400:kworker.0 00000100:00100000:1.0:1782222107.122514:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1868795081754752:0@lo:400:kworker.0 00000100:00100000:1.0:1782222107.122526:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1868795081755264:0@lo:400:kworker.0 00000100:00100000:1.0:1782222107.122534:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081754112:0@lo:400:kworker.0 00000100:00100000:1.0:1782222107.122543:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1868795081754624:0@lo:400:kworker.0 00010000:00080000:1.0:1782222107.122555:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474d1880 x1868795081755136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222107.122565:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081755136:0@lo:400:kworker.0 00010000:00080000:1.0:1782222107.122574:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474d0700 x1868795081755648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222107.122594:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081755648:0@lo:400:kworker.0 00000100:00080000:1.0:1782222107.122628:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782222107.122632:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782222107.122634:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782222107.122649:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081754496:0@lo:400:kworker.0 00010000:00080000:1.0:1782222107.122658:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474d3b80 x1868795081755008/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222107.122667:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081755008:0@lo:400:kworker.0 00010000:00080000:1.0:1782222107.122676:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474d1f80 x1868795081755520/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222107.122684:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081755520:0@lo:400:kworker.0 00000100:00100000:1.0:1782222107.122693:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081754368:0@lo:400:kworker.0 00010000:00080000:1.0:1782222107.122702:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474d1c00 x1868795081754880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222107.122709:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1868795081754880:0@lo:400:kworker.0 00010000:00080000:1.0:1782222107.122718:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474d0380 x1868795081755392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222107.122724:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1868795081755392:0@lo:400:kworker.0 00010000:00010000:0.0:1782222107.178557:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1782222107.841969:0:12611:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782222107.842205:0:12611:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1782222108.202417:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222109.227706:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782222109.674516:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081755776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782222109.676099:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222109.676220:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081755776 00000100:00100000:1.0:1782222109.676230:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081755776 00000100:00100000:1.0:1782222109.676310:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1782222109.676321:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081755776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782222109.676409:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782222109.676480:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081755776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 162us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222109.676488:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1782222109.676511:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1782222109.676542:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747714000 x1868795081755776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222125 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222109.676560:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081755776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782222109.677360:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081755904:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782222109.677445:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222109.677785:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081755904 00000100:00100000:1.0:1782222109.677796:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081755904 00000100:00100000:1.0:1782222109.677865:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1782222109.677874:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747716300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081755904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782222109.677895:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782222109.677958:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747716300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081755904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222109.677965:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:2.0:1782222109.684342:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747715f80 x1868795081755904/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222125 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222109.684371:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081755904:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1782222109.684452:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000004:3.0:1782222109.769381:0:12708:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782222109.769777:0:12708:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1782222110.250549:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782222110.699503:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081756032:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782222110.699625:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222110.699731:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081756032 00000100:00100000:0.0:1782222110.699739:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081756032 00000100:00100000:0.0:1782222110.699802:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1782222110.699819:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081756032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782222110.699853:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1782222110.699901:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081756032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222110.699909:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1782222110.699951:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081756032:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782222110.708487:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782222110.708510:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081756160:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782222110.708578:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222110.708626:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081756160 00000100:00100000:0.0:1782222110.708634:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081756160 00000100:00100000:0.0:1782222110.708682:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1782222110.708689:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081756160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782222110.708723:0:7480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1782222110.708785:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081756160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222110.708791:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1782222110.708842:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081756160:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782222111.213877:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782222111.213898:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081756288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782222111.213980:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222111.214046:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081756288 00000100:00100000:2.0:1782222111.214052:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081756288 00000100:00100000:2.0:1782222111.214109:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1782222111.214117:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747714000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081756288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782222111.214146:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782222111.214188:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747714000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081756288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222111.214196:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1782222111.214216:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782222111.214276:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747715f80 x1868795081756288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222127 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222111.214310:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081756288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782222111.214889:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782222111.214904:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081756416:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782222111.214959:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222111.215013:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081756416 00000100:00100000:1.0:1782222111.215018:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081756416 00000100:00100000:1.0:1782222111.215056:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1782222111.215066:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081756416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782222111.215083:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782222111.215129:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081756416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222111.215136:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:1.0:1782222111.215310:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747530700 x1868795081756416/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222127 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222111.215324:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081756416:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1782222111.215503:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782222111.274444:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222111.663129:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222111.663177:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222111.663198:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222111.663215:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222111.663252:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222111.663278:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222111.663323:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222111.663351:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060700800 00000100:00100000:0.0:1782222111.663362:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060700800 00000100:00100000:0.0:1782222111.663428:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060700928 00000100:00100000:0.0:1782222111.663431:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060700928 00000100:00100000:0.0:1782222111.663446:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060701056 00000100:00100000:0.0:1782222111.663448:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060701056 00000100:00100000:0.0:1782222111.663460:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060701184 00000100:00100000:0.0:1782222111.663462:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060701184 00000100:00100000:0.0:1782222111.663478:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 184 00000100:00100000:0.0:1782222111.663486:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+6:2389:x1868795060700800:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222111.663559:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+6:2389:x1868795060700800:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 73us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222111.663568:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 184 00000100:00100000:0.0:1782222111.663585:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 185 00000100:00100000:0.0:1782222111.663602:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:2389:x1868795060700928:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222111.663628:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:2389:x1868795060700928:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 28us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222111.663634:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 185 00000100:00100000:0.0:1782222111.663646:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 186 00000100:00100000:0.0:1782222111.663652:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2389:x1868795060701056:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222111.663676:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2389:x1868795060701056:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 24us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222111.663681:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 186 00000100:00100000:0.0:1782222111.663692:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 187 00000100:00100000:0.0:1782222111.663698:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2389:x1868795060701184:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222111.663732:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2389:x1868795060701184:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 33us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222111.663737:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 187 00000100:00100000:0.0:1782222111.663769:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060701312 00000100:00100000:0.0:1782222111.663773:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060701312 00000100:00100000:0.0:1782222111.663796:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060701440 00000100:00100000:0.0:1782222111.663798:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060701440 00000100:00100000:0.0:1782222111.663815:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 22 00000100:00100000:0.0:1782222111.663821:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2386:x1868795060701312:12345-192.168.203.27@tcp:9:kworker.0 00000020:00000080:0.0:1782222111.663840:0:8440:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e681134a 00000100:00080000:0.0:1782222111.663848:0:8440:0:(import.c:65:import_set_state_nolock()) ffff8f0881594000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782222111.663889:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1782222111.664008:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+2:2386:x1868795060701312:12345-192.168.203.27@tcp:9:kworker.0 Request processed in 186us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222111.664015:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 22 00000100:00100000:0.0:1782222111.664033:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 23 00000100:00100000:0.0:1782222111.664040:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2386:x1868795060701440:12345-192.168.203.27@tcp:9:kworker.0 00000020:00000080:0.0:1782222111.664051:0:8440:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6811351 00000100:00080000:0.0:1782222111.664056:0:8440:0:(import.c:65:import_set_state_nolock()) ffff8f08815e1800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782222111.664082:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1782222111.664215:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+2:2386:x1868795060701440:12345-192.168.203.27@tcp:9:kworker.0 Request processed in 175us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222111.664222:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 23 00000100:00080000:0.0:1782222111.664266:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782222111.664270:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782222111.664272:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782222111.664283:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782222111.664425:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222111.664598:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222111.666747:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060700672 00000100:00100000:2.0:1782222111.666761:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060700672 00000100:00100000:2.0:1782222111.666832:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 315 00000100:00100000:2.0:1782222111.666843:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2389:x1868795060700672:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222111.666926:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2389:x1868795060700672:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 85us (3807us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222111.666934:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 315 00000020:00000004:1.0:1782222111.982807:0:12805:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782222111.983050:0:12805:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1782222112.234933:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081756672:0@lo:400:kworker.0 00000100:00100000:3.0:1782222112.235008:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222112.235073:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074728d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1868795081757184:0@lo:400:kworker.0 00000100:00100000:3.0:1782222112.235095:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222112.235115:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074728f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1868795081757696:0@lo:400:kworker.0 00000100:00100000:3.0:1782222112.235136:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222112.235158:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1782222112.235164:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081756800:0@lo:400:kworker.0 00000100:00100000:3.0:1782222112.235185:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222112.235209:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074728f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1868795081757312:0@lo:400:kworker.0 00000100:00100000:3.0:1782222112.235229:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222112.235284:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074728e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1868795081757824:0@lo:400:kworker.0 00000100:00100000:3.0:1782222112.235318:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222112.235346:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081756800 00000100:00100000:3.0:1782222112.235354:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081756800 00000100:00100000:3.0:1782222112.235415:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1782222112.235423:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081756800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222112.235476:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081756800:12345-0@lo:400:kworker.0 Request processed in 54us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222112.235483:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1782222112.235518:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081756800:0@lo:400:kworker.0 00000100:00100000:0.0:1782222112.235727:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081756672 00000100:00100000:0.0:1782222112.235732:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081756672 00000100:00100000:0.0:1782222112.235753:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081757184 00000100:00100000:0.0:1782222112.235755:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081757184 00000100:00100000:0.0:1782222112.235786:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081757696 00000100:00100000:0.0:1782222112.235789:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081757696 00000100:00100000:0.0:1782222112.235800:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081757312 00000100:00100000:0.0:1782222112.235802:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081757312 00000100:00100000:0.0:1782222112.235811:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081757824 00000100:00100000:0.0:1782222112.235813:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081757824 00000100:00100000:0.0:1782222112.235825:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1782222112.235831:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081756672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222112.235871:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081756672:12345-0@lo:400:kworker.0 Request processed in 40us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222112.235876:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1782222112.235888:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1782222112.235894:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1868795081757184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222112.235921:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1868795081757184:12345-0@lo:400:kworker.0 Request processed in 28us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222112.235927:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1782222112.235938:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1782222112.235943:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1868795081757696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222112.235969:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1868795081757696:12345-0@lo:400:kworker.0 Request processed in 27us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222112.235974:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1782222112.235984:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1782222112.235990:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1868795081757312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222112.236024:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1868795081757312:12345-0@lo:400:kworker.0 Request processed in 35us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222112.236029:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1782222112.236039:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1782222112.236044:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1868795081757824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222112.236067:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1868795081757824:12345-0@lo:400:kworker.0 Request processed in 23us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222112.236072:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1782222112.236157:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074728dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081756928:0@lo:400:kworker.0 00000100:00100000:2.0:1782222112.236191:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222112.236218:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074728c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081757440:0@lo:400:kworker.0 00000100:00100000:0.0:1782222112.236322:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081756928 00000100:00100000:0.0:1782222112.236327:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081756928 00000100:00100000:0.0:1782222112.236352:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1782222112.236358:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081756928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222112.236390:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081756928:12345-0@lo:400:kworker.0 Request processed in 32us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222112.236406:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1782222112.236477:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222112.236499:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074728f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081757952:0@lo:400:kworker.0 00000100:00100000:2.0:1782222112.236521:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222112.236642:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081757440 00000100:00100000:0.0:1782222112.236646:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081757440 00000100:00100000:0.0:1782222112.236670:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081757952 00000100:00100000:0.0:1782222112.236672:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081757952 00000100:00100000:0.0:1782222112.236688:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1782222112.236693:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074767a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081757440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222112.236726:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074767a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081757440:12345-0@lo:400:kworker.0 Request processed in 32us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222112.236732:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1782222112.236742:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1782222112.236748:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747678a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081757952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222112.236788:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747678a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081757952:12345-0@lo:400:kworker.0 Request processed in 40us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222112.236794:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1782222112.236842:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074728dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081756928:0@lo:400:kworker.0 00010000:00080000:2.0:1782222112.236858:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074728c380 x1868795081757440/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222112.236867:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074728c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081757440:0@lo:400:kworker.0 00010000:00080000:2.0:1782222112.236875:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074728f100 x1868795081757952/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222112.236882:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074728f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081757952:0@lo:400:kworker.0 00000100:00100000:2.0:1782222112.236911:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1782222112.236919:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081756544:0@lo:400:kworker.0 00000100:00100000:2.0:1782222112.236947:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222112.237101:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074728ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1868795081757056:0@lo:400:kworker.0 00000100:00100000:2.0:1782222112.237128:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222112.237154:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074728d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081757568:0@lo:400:kworker.0 00000100:00100000:2.0:1782222112.237175:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222112.237193:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074728e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081758080:0@lo:400:kworker.0 00000100:00100000:2.0:1782222112.237217:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222112.237344:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081757568 00000100:00100000:2.0:1782222112.237349:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081757568 00000100:00100000:2.0:1782222112.237373:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081758080 00000100:00100000:2.0:1782222112.237376:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081758080 00000100:00100000:2.0:1782222112.237390:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1782222112.237408:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081757568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222112.237443:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081757568:12345-0@lo:400:kworker.0 Request processed in 47us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222112.237449:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1782222112.237460:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1782222112.237465:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081758080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222112.237486:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081758080:12345-0@lo:400:kworker.0 Request processed in 22us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222112.237491:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1782222112.237657:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782222112.237662:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782222112.237665:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1782222112.237696:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074728f800 x1868795081757312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222112.237706:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074728f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1868795081757312:0@lo:400:kworker.0 00010000:00080000:3.0:1782222112.237717:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074728e680 x1868795081757824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222112.237724:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074728e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1868795081757824:0@lo:400:kworker.0 00000100:00100000:3.0:1782222112.237735:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081756672:0@lo:400:kworker.0 00000100:00100000:3.0:1782222112.237745:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074728d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1868795081757184:0@lo:400:kworker.0 00000100:00100000:3.0:1782222112.237755:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074728f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1868795081757696:0@lo:400:kworker.0 00010000:00080000:3.0:1782222112.237816:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074728d500 x1868795081757568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222112.237838:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074728d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081757568:0@lo:400:kworker.0 00010000:00080000:3.0:1782222112.237849:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074728e300 x1868795081758080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222112.237856:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074728e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081758080:0@lo:400:kworker.0 00000100:00100000:1.0:1782222112.238215:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081757056 00000100:00100000:1.0:1782222112.238221:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081757056 00000100:00100000:1.0:1782222112.238296:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1782222112.238304:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088159ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1868795081757056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222112.238356:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088159ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1868795081757056:12345-0@lo:400:kworker.0 Request processed in 52us (1225us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222112.238361:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1782222112.238512:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074728ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1868795081757056:0@lo:400:kworker.0 00000100:00100000:0.0:1782222112.246423:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081756544 00000100:00100000:0.0:1782222112.246442:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081756544 00000100:00100000:1.0:1782222112.246757:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1782222112.246769:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3655:x1868795081756544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222112.246879:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3655:x1868795081756544:12345-0@lo:400:kworker.0 Request processed in 113us (9929us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222112.246887:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1782222112.246999:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081756544:0@lo:400:kworker.0 00010000:00010000:0.0:1782222112.299513:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222113.323220:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1782222114.247473:0:12903:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782222114.247703:0:12903:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1782222114.348509:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222114.794698:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081758208:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782222114.794777:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222114.794871:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081758208 00000100:00100000:0.0:1782222114.794879:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081758208 00000100:00100000:0.0:1782222114.794936:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1782222114.794946:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074728ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081758208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782222114.794975:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782222114.795019:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074728ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081758208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222114.795026:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1782222114.795046:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1782222114.795077:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0881598e00 x1868795081758208/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222130 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222114.795096:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081758208:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782222114.795510:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081758336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782222114.795545:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222114.795614:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081758336 00000100:00100000:2.0:1782222114.795619:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081758336 00000100:00100000:2.0:1782222114.795661:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1782222114.795684:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081758336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782222114.795698:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782222114.795736:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081758336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222114.795742:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:2.0:1782222114.795771:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0881598a80 x1868795081758336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222130 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222114.795785:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081758336:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1782222114.795839:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782222115.371168:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222115.819128:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782222115.819150:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074728ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081758464:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782222115.819219:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222115.819319:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081758464 00000100:00100000:0.0:1782222115.819326:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081758464 00000100:00100000:0.0:1782222115.819388:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1782222115.819397:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074728d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081758464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782222115.819431:0:7480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1782222115.819492:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074728d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081758464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222115.819500:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1782222115.819586:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074728ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081758464:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782222115.823298:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782222115.823325:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081758592:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782222115.823421:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222115.824430:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081758592 00000100:00100000:1.0:1782222115.824441:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081758592 00000100:00100000:1.0:1782222115.824495:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1782222115.824504:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081758592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782222115.824542:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1782222115.824612:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081758592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222115.824619:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1782222115.824774:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081758592:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782222116.333494:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782222116.333516:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081758720:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782222116.333581:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222116.333644:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081758720 00000100:00100000:3.0:1782222116.333652:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081758720 00000100:00100000:3.0:1782222116.333712:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1782222116.333720:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747782a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081758720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782222116.333750:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222116.333796:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747782a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081758720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222116.333813:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:3.0:1782222116.333856:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747780000 x1868795081758720/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222132 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222116.333874:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081758720:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1782222116.333881:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782222116.344584:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782222116.344607:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081758848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782222116.344676:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222116.344730:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081758848 00000100:00100000:3.0:1782222116.344737:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081758848 00000100:00100000:3.0:1782222116.344784:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1782222116.344793:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081758848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782222116.344817:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222116.344856:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081758848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222116.344863:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1782222116.344881:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782222116.344911:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747780000 x1868795081758848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222132 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222116.344931:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081758848:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782222116.395556:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222116.784793:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222116.784830:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222116.784868:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222116.784894:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222116.784917:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222116.785021:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060701824 00000100:00100000:2.0:1782222116.785022:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060702080 00000100:00100000:2.0:1782222116.785032:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060702080 00000100:00100000:3.0:1782222116.785033:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060701824 00000100:00100000:2.0:1782222116.785095:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060701696 00000100:00100000:2.0:1782222116.785099:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060701696 00000100:00100000:1.0:1782222116.785100:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060701568 00000100:00100000:1.0:1782222116.785104:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060701568 00000100:00100000:1.0:1782222116.785135:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 317 00000100:00100000:1.0:1782222116.785144:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2389:x1868795060701568:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222116.785214:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2389:x1868795060701568:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 70us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222116.785221:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 317 00000100:00100000:1.0:1782222116.785275:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060701952 00000100:00100000:1.0:1782222116.785279:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060701952 00000100:00100000:3.0:1782222116.787937:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 194 00000100:00100000:3.0:1782222116.787951:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074728df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2389:x1868795060702080:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222116.788027:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074728df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2389:x1868795060702080:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 79us (3157us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222116.788067:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 194 00000100:00100000:3.0:1782222116.788087:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 195 00000100:00100000:3.0:1782222116.788095:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074728ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+5:2389:x1868795060701824:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222116.788124:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074728ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+5:2389:x1868795060701824:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 30us (3293us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222116.788130:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 195 00000100:00100000:2.0:1782222116.789489:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 196 00000100:00100000:2.0:1782222116.789503:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074728fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+6:2389:x1868795060701696:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222116.789567:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074728fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+6:2389:x1868795060701696:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 68us (4671us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222116.789573:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 196 00000100:00080000:0.0:1782222116.789727:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782222116.790883:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782222116.791780:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 197 00000100:00100000:1.0:1782222116.791794:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074728ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2389:x1868795060701952:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222116.791888:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074728ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2389:x1868795060701952:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 97us (6969us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222116.791896:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 197 00000001:00100000:0.0:1782222116.850968:0:8436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of eb78d98d-0650-4da4-8eeb-708f911905dd 00000020:00000080:0.0:1782222116.850979:0:8436:0:(genops.c:906:class_export_put()) final put ffff8f0881597800/eb78d98d-0650-4da4-8eeb-708f911905dd 00000020:00000080:1.0:1782222116.851063:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0881597800/eb78d98d-0650-4da4-8eeb-708f911905dd for lustre-OST0000 00000020:00000080:1.0:1782222116.851130:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f0881594000 for lustre-OST0000 00000001:00100000:3.0:1782222116.851584:0:9523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of eb78d98d-0650-4da4-8eeb-708f911905dd 00000020:00000080:3.0:1782222116.851598:0:9523:0:(genops.c:906:class_export_put()) final put ffff8f08815e2000/eb78d98d-0650-4da4-8eeb-708f911905dd 00000020:00000080:2.0:1782222116.851761:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f08815e2000/eb78d98d-0650-4da4-8eeb-708f911905dd for lustre-OST0001 00000020:00000080:2.0:1782222116.857644:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f08815e1800 for lustre-OST0001 00000100:00100000:1.0:1782222117.356727:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081759232:0@lo:400:kworker.0 00000100:00100000:1.0:1782222117.356792:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222117.356839:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1868795081759744:0@lo:400:kworker.0 00000100:00100000:1.0:1782222117.356863:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222117.356881:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1868795081760256:0@lo:400:kworker.0 00000100:00100000:1.0:1782222117.356901:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222117.356926:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1782222117.356932:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081759360:0@lo:400:kworker.0 00000100:00100000:1.0:1782222117.356953:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222117.356968:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747531880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081759872:0@lo:400:kworker.0 00000100:00100000:1.0:1782222117.356989:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222117.357005:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081760384:0@lo:400:kworker.0 00000100:00100000:1.0:1782222117.357022:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222117.357053:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081759744 00000100:00100000:1.0:1782222117.357060:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081759744 00000100:00100000:1.0:1782222117.357106:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081760256 00000100:00100000:1.0:1782222117.357110:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081760256 00000100:00100000:1.0:1782222117.357133:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1782222117.357141:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1868795081759744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222117.357191:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1868795081759744:12345-0@lo:400:kworker.0 Request processed in 50us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222117.357199:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1782222117.357216:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1782222117.357222:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1868795081760256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222117.357270:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1868795081760256:12345-0@lo:400:kworker.0 Request processed in 48us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222117.357284:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1782222117.357306:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081759232 00000100:00100000:1.0:1782222117.357310:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081759232 00000100:00100000:1.0:1782222117.357329:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081759360 00000100:00100000:1.0:1782222117.357332:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081759360 00000100:00100000:1.0:1782222117.357344:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1782222117.357349:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081759232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222117.357391:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081759232:12345-0@lo:400:kworker.0 Request processed in 41us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222117.357396:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1782222117.357407:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1782222117.357413:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081759360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222117.357437:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081759360:12345-0@lo:400:kworker.0 Request processed in 25us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222117.357442:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1782222117.357459:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081759872 00000100:00100000:1.0:1782222117.357462:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081759872 00000100:00100000:1.0:1782222117.357485:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081760384 00000100:00100000:1.0:1782222117.357488:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081760384 00000100:00100000:1.0:1782222117.357508:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1782222117.357513:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081759872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222117.357543:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081759872:12345-0@lo:400:kworker.0 Request processed in 29us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222117.357549:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1782222117.357560:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1782222117.357567:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081760384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222117.357605:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081760384:12345-0@lo:400:kworker.0 Request processed in 38us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222117.357611:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:1.0:1782222117.357631:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782222117.357635:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782222117.357675:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081759360:0@lo:400:kworker.0 00010000:00080000:1.0:1782222117.357688:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747531880 x1868795081759872/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222117.357699:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747531880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081759872:0@lo:400:kworker.0 00010000:00080000:1.0:1782222117.357709:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474d0380 x1868795081760384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222117.357718:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081760384:0@lo:400:kworker.0 00000100:00100000:1.0:1782222117.357727:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081759232:0@lo:400:kworker.0 00010000:00080000:1.0:1782222117.357736:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747531c00 x1868795081759744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222117.357744:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1868795081759744:0@lo:400:kworker.0 00010000:00080000:1.0:1782222117.357753:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474d3800 x1868795081760256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222117.357760:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1868795081760256:0@lo:400:kworker.0 00000100:00100000:0.0:1782222117.357869:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081758976:0@lo:400:kworker.0 00000100:00100000:0.0:1782222117.357905:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222117.357942:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1868795081759488:0@lo:400:kworker.0 00000100:00100000:0.0:1782222117.357964:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222117.357982:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081760000:0@lo:400:kworker.0 00000100:00100000:0.0:1782222117.358002:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222117.358017:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081760512:0@lo:400:kworker.0 00000100:00100000:0.0:1782222117.358036:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222117.358063:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1782222117.358069:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1868795081759104:0@lo:400:kworker.0 00000100:00100000:0.0:1782222117.358090:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222117.358105:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1868795081759616:0@lo:400:kworker.0 00000100:00100000:0.0:1782222117.358123:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222117.358137:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1868795081760128:0@lo:400:kworker.0 00000100:00100000:0.0:1782222117.358154:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222117.358187:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081759488 00000100:00100000:0.0:1782222117.358191:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081759488 00000100:00100000:0.0:1782222117.358211:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081759104 00000100:00100000:0.0:1782222117.358214:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081759104 00000100:00100000:0.0:1782222117.358223:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081759616 00000100:00100000:0.0:1782222117.358226:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081759616 00000100:00100000:0.0:1782222117.358275:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081760128 00000100:00100000:0.0:1782222117.358278:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081760128 00000100:00100000:0.0:1782222117.358292:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1782222117.358298:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074728c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1868795081759488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222117.358335:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074728c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1868795081759488:12345-0@lo:400:kworker.0 Request processed in 37us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222117.358341:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1782222117.358354:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1782222117.358371:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074728e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1868795081759104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222117.358397:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074728e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1868795081759104:12345-0@lo:400:kworker.0 Request processed in 27us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222117.358402:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1782222117.358413:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1782222117.358419:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074728d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1868795081759616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222117.358457:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074728d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1868795081759616:12345-0@lo:400:kworker.0 Request processed in 39us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222117.358464:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1782222117.358475:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1782222117.358481:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074728f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1868795081760128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222117.358506:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074728f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1868795081760128:12345-0@lo:400:kworker.0 Request processed in 25us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222117.358511:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1782222117.358528:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081760000 00000100:00100000:0.0:1782222117.358532:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081760000 00000100:00100000:0.0:1782222117.358551:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081760512 00000100:00100000:0.0:1782222117.358554:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081760512 00000100:00100000:0.0:1782222117.358570:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1782222117.358575:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074728c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081760000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222117.358603:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074728c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081760000:12345-0@lo:400:kworker.0 Request processed in 28us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222117.358609:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1782222117.358619:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1782222117.358624:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074728ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081760512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222117.358647:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074728ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081760512:12345-0@lo:400:kworker.0 Request processed in 23us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222117.358652:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:0.0:1782222117.358673:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782222117.358676:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782222117.358701:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1868795081759104:0@lo:400:kworker.0 00000100:00100000:0.0:1782222117.358710:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1868795081759616:0@lo:400:kworker.0 00000100:00100000:0.0:1782222117.358728:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1868795081760128:0@lo:400:kworker.0 00000100:00100000:0.0:1782222117.358736:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1868795081759488:0@lo:400:kworker.0 00010000:00080000:0.0:1782222117.358745:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747531f80 x1868795081760000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222117.358752:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081760000:0@lo:400:kworker.0 00010000:00080000:0.0:1782222117.358761:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474d1c00 x1868795081760512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222117.358768:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081760512:0@lo:400:kworker.0 00000100:00100000:1.0:1782222117.359517:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081758976 00000100:00100000:1.0:1782222117.359525:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081758976 00000100:00100000:1.0:1782222117.359571:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1782222117.359579:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3655:x1868795081758976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222117.359644:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3655:x1868795081758976:12345-0@lo:400:kworker.0 Request processed in 66us (1739us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222117.359651:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1782222117.359883:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081758976:0@lo:400:kworker.0 00010000:00010000:3.0:1782222117.431336:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782222118.050426:0:13047:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1782222118.442625:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222119.466542:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782222119.919974:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081760640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782222119.920041:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222119.920351:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081760640 00000100:00100000:1.0:1782222119.920359:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081760640 00000100:00100000:1.0:1782222119.920417:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1782222119.920425:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081760640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782222119.920457:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782222119.920503:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081760640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222119.920510:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:1.0:1782222119.920557:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474d3800 x1868795081760640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222135 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222119.920574:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081760640:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1782222119.921106:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782222119.923879:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782222119.923899:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081760768:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782222119.923958:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222119.923999:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081760768 00000100:00100000:1.0:1782222119.924007:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081760768 00000100:00100000:1.0:1782222119.924050:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1782222119.924058:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081760768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782222119.924079:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782222119.924126:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081760768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222119.924133:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1782222119.924154:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1782222119.924181:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474d3800 x1868795081760768/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222135 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222119.924198:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081760768:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1782222120.493319:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782222120.939049:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074728d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081760896:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782222120.939125:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222120.940186:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081760896 00000100:00100000:3.0:1782222120.940197:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081760896 00000100:00100000:3.0:1782222120.940268:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1782222120.940277:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081760896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782222120.940314:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1782222120.940398:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081760896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (1272us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222120.940406:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1782222120.940624:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782222120.940637:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081761024:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782222120.940673:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222120.940793:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074728d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081760896:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782222120.941002:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081761024 00000100:00100000:0.0:1782222120.941007:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081761024 00000100:00100000:0.0:1782222120.941055:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1782222120.941063:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081761024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782222120.941087:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1782222120.941136:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081761024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222120.941143:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1782222120.941271:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081761024:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782222121.451629:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782222121.451661:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081761280:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782222121.451757:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222121.451836:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081761280 00000100:00100000:1.0:1782222121.451846:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081761280 00000100:00100000:1.0:1782222121.451925:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1782222121.451935:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081761280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782222121.451978:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782222121.452031:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081761280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222121.452039:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1782222121.452066:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782222121.452105:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747531f80 x1868795081761280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222137 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222121.452143:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081761280:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782222121.452465:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782222121.452558:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081761152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782222121.452603:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222121.452638:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081761152 00000100:00100000:3.0:1782222121.452643:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081761152 00000100:00100000:3.0:1782222121.452678:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1782222121.452686:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081761152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782222121.452710:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222121.452747:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081761152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222121.452754:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:3.0:1782222121.452786:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747780000 x1868795081761152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222137 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222121.452801:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081761152:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782222121.453391:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782222121.523675:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222121.895600:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222121.895667:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222121.895711:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222121.895733:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222121.895766:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222121.895803:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060702336 00000100:00100000:3.0:1782222121.895816:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060702336 00000100:00100000:3.0:1782222121.895881:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060702592 00000100:00100000:3.0:1782222121.895885:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060702592 00000100:00100000:3.0:1782222121.895900:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060702464 00000100:00100000:3.0:1782222121.895903:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060702464 00000100:00100000:3.0:1782222121.895916:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060702720 00000100:00100000:3.0:1782222121.895918:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060702720 00000100:00100000:3.0:1782222121.895936:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 204 00000100:00100000:3.0:1782222121.898407:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+6:2389:x1868795060702336:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222121.898545:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+6:2389:x1868795060702336:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 181us (2962us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222121.899853:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 205 00000100:00100000:1.0:1782222121.899877:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2389:x1868795060702592:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222121.901084:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2389:x1868795060702592:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 1206us (5413us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222121.901104:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 205 00000100:00100000:1.0:1782222121.901228:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 206 00000100:00100000:1.0:1782222121.901254:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060702464:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222121.901313:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060702464:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 64us (5578us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222121.901320:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 206 00000100:00100000:1.0:1782222121.901346:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 207 00000100:00100000:1.0:1782222121.901355:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2390:x1868795060702720:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222121.901513:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060702208 00000100:00100000:2.0:1782222121.901524:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060702208 00000100:00100000:2.0:1782222121.901577:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 319 00000100:00100000:2.0:1782222121.901584:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2390:x1868795060702208:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222121.901624:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2390:x1868795060702208:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 41us (5913us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222121.901631:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 319 00000100:00100000:3.0:1782222121.901793:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 204 00000100:00080000:3.0:1782222121.901821:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782222121.901834:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782222121.902017:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2390:x1868795060702720:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 661us (6248us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222121.902024:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 207 00000020:00000080:1.0:1782222122.007892:0:13195:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdda359130 20000000:00000080:1.0:1782222122.007921:0:13195:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f0881639400 uarg=0000000000000000 20000000:01000000:1.0:1782222122.007983:0:13195:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1782222122.007990:0:13195:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1782222122.007997:0:13195:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1782222122.009194:0:13196:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1782222122.009701:0:13195:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1782222122.017015:0:13195:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1782222122.017059:0:13195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f074744dc00/0xe2b7cc26e6811358 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222122.017085:0:13195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f087fb83800/0xe2b7cc26e68112e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558347 expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222122.017094:0:13195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f087fb82600/0xe2b7cc26e68112f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68112ef expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222122.017101:0:13195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e6811304 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68112fd expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222122.017108:0:13195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f087fb82c00/0xe2b7cc26e6811312 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e681130b expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222122.017114:0:13195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f087fb83e00/0xe2b7cc26e6811320 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6811319 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222122.017120:0:13195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f087fb82800/0xe2b7cc26e6811335 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558386 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222122.017129:0:13195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f074744dc00/0xe2b7cc26e6811358 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222122.017188:0:13195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f087fb82800/0xe2b7cc26e6811335 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558386 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222122.017207:0:13195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f087fb82800/0xe2b7cc26e6811335 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558386 expref: 12 pid: 6520 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222122.017227:0:13195:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747531f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13195:1868795081761408:192.168.203.27@tcp:104: 00010000:00010000:1.0:1782222122.018084:0:13195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f087fb83e00/0xe2b7cc26e6811320 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e6811319 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222122.018097:0:13195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f087fb83e00/0xe2b7cc26e6811320 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e6811319 expref: 23 pid: 6519 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222122.018111:0:13195:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747533480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13195:1868795081761536:0@lo:104: 00000100:00100000:1.0:1782222122.018161:0:13195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782222122.018205:0:13195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f087fb82c00/0xe2b7cc26e6811312 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e681130b expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222122.018212:0:13195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f087fb82c00/0xe2b7cc26e6811312 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e681130b expref: 23 pid: 6521 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222122.018220:0:13195:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747531c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13195:1868795081761664:0@lo:104: 00000100:00100000:1.0:1782222122.018273:0:13195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222122.018312:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081761536 00000100:00100000:1.0:1782222122.018320:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081761536 00000100:00100000:3.0:1782222122.018497:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081761664 00000100:00100000:3.0:1782222122.018503:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081761664 00000100:00100000:3.0:1782222122.018534:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782222122.018544:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747531180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+4:13195:x1868795081761536:12345-0@lo:104: 00010000:00010000:3.0:1782222122.018561:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e6811319 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6811320 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222122.018628:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782222122.018636:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747531180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+4:13195:x1868795081761536:12345-0@lo:104: Request processed in 94us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222122.018643:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782222122.018679:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782222122.018686:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747533800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+3:13195:x1868795081761664:12345-0@lo:104: 00010000:00010000:3.0:1782222122.018695:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f087fb82a00/0xe2b7cc26e681130b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6811312 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222122.018731:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782222122.018736:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747533800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+3:13195:x1868795081761664:12345-0@lo:104: Request processed in 51us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222122.018743:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:3.0:1782222122.018765:0:7468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782222122.018771:0:7468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e6811319 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6811320 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222122.018778:0:7468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0840030c00 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:3.0:1782222122.018783:0:7468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e6811319 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e6811320 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222122.018807:0:7468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e6811319 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e6811320 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782222122.018814:0:7468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e6811319 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e6811320 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782222122.018820:0:7468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782222122.018851:0:7468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e6811319 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811320 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222122.018858:0:7468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782222122.018883:0:7468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e6811319 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811320 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222122.018891:0:7468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e6811319 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811320 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222122.018907:0:7468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782222122.018910:0:7468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f087fb82a00/0xe2b7cc26e681130b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6811312 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222122.018916:0:7468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb82a00 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:3.0:1782222122.018919:0:7468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f087fb82a00/0xe2b7cc26e681130b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e6811312 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222122.018926:0:7468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f087fb82a00/0xe2b7cc26e681130b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e6811312 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782222122.018933:0:7468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f087fb82a00/0xe2b7cc26e681130b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e6811312 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782222122.018946:0:7468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782222122.018963:0:7468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f087fb82a00/0xe2b7cc26e681130b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811312 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222122.018969:0:7468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782222122.018986:0:7468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f087fb82a00/0xe2b7cc26e681130b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811312 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222122.018994:0:7468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f087fb82a00/0xe2b7cc26e681130b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811312 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222122.019005:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222122.019007:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222122.019008:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222122.019015:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222122.019030:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3654:1868795081761792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782222122.019067:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222122.019118:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081761920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782222122.019143:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222122.019178:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081761792 00000100:00100000:3.0:1782222122.019182:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081761792 00010000:00010000:3.0:1782222122.019204:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f087fb83e00/0xe2b7cc26e6811320 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6811319 expref: 24 pid: 6519 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222122.019225:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081761920 00000100:00100000:3.0:1782222122.019227:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081761920 00010000:00010000:3.0:1782222122.019284:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f087fb82c00/0xe2b7cc26e6811312 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e681130b expref: 25 pid: 6521 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222122.019320:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782222122.019338:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877155180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+25:3654:x1868795081761792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782222122.019351:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222122.019357:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f087fb83e00/0xe2b7cc26e6811320 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6811319 expref: 25 pid: 6519 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222122.019367:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f087fb83e00/0xe2b7cc26e6811320 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e6811319 expref: 25 pid: 6519 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222122.019399:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782222122.019429:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877155180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+25:3654:x1868795081761792:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222122.019437:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782222122.019452:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782222122.019458:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877155c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3655:x1868795081761920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782222122.019466:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222122.019470:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f087fb82c00/0xe2b7cc26e6811312 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e681130b expref: 24 pid: 6521 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222122.019478:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f087fb82c00/0xe2b7cc26e6811312 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e681130b expref: 24 pid: 6521 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222122.019488:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782222122.019514:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877155c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3655:x1868795081761920:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222122.019520:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782222122.019558:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081761920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782222122.019596:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3654:1868795081761792:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782222122.020123:0:13195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e6811304 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e68112fd expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222122.020138:0:13195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e6811304 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e68112fd expref: 23 pid: 6519 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222122.020150:0:13195:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747531880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13195:1868795081762048:0@lo:104: 00000100:00100000:1.0:1782222122.020189:0:13195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782222122.020227:0:13195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f087fb82600/0xe2b7cc26e68112f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e68112ef expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222122.020256:0:13195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f087fb82600/0xe2b7cc26e68112f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e68112ef expref: 23 pid: 6521 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222122.020274:0:13195:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b17480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13195:1868795081762176:0@lo:104: 00000100:00100000:1.0:1782222122.020299:0:13195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222122.020333:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081762048 00000100:00100000:1.0:1782222122.020338:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081762048 00000100:00100000:1.0:1782222122.020365:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081762176 00000100:00100000:1.0:1782222122.020367:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081762176 00000100:00100000:1.0:1782222122.021034:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782222122.021048:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747530380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+4:13195:x1868795081762048:12345-0@lo:104: 00010000:00010000:1.0:1782222122.021063:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e68112fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6811304 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222122.021138:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782222122.021146:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747530380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+4:13195:x1868795081762048:12345-0@lo:104: Request processed in 104us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222122.021153:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782222122.021175:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782222122.021181:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+3:13195:x1868795081762176:12345-0@lo:104: 00010000:00010000:1.0:1782222122.021191:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f0875803200/0xe2b7cc26e68112ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e68112f6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222122.021222:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782222122.021226:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+3:13195:x1868795081762176:12345-0@lo:104: Request processed in 46us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222122.021231:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1782222122.021366:0:13195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f087fb83800/0xe2b7cc26e68112e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558347 expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222122.024374:0:7468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782222122.024792:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782222122.024811:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f0875803200/0xe2b7cc26e68112ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e68112f6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222122.024851:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0875803200 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:0.0:1782222122.024856:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f0875803200/0xe2b7cc26e68112ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e68112f6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222122.024868:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f0875803200/0xe2b7cc26e68112ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e68112f6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782222122.024875:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f0875803200/0xe2b7cc26e68112ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e68112f6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782222122.024881:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782222122.024943:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f0875803200/0xe2b7cc26e68112ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e68112f6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222122.024948:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782222122.024978:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f0875803200/0xe2b7cc26e68112ef lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e68112f6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222122.024984:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f0875803200/0xe2b7cc26e68112ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e68112f6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222122.025001:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222122.025004:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222122.025006:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222122.025027:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074728e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081762432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782222122.025113:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222122.025212:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081762432 00000100:00100000:0.0:1782222122.025221:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081762432 00010000:00010000:0.0:1782222122.025278:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f087fb82600/0xe2b7cc26e68112f6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e68112ef expref: 24 pid: 6521 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222122.025337:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1782222122.025347:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074728f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3656:x1868795081762432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782222122.025368:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222122.025375:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f087fb82600/0xe2b7cc26e68112f6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e68112ef expref: 24 pid: 6521 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222122.026628:0:13195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f087fb83800/0xe2b7cc26e68112e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558347 expref: 12 pid: 6521 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222122.026653:0:13195:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b15c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13195:1868795081762304:192.168.203.27@tcp:104: 00000100:00100000:1.0:1782222122.026783:0:13195:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f085292af00 going to sleep for 11 seconds 00010000:00010000:1.0:1782222122.026821:0:13195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f087fb83e00/0xe2b7cc26e6811320 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e6811319 expref: 24 pid: 6519 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222122.026843:0:13195:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747533480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13195:1868795081761536:0@lo:104: 00010000:00010000:1.0:1782222122.026857:0:13195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f087fb82c00/0xe2b7cc26e6811312 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e681130b expref: 23 pid: 6521 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222122.026866:0:13195:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747531c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13195:1868795081761664:0@lo:104: 00000100:00100000:1.0:1782222122.026876:0:13195:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747531880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13195:1868795081762048:0@lo:104: 00000100:00100000:1.0:1782222122.026884:0:13195:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b17480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13195:1868795081762176:0@lo:104: 00010000:00010000:0.0:1782222122.027179:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f087fb82600/0xe2b7cc26e68112f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e68112ef expref: 22 pid: 6521 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222122.027203:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f087fb82600/0xe2b7cc26e68112f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e68112ef expref: 22 pid: 6521 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222122.027220:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782222122.027321:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074728f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:3656:x1868795081762432:12345-0@lo:103:ldlm_bl.0 Request processed in 1975us (2207us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222122.027345:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:3.0:1782222122.027957:0:7468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e68112fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6811304 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222122.027968:0:7468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0840031a00 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:3.0:1782222122.027973:0:7468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e68112fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e6811304 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222122.027985:0:7468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e68112fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e6811304 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782222122.027994:0:7468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e68112fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e6811304 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782222122.028000:0:7468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782222122.028056:0:7468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e68112fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811304 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222122.028064:0:7468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782222122.028086:0:7468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e68112fd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811304 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222122.028094:0:7468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e68112fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811304 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222122.028120:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222122.028122:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222122.028124:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222122.028368:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222122.030285:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074728e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081762432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782222122.030362:0:13195:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747531f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13195:1868795081761408:192.168.203.27@tcp:104: 00000100:00100000:3.0:1782222122.031074:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081762560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782222122.031154:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222122.031216:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060702848 00000100:00100000:3.0:1782222122.031223:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060702848 00010000:00010000:3.0:1782222122.031282:0:9532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f087fb82800/0xe2b7cc26e6811335 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558386 expref: 13 pid: 6520 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222122.031311:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081762560 00000100:00100000:3.0:1782222122.031314:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081762560 00010000:00010000:3.0:1782222122.031336:0:9532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e6811304 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e68112fd expref: 21 pid: 6519 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222122.031355:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 43 00000100:00100000:3.0:1782222122.031365:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2389:x1868795060702848:12345-192.168.203.27@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1782222122.031796:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1782222122.031809:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747780000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:3653:x1868795081762560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782222122.031823:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222122.031829:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e6811304 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e68112fd expref: 21 pid: 6519 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222122.031842:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e6811304 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e68112fd expref: 21 pid: 6519 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222122.031864:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e6811304 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e68112fd expref: 21 pid: 6519 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222122.031900:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782222122.031955:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747780000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:3653:x1868795081762560:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222122.031963:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1782222122.032009:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081762560:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782222122.032075:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222122.032083:0:9532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f087fb82800/0xe2b7cc26e6811335 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558386 expref: 13 pid: 6520 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222122.032094:0:9532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f087fb82800/0xe2b7cc26e6811335 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558386 expref: 13 pid: 6520 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222122.032105:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f087fb82800/0xe2b7cc26e6811335 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558386 expref: 13 pid: 6520 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222122.032116:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782222122.032717:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2ca5b6e-1b2d-4770-b014-03af882e6158+12:2389:x1868795060702848:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 1348us (4348us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222122.032726:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 43 00000100:00100000:1.0:1782222122.039033:0:13195:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b15c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13195:1868795081762304:192.168.203.27@tcp:104: 00010000:00010000:1.0:1782222122.039092:0:13195:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f074744dc00/0xe2b7cc26e6811358 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222122.041991:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222122.042100:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060702976 00000100:00100000:0.0:1782222122.042115:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060702976 00010000:00010000:0.0:1782222122.042172:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f087fb83800/0xe2b7cc26e68112e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558347 expref: 12 pid: 6521 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222122.042230:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 45 00000100:00100000:0.0:1782222122.042288:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08429a8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2ca5b6e-1b2d-4770-b014-03af882e6158+12:2390:x1868795060702976:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782222122.042309:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222122.042315:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f087fb83800/0xe2b7cc26e68112e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558347 expref: 12 pid: 6521 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222122.042338:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f087fb83800/0xe2b7cc26e68112e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558347 expref: 12 pid: 6521 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222122.042362:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f087fb83800/0xe2b7cc26e68112e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558347 expref: 12 pid: 6521 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222122.042386:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f074744dc00/0xe2b7cc26e6811358 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222122.042396:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f074744dc00/0xe2b7cc26e6811358 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222122.042427:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f074744dc00/0xe2b7cc26e6811358 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222122.042434:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f074744dc00/0xe2b7cc26e6811358 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222122.042440:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f074744dc00/0xe2b7cc26e6811358 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222122.042446:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f074744dc00/0xe2b7cc26e6811358 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222122.042452:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744dc00 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:0.0:1782222122.042457:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f074744dc00/0xe2b7cc26e6811358 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222122.042467:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f074744dc00/0xe2b7cc26e6811358 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222122.042484:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f074744dc00/0xe2b7cc26e6811358 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222122.042499:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782222122.042584:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08429a8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2ca5b6e-1b2d-4770-b014-03af882e6158+11:2390:x1868795060702976:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 297us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222122.042594:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 45 00010000:00010000:1.0:1782222122.042871:0:13195:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f074744dc00/0xe2b7cc26e6811358 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222122.042881:0:13195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f074744dc00/0xe2b7cc26e6811358 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222122.042897:0:13195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f074744dc00/0xe2b7cc26e6811358 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222122.474962:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782222122.475152:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081762816:0@lo:400:kworker.0 00000100:00100000:2.0:1782222122.475285:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222122.475346:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782222122.475352:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081762944:0@lo:400:kworker.0 00000100:00100000:2.0:1782222122.475378:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222122.475409:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782222122.475421:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081762816 00000100:00100000:3.0:1782222122.475422:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1868795081763072:0@lo:400:kworker.0 00000100:00100000:2.0:1782222122.475430:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081762816 00000100:00100000:3.0:1782222122.475459:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222122.475499:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081762944 00000100:00100000:3.0:1782222122.475503:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081762944 00000100:00100000:2.0:1782222122.475504:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1782222122.475513:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081762816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222122.475523:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1782222122.475528:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081762944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222122.480227:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081762944:12345-0@lo:400:kworker.0 Request processed in 4681us (4832us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222122.480264:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1782222122.480343:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081762688:0@lo:400:kworker.0 00000100:00100000:3.0:1782222122.480397:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081762944:0@lo:400:kworker.0 00000100:00100000:3.0:1782222122.480412:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081762816:0@lo:400:kworker.0 00000100:00100000:0.0:1782222122.480434:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222122.480470:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081763072 00000100:00100000:3.0:1782222122.480478:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081763072 00000100:00100000:3.0:1782222122.480527:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081762688 00000100:00100000:3.0:1782222122.480531:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081762688 00000100:00100000:3.0:1782222122.480561:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1782222122.480571:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1868795081763072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222122.480655:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1868795081763072:12345-0@lo:400:kworker.0 Request processed in 85us (5194us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222122.480841:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1782222122.480858:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1782222122.480865:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074728f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081762688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222122.480934:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081762688:0@lo:400:kworker.0 00000100:00100000:0.0:1782222122.481090:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1868795081763072:0@lo:400:kworker.0 00000100:00100000:2.0:1782222122.482640:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081762816:12345-0@lo:400:kworker.0 Request processed in 7116us (7344us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222122.482658:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1782222122.484188:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1868795081763328:0@lo:400:kworker.0 00000100:00100000:1.0:1782222122.484305:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222122.484352:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747531880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1868795081763840:0@lo:400:kworker.0 00000100:00100000:1.0:1782222122.484376:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222122.484401:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1782222122.484407:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081763456:0@lo:400:kworker.0 00000100:00100000:1.0:1782222122.484434:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222122.484450:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081763968:0@lo:400:kworker.0 00000100:00100000:0.0:1782222122.484961:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081763456 00000100:00100000:0.0:1782222122.484973:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081763456 00000100:00100000:0.0:1782222122.485202:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1782222122.485215:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849badf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081763456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222122.485338:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849badf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081763456:12345-0@lo:400:kworker.0 Request processed in 124us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222122.485345:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1782222122.485378:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081763328 00000100:00100000:0.0:1782222122.485382:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081763328 00000100:00100000:0.0:1782222122.485421:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081763840 00000100:00100000:0.0:1782222122.485423:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081763840 00000100:00100000:0.0:1782222122.485440:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1782222122.485445:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849baed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1868795081763328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222122.486171:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222122.487294:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081763968 00000100:00100000:0.0:1782222122.487308:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849baed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1868795081763328:12345-0@lo:400:kworker.0 Request processed in 1848us (2990us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222122.487313:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081763968 00000100:00100000:0.0:1782222122.487335:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1782222122.487374:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1782222122.487388:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1868795081763840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222122.487393:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1782222122.487404:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849baca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081763968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222122.487494:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849baca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081763968:12345-0@lo:400:kworker.0 Request processed in 92us (3020us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222122.487498:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1868795081763840:12345-0@lo:400:kworker.0 Request processed in 113us (3118us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222122.487507:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1782222122.487511:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00080000:0.0:1782222122.487542:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1782222122.487547:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0849b15c00 x1868795081763328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782222122.487549:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782222122.487568:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1868795081763328:0@lo:400:kworker.0 00000100:00100000:2.0:1782222122.487588:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1868795081763200:0@lo:400:kworker.0 00010000:00080000:1.0:1782222122.487588:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747531880 x1868795081763840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222122.487604:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081763584:0@lo:400:kworker.0 00000100:00100000:1.0:1782222122.487608:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747531880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1868795081763840:0@lo:400:kworker.0 00010000:00080000:1.0:1782222122.487647:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0849b17480 x1868795081763456/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222122.487655:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081763456:0@lo:400:kworker.0 00010000:00080000:1.0:1782222122.487665:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747531c00 x1868795081763968/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222122.487695:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081763968:0@lo:400:kworker.0 00000100:00100000:0.0:1782222122.487900:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222122.487937:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081764096:0@lo:400:kworker.0 00000100:00100000:0.0:1782222122.487963:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222122.487997:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081763584 00000100:00100000:0.0:1782222122.488002:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081763584 00000100:00100000:0.0:1782222122.488025:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081764096 00000100:00100000:0.0:1782222122.488027:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081764096 00000100:00100000:0.0:1782222122.488065:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1782222122.488073:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074728f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081763584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222122.488109:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074728f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081763584:12345-0@lo:400:kworker.0 Request processed in 37us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222122.488116:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1782222122.488128:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1782222122.488134:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074728c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081764096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222122.488209:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222122.488276:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1868795081763712:0@lo:400:kworker.0 00000100:00100000:2.0:1782222122.488315:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222122.488357:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081763200 00000100:00100000:2.0:1782222122.488362:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081763200 00000100:00100000:2.0:1782222122.488389:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081763712 00000100:00100000:2.0:1782222122.488392:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081763712 00000100:00100000:2.0:1782222122.488409:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1782222122.488415:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1868795081763200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222122.488450:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074728c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081764096:12345-0@lo:400:kworker.0 Request processed in 177us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222122.488456:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1868795081763200:12345-0@lo:400:kworker.0 Request processed in 39us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222122.488463:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1782222122.488468:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1782222122.488486:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00080000:0.0:1782222122.488490:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782222122.488494:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1868795081763712:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1782222122.488497:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1782222122.488534:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0849b16a00 x1868795081763584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222122.488541:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1868795081763712:12345-0@lo:400:kworker.0 Request processed in 47us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222122.488555:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1782222122.488558:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081763584:0@lo:400:kworker.0 00010000:00080000:0.0:1782222122.488576:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747533480 x1868795081764096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222122.488585:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081764096:0@lo:400:kworker.0 00000100:00100000:2.0:1782222122.488593:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1868795081763200:0@lo:400:kworker.0 00000100:00100000:2.0:1782222122.488610:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1868795081763712:0@lo:400:kworker.0 00000100:00100000:3.0:1782222122.490821:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074728f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081762688:12345-0@lo:400:kworker.0 Request processed in 9936us (10366us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222122.490841:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00010000:00010000:3.0:1782222122.538675:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222123.249679:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222123.257465:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060703104 00000100:00100000:2.0:1782222123.257522:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060703104 00000100:00100000:2.0:1782222123.258200:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 320 00000100:00100000:2.0:1782222123.258218:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08672c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+11:6161:x1868795060703104:12345-192.168.203.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782222123.258267:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222123.258295:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f087fb82400/0xe2b7cc26e681135f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x558f77f2f75583b7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222123.258358:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fb82400/0xe2b7cc26e681135f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583b7 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222123.258372:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f087fb82400/0xe2b7cc26e681135f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583b7 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222123.258384:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb82400, rc 0) 00000100:00100000:2.0:1782222123.258475:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08672c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+12:6161:x1868795060703104:12345-192.168.203.27@tcp:101:ll_cfg_requeue.0 Request processed in 261us (8809us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222123.258483:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 320 00000100:00100000:3.0:1782222123.261807:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222123.267283:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060703232 00000100:00100000:0.0:1782222123.267303:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060703232 00000100:00100000:0.0:1782222123.267407:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 321 00000100:00100000:0.0:1782222123.267421:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+12:6161:x1868795060703232:12345-192.168.203.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782222123.267660:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+12:6161:x1868795060703232:12345-192.168.203.27@tcp:501:ll_cfg_requeue.0 Request processed in 242us (5868us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222123.267669:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 321 00000100:00100000:3.0:1782222123.280139:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222123.280446:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060703360 00000100:00100000:0.0:1782222123.280463:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060703360 00000100:00100000:0.0:1782222123.280540:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 322 00000100:00100000:0.0:1782222123.280552:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08672c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+12:6161:x1868795060703360:12345-192.168.203.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782222123.280756:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08672c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+12:6161:x1868795060703360:12345-192.168.203.27@tcp:503:ll_cfg_requeue.0 Request processed in 206us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222123.280765:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 322 00000100:00100000:0.0:1782222123.291792:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222123.291903:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060703488 00000100:00100000:2.0:1782222123.291916:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060703488 00000100:00100000:2.0:1782222123.291999:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 323 00000100:00100000:2.0:1782222123.292011:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+12:6161:x1868795060703488:12345-192.168.203.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782222123.292039:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222123.292062:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f087fb82e00/0xe2b7cc26e6811366 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x558f77f2f75583be expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222123.292104:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fb82e00/0xe2b7cc26e6811366 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583be expref: 13 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222123.292119:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f087fb82e00/0xe2b7cc26e6811366 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583be expref: 13 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222123.292131:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb82e00, rc 0) 00000100:00100000:2.0:1782222123.292213:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:6161:x1868795060703488:12345-192.168.203.27@tcp:101:ll_cfg_requeue.0 Request processed in 204us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222123.292230:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 323 00000100:00100000:3.0:1782222123.294321:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222123.294425:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060703616 00000100:00100000:2.0:1782222123.294438:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060703616 00000100:00100000:2.0:1782222123.294509:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 324 00000100:00100000:2.0:1782222123.294521:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:6161:x1868795060703616:12345-192.168.203.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782222123.294722:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:6161:x1868795060703616:12345-192.168.203.27@tcp:501:ll_cfg_requeue.0 Request processed in 203us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222123.294731:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 324 00000100:00100000:2.0:1782222123.300527:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222123.302163:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060703744 00000100:00100000:0.0:1782222123.302184:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060703744 00000100:00100000:0.0:1782222123.302309:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 325 00000100:00100000:0.0:1782222123.302330:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:6161:x1868795060703744:12345-192.168.203.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782222123.302552:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:6161:x1868795060703744:12345-192.168.203.27@tcp:503:ll_cfg_requeue.0 Request processed in 223us (2040us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222123.302561:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 325 00010000:00010000:0.0:1782222123.562454:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782222124.075897:0:6523:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782222124.075909:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f08815e6800 from 7 10000000:01000000:3.0:1782222124.075915:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782222124.075985:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0841458c00/0xe2b7cc26e681136d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222124.076000:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f0841458c00/0xe2b7cc26e681136d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222124.076012:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0841458c00/0xe2b7cc26e681136d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222124.076043:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747678700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081764224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782222124.076134:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222124.076755:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08455e26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782222124.078389:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081764224 00000100:00100000:0.0:1782222124.078414:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081764224 00000100:00100000:1.0:1782222124.078564:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1782222124.078579:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:6523:x1868795081764224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782222124.078604:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222124.078627:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f074744d200/0xe2b7cc26e6811374 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e681136d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222124.078661:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f074744d200/0xe2b7cc26e6811374 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e681136d expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222124.078676:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f074744d200/0xe2b7cc26e6811374 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e681136d expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222124.078687:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744d200, rc 0) 00000100:00100000:1.0:1782222124.078785:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:6523:x1868795081764224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 210us (2650us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222124.078792:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1782222124.080673:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747678700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081764224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782222124.080715:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0841458c00/0xe2b7cc26e681136d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811374 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222124.080730:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0841458c00/0xe2b7cc26e681136d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6811374 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222124.080852:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747678700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081764352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782222124.080934:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222124.080987:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08455e26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782222124.081070:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081764352 00000100:00100000:2.0:1782222124.081078:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081764352 00000100:00100000:2.0:1782222124.081147:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1782222124.081157:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:6523:x1868795081764352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782222124.081358:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:6523:x1868795081764352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 202us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222124.081366:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1782222124.081411:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747678700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081764352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782222124.081450:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081764480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782222124.081563:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222124.081586:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087fb75f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782222124.081641:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081764480 00000100:00100000:1.0:1782222124.081647:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081764480 00000100:00100000:1.0:1782222124.081734:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1782222124.081747:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:6523:x1868795081764480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782222124.081860:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:6523:x1868795081764480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222124.081868:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1782222124.083683:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081764480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1782222124.090113:0:13234:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1782222124.090916:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1782222124.090959:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782222124.090977:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0841458c00/0xe2b7cc26e681136d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811374 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222124.090992:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f0841458c00/0xe2b7cc26e681136d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811374 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782222124.091006:0:6523:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782222124.091009:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f087fb98800 from 7 10000000:01000000:3.0:1782222124.091012:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782222124.091072:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0841458600/0xe2b7cc26e681137b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222124.091081:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f0841458600/0xe2b7cc26e681137b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222124.091095:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0841458600/0xe2b7cc26e681137b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222124.091146:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747678000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081764608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782222124.091268:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222124.091330:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08455e2180 going to sleep for 11 seconds 00000100:00100000:2.0:1782222124.091576:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081764608 00000100:00100000:2.0:1782222124.091586:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081764608 00000100:00100000:2.0:1782222124.091652:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1782222124.091663:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:6523:x1868795081764608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782222124.091803:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222124.091820:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f087fb82800/0xe2b7cc26e6811382 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e681137b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222124.091852:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fb82800/0xe2b7cc26e6811382 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e681137b expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222124.091866:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f087fb82800/0xe2b7cc26e6811382 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e681137b expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222124.091876:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb82800, rc 0) 00000100:00100000:2.0:1782222124.091973:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:6523:x1868795081764608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 310us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222124.091982:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1782222124.092067:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747678000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081764608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782222124.092085:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0841458600/0xe2b7cc26e681137b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811382 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222124.092094:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0841458600/0xe2b7cc26e681137b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6811382 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222124.092332:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747678000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081764736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782222124.092369:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222124.092392:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08455e2180 going to sleep for 11 seconds 00000100:00100000:0.0:1782222124.093145:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081764736 00000100:00100000:0.0:1782222124.093156:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081764736 00000100:00100000:0.0:1782222124.093217:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1782222124.093226:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:6523:x1868795081764736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782222124.093794:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:6523:x1868795081764736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 566us (1422us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222124.093803:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1782222124.093853:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747678000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081764736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782222124.093913:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747678000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081764864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782222124.093972:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222124.094003:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08455e2180 going to sleep for 11 seconds 00000100:00100000:0.0:1782222124.094050:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081764864 00000100:00100000:0.0:1782222124.094055:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081764864 00000100:00100000:0.0:1782222124.094120:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1782222124.094213:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:6523:x1868795081764864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782222124.094993:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:6523:x1868795081764864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 861us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222124.095003:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1782222124.095112:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747678000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081764864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1782222124.098132:0:13235:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1782222124.098621:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1782222124.098658:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782222124.098684:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0841458600/0xe2b7cc26e681137b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811382 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222124.098698:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f0841458600/0xe2b7cc26e681137b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811382 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782222124.098710:0:6523:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782222124.098713:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f0849b46800 from 7 10000000:01000000:1.0:1782222124.098716:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782222124.098768:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e6811389 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222124.098777:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e6811389 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222124.098791:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e6811389 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222124.098823:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849bae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081764992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782222124.098910:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222124.098965:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f085292a240 going to sleep for 11 seconds 00000100:00100000:3.0:1782222124.099027:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081764992 00000100:00100000:3.0:1782222124.099037:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081764992 00000100:00100000:3.0:1782222124.099099:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1782222124.099110:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:6523:x1868795081764992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782222124.099194:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222124.099213:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0841459800/0xe2b7cc26e6811390 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6811389 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222124.099271:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0841459800/0xe2b7cc26e6811390 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6811389 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222124.099284:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0841459800/0xe2b7cc26e6811390 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6811389 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222124.099294:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0841459800, rc 0) 00000100:00100000:3.0:1782222124.099379:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:6523:x1868795081764992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 269us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222124.099396:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1782222124.099401:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849bae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081764992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782222124.099428:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e6811389 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811390 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222124.099440:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e6811389 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6811390 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222124.099652:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881599f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081765120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782222124.099690:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222124.099720:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087fb75000 going to sleep for 11 seconds 00000100:00100000:3.0:1782222124.099738:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081765120 00000100:00100000:3.0:1782222124.099745:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081765120 00000100:00100000:3.0:1782222124.099780:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1782222124.099789:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:6523:x1868795081765120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782222124.099936:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:6523:x1868795081765120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 147us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222124.099943:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1782222124.100598:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881599f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081765120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782222124.100656:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849baf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081765248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782222124.100717:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222124.100749:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f085292a240 going to sleep for 11 seconds 00000100:00100000:3.0:1782222124.100827:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081765248 00000100:00100000:3.0:1782222124.100833:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081765248 00000100:00100000:3.0:1782222124.100875:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1782222124.100885:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:6523:x1868795081765248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782222124.100996:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:6523:x1868795081765248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222124.101003:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1782222124.101276:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849baf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081765248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782222124.102812:0:13237:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1782222124.103049:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1782222124.103083:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782222124.103100:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e6811389 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811390 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222124.103127:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e6811389 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811390 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782222124.103140:0:6523:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782222124.103143:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f08490d0000 from 7 10000000:01000000:2.0:1782222124.103146:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782222124.103189:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb83200/0xe2b7cc26e6811397 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222124.103197:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f087fb83200/0xe2b7cc26e6811397 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222124.103209:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f087fb83200/0xe2b7cc26e6811397 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222124.103573:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081765376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782222124.103662:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222124.103714:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087fb75300 going to sleep for 11 seconds 00000100:00100000:0.0:1782222124.103769:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081765376 00000100:00100000:0.0:1782222124.103778:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081765376 00000100:00100000:0.0:1782222124.103841:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1782222124.103852:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:6523:x1868795081765376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782222124.103869:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222124.103886:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0840030800/0xe2b7cc26e681139e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6811397 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222124.103915:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0840030800/0xe2b7cc26e681139e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6811397 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222124.103927:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0840030800/0xe2b7cc26e681139e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6811397 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222124.103937:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0840030800, rc 0) 00000100:00100000:0.0:1782222124.103993:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:6523:x1868795081765376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222124.104001:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1782222124.104147:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081765376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782222124.104165:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f087fb83200/0xe2b7cc26e6811397 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681139e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222124.104175:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f087fb83200/0xe2b7cc26e6811397 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e681139e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222124.104394:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081765504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782222124.104426:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222124.104473:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087fb75300 going to sleep for 11 seconds 00000100:00100000:2.0:1782222124.104491:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081765504 00000100:00100000:2.0:1782222124.104495:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081765504 00000100:00100000:2.0:1782222124.104525:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1782222124.104533:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:6523:x1868795081765504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782222124.104669:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:6523:x1868795081765504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222124.104676:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1782222124.104700:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081765504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782222124.104730:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081765632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782222124.104774:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222124.104783:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087fb75300 going to sleep for 11 seconds 00000100:00100000:2.0:1782222124.104799:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081765632 00000100:00100000:2.0:1782222124.104803:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081765632 00000100:00100000:2.0:1782222124.104820:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1782222124.104825:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:6523:x1868795081765632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782222124.104914:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:6523:x1868795081765632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222124.104920:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1782222124.104962:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081765632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782222124.109103:0:13238:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1782222124.109739:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1782222124.109776:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782222124.109793:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb83200/0xe2b7cc26e6811397 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681139e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222124.109808:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f087fb83200/0xe2b7cc26e6811397 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681139e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222124.586605:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222125.035404:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782222125.035427:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081765760:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782222125.035509:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222125.035560:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081765760 00000100:00100000:2.0:1782222125.035568:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081765760 00000100:00100000:2.0:1782222125.035619:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1782222125.035629:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881599f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081765760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782222125.035659:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782222125.035714:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881599f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081765760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222125.035721:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:2.0:1782222125.035742:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1782222125.035769:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088159bb80 x1868795081765760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222141 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222125.035786:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081765760:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782222125.035978:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782222125.035993:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074767ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081765888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782222125.036024:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222125.036053:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081765888 00000100:00100000:3.0:1782222125.036056:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081765888 00000100:00100000:3.0:1782222125.036086:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1782222125.036093:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081765888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782222125.036103:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222125.036134:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081765888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222125.036140:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1782222125.036165:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1782222125.036184:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074767ad80 x1868795081765888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222141 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222125.036199:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074767ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081765888:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782222125.611876:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222126.058392:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782222126.058411:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081766016:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782222126.058475:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222126.058534:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081766016 00000100:00100000:2.0:1782222126.058540:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081766016 00000100:00100000:2.0:1782222126.058580:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1782222126.058587:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088159b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081766016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782222126.058620:0:7480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1782222126.058674:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088159b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081766016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222126.058690:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1782222126.058732:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081766016:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782222126.058922:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782222126.058935:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081766144:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782222126.058966:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222126.059034:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081766144 00000100:00100000:1.0:1782222126.059054:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081766144 00000100:00100000:1.0:1782222126.059088:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1782222126.059095:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074767ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081766144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782222126.059113:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1782222126.059148:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074767ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081766144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222126.059154:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1782222126.059183:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081766144:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782222126.570422:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782222126.570444:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074767b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081766272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782222126.570510:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222126.570577:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081766272 00000100:00100000:3.0:1782222126.570584:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081766272 00000100:00100000:3.0:1782222126.570635:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1782222126.570644:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747679500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081766272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782222126.570673:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222126.570712:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747679500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081766272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222126.570719:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1782222126.570738:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782222126.570767:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074767b800 x1868795081766272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222142 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222126.570790:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074767b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081766272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782222126.573508:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074728dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081766400:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782222126.573575:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222126.573703:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081766400 00000100:00100000:3.0:1782222126.573710:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081766400 00000100:00100000:3.0:1782222126.573781:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1782222126.573790:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074767b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081766400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782222126.573814:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222126.573856:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074767b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081766400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222126.573863:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:3.0:1782222126.573901:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074728dc00 x1868795081766400/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222142 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222126.573919:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074728dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081766400:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1782222126.573990:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782222126.640411:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782222127.025188:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222127.025253:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222127.025270:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222127.025296:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222127.025320:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222127.025350:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060704128 00000100:00100000:1.0:1782222127.025360:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060704128 00000100:00100000:1.0:1782222127.025413:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060704384 00000100:00100000:1.0:1782222127.025416:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060704384 00000100:00100000:1.0:1782222127.025657:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060704000 00000100:00100000:1.0:1782222127.025661:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060704000 00000100:00100000:1.0:1782222127.025675:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060704256 00000100:00100000:1.0:1782222127.025677:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060704256 00000100:00100000:1.0:1782222127.025694:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 214 00000100:00100000:1.0:1782222127.025702:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:2388:x1868795060704128:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222127.025774:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:2388:x1868795060704128:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 71us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222127.025781:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 214 00000100:00100000:1.0:1782222127.025799:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 215 00000100:00100000:1.0:1782222127.025817:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2388:x1868795060704384:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222127.025844:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2388:x1868795060704384:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 27us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222127.025850:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 215 00000100:00100000:1.0:1782222127.025861:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 216 00000100:00100000:1.0:1782222127.025867:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849bad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+6:2388:x1868795060704000:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222127.025889:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849bad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+6:2388:x1868795060704000:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 22us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222127.025895:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 216 00000100:00100000:1.0:1782222127.025905:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 217 00000100:00100000:1.0:1782222127.025910:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2388:x1868795060704256:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222127.025933:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2388:x1868795060704256:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 22us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222127.025938:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 217 00000100:00100000:0.0:1782222127.026135:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060703872 00000100:00100000:0.0:1782222127.026140:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060703872 00000100:00100000:0.0:1782222127.026168:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 338 00000100:00100000:0.0:1782222127.026174:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2388:x1868795060703872:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222127.026199:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2388:x1868795060703872:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 26us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222127.026205:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 338 00000100:00080000:0.0:1782222127.026260:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782222127.026264:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:2.0:1782222127.129123:0:13394:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1782222127.596657:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081766656:0@lo:400:kworker.0 00000100:00100000:2.0:1782222127.596738:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222127.596795:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1868795081767168:0@lo:400:kworker.0 00000100:00100000:2.0:1782222127.596817:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222127.596839:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1868795081767680:0@lo:400:kworker.0 00000100:00100000:2.0:1782222127.596858:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222127.596882:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1782222127.596888:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081766784:0@lo:400:kworker.0 00000100:00100000:2.0:1782222127.596912:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222127.596934:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1868795081767296:0@lo:400:kworker.0 00000100:00100000:2.0:1782222127.596952:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222127.596968:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1868795081767808:0@lo:400:kworker.0 00000100:00100000:2.0:1782222127.596986:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222127.597019:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081766656 00000100:00100000:2.0:1782222127.597026:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081766656 00000100:00100000:2.0:1782222127.597063:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081767168 00000100:00100000:2.0:1782222127.597065:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081767168 00000100:00100000:2.0:1782222127.597085:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081767680 00000100:00100000:2.0:1782222127.597087:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081767680 00000100:00100000:2.0:1782222127.597096:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081767296 00000100:00100000:2.0:1782222127.597099:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081767296 00000100:00100000:2.0:1782222127.597111:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081767808 00000100:00100000:2.0:1782222127.597126:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081767808 00000100:00100000:2.0:1782222127.597144:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1782222127.597151:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747748380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081766656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222127.597199:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747748380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081766656:12345-0@lo:400:kworker.0 Request processed in 48us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222127.597393:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081766912:0@lo:400:kworker.0 00000100:00100000:3.0:1782222127.597427:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222127.597460:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081767424:0@lo:400:kworker.0 00000100:00100000:3.0:1782222127.597485:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222127.597505:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081767936:0@lo:400:kworker.0 00000100:00100000:3.0:1782222127.597524:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222127.597543:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1782222127.597548:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081766528:0@lo:400:kworker.0 00000100:00100000:3.0:1782222127.597572:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222127.597592:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1868795081767040:0@lo:400:kworker.0 00000100:00100000:3.0:1782222127.597612:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222127.597621:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081767552:0@lo:400:kworker.0 00000100:00100000:3.0:1782222127.597638:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222127.597653:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081768064:0@lo:400:kworker.0 00000100:00100000:3.0:1782222127.597669:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222127.597703:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081767424 00000100:00100000:3.0:1782222127.597707:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081767424 00000100:00100000:3.0:1782222127.597726:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081767936 00000100:00100000:3.0:1782222127.597729:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081767936 00000100:00100000:3.0:1782222127.597739:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081767552 00000100:00100000:3.0:1782222127.597742:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081767552 00000100:00100000:3.0:1782222127.597752:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081768064 00000100:00100000:3.0:1782222127.597754:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081768064 00000100:00100000:3.0:1782222127.597767:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1782222127.597772:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747679c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081767424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222127.597809:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747679c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081767424:12345-0@lo:400:kworker.0 Request processed in 36us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222127.597816:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1782222127.597832:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1782222127.597837:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074767a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081767936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222127.597861:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074767a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081767936:12345-0@lo:400:kworker.0 Request processed in 24us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222127.597866:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1782222127.597874:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1782222127.597880:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747678000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081767552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222127.597903:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747678000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081767552:12345-0@lo:400:kworker.0 Request processed in 23us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222127.597909:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1782222127.597918:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1782222127.597923:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081768064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222127.597946:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081768064:12345-0@lo:400:kworker.0 Request processed in 23us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222127.597960:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:3.0:1782222127.598000:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747747100 x1868795081767552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222127.598014:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081767552:0@lo:400:kworker.0 00010000:00080000:3.0:1782222127.598024:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747746680 x1868795081768064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222127.598033:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081768064:0@lo:400:kworker.0 00010000:00080000:3.0:1782222127.598043:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074778d880 x1868795081767424/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222127.598051:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081767424:0@lo:400:kworker.0 00010000:00080000:3.0:1782222127.598060:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747745880 x1868795081767936/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222127.598068:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081767936:0@lo:400:kworker.0 00000100:00100000:3.0:1782222127.598119:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081767040 00000100:00100000:3.0:1782222127.598122:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081767040 00000100:00100000:0.0:1782222127.598203:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081766528 00000100:00100000:0.0:1782222127.598220:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081766528 00000100:00100000:0.0:1782222127.598275:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1782222127.598290:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3655:x1868795081766528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222127.598330:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3655:x1868795081766528:12345-0@lo:400:kworker.0 Request processed in 49us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222127.598335:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1782222127.598369:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081766528:0@lo:400:kworker.0 00000100:00080000:0.0:1782222127.598462:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782222127.598466:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782222127.598469:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782222127.598498:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081766656:0@lo:400:kworker.0 00000100:00100000:0.0:1782222127.598525:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081766784 00000100:00100000:0.0:1782222127.598528:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081766784 00000100:00100000:0.0:1782222127.598547:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081766912 00000100:00100000:0.0:1782222127.598549:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081766912 00000100:00100000:0.0:1782222127.598560:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1782222127.598565:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081766784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222127.598600:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081766784:12345-0@lo:400:kworker.0 Request processed in 35us (1688us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222127.598606:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1782222127.598616:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1782222127.598622:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074767b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081766912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222127.598649:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074767b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081766912:12345-0@lo:400:kworker.0 Request processed in 27us (1221us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222127.598655:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1782222127.598676:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081766784:0@lo:400:kworker.0 00000100:00100000:0.0:1782222127.598694:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081766912:0@lo:400:kworker.0 00000100:00100000:2.0:1782222127.599341:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1782222127.603896:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1782222127.603921:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074774a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1868795081767168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222127.604040:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074774a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1868795081767168:12345-0@lo:400:kworker.0 Request processed in 133us (7220us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222127.604048:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1782222127.604066:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1782222127.604072:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1868795081767680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222127.604102:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1868795081767680:12345-0@lo:400:kworker.0 Request processed in 31us (7243us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222127.604123:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1782222127.604136:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1782222127.604143:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1868795081767296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222127.604175:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1868795081767296:12345-0@lo:400:kworker.0 Request processed in 34us (7222us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222127.604181:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1782222127.604192:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1782222127.604198:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1868795081767808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222127.605641:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1868795081767808:12345-0@lo:400:kworker.0 Request processed in 1437us (8648us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222127.605652:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1782222127.605676:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1782222127.605686:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1868795081767040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222127.605733:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1868795081767040:12345-0@lo:400:kworker.0 Request processed in 50us (8121us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222127.605740:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00010000:00080000:3.0:1782222127.605792:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074778f480 x1868795081767296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222127.605806:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1868795081767296:0@lo:400:kworker.0 00010000:00080000:3.0:1782222127.605820:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747744e00 x1868795081767808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222127.605828:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1868795081767808:0@lo:400:kworker.0 00000100:00100000:3.0:1782222127.605841:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1868795081767168:0@lo:400:kworker.0 00000100:00100000:3.0:1782222127.605867:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1868795081767680:0@lo:400:kworker.0 00000100:00100000:3.0:1782222127.605916:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1868795081767040:0@lo:400:kworker.0 00010000:00010000:0.0:1782222127.658741:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222128.682620:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222129.706632:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222130.154776:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782222130.154802:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081768192:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782222130.154880:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222130.155134:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081768192 00000100:00100000:1.0:1782222130.155143:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081768192 00000100:00100000:1.0:1782222130.155215:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1782222130.155228:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074728dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081768192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782222130.155291:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222130.155303:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782222130.155316:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081768320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782222130.155340:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074728dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081768192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 115us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222130.155348:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1782222130.155358:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1782222130.155420:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1782222130.155441:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747716d80 x1868795081768192/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222146 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222130.155460:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081768192:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782222130.155532:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081768320 00000100:00100000:1.0:1782222130.155537:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081768320 00000100:00100000:1.0:1782222130.155629:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1782222130.155637:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081768320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782222130.155648:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782222130.155677:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081768320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222130.155683:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:3.0:1782222130.155731:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1782222130.155753:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088163e680 x1868795081768320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222146 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222130.155767:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081768320:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782222130.734392:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222131.178401:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782222131.189047:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081768576:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782222131.189121:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222131.189181:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081768448:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782222131.189206:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222131.189282:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081768576 00000100:00100000:0.0:1782222131.189289:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081768576 00000100:00100000:0.0:1782222131.189334:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081768448 00000100:00100000:0.0:1782222131.189337:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081768448 00000100:00100000:0.0:1782222131.189352:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1782222131.189360:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074728e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081768576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782222131.189401:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1782222131.189447:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074728e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081768576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222131.189455:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1782222131.189472:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1782222131.189478:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074728d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081768448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782222131.189494:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1782222131.189520:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074728d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081768448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 42us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222131.189526:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1782222131.189569:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081768576:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782222131.189582:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081768448:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782222131.692479:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782222131.692503:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081768704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782222131.692576:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222131.692811:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081768704 00000100:00100000:3.0:1782222131.692819:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081768704 00000100:00100000:3.0:1782222131.692883:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1782222131.692892:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081768704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782222131.692920:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222131.692963:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081768704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222131.692969:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:2.0:1782222131.693061:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782222131.693092:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074778f480 x1868795081768704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222147 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222131.693111:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081768704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782222131.693345:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782222131.693357:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081768832:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782222131.693391:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222131.693471:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081768832 00000100:00100000:3.0:1782222131.693475:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081768832 00000100:00100000:3.0:1782222131.693519:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1782222131.693527:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849bae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081768832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782222131.693540:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222131.693575:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849bae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081768832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222131.693599:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:3.0:1782222131.693746:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747716d80 x1868795081768832/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222147 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222131.693760:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081768832:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1782222131.693809:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782222131.755486:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222132.144929:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222132.144971:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222132.145004:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222132.145020:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222132.145039:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222132.145131:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060704768 00000100:00100000:2.0:1782222132.145140:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060704768 00000100:00100000:2.0:1782222132.145191:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060705024 00000100:00100000:2.0:1782222132.145194:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060705024 00000100:00100000:2.0:1782222132.145204:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060704640 00000100:00100000:2.0:1782222132.145207:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060704640 00000100:00100000:2.0:1782222132.145217:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060704896 00000100:00100000:2.0:1782222132.145219:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060704896 00000100:00100000:2.0:1782222132.145232:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 224 00000100:00100000:2.0:1782222132.145281:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+5:2387:x1868795060704768:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222132.145346:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+5:2387:x1868795060704768:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 67us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222132.145355:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 224 00000100:00100000:2.0:1782222132.145371:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 225 00000100:00100000:2.0:1782222132.145377:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2387:x1868795060705024:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222132.145416:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2387:x1868795060705024:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 40us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222132.145422:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 225 00000100:00100000:2.0:1782222132.145433:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 226 00000100:00100000:2.0:1782222132.145439:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+6:2387:x1868795060704640:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222132.145462:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+6:2387:x1868795060704640:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 23us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222132.145468:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 226 00000100:00100000:2.0:1782222132.145479:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 227 00000100:00100000:2.0:1782222132.145484:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2387:x1868795060704896:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222132.145507:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2387:x1868795060704896:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 23us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222132.145513:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 227 00000100:00100000:0.0:1782222132.145746:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060704512 00000100:00100000:0.0:1782222132.145751:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060704512 00000100:00100000:0.0:1782222132.145789:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 340 00000100:00100000:0.0:1782222132.145797:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2387:x1868795060704512:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222132.145837:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2387:x1868795060704512:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 41us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222132.145844:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 340 00000100:00080000:3.0:1782222132.146094:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782222132.146098:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782222132.714821:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1868795081769088:0@lo:400:kworker.0 00000100:00100000:0.0:1782222132.714860:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081769344:0@lo:400:kworker.0 00000100:00100000:2.0:1782222132.714901:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222132.714906:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222132.714967:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1868795081769600:0@lo:400:kworker.0 00000100:00100000:3.0:1782222132.714992:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081769216:0@lo:400:kworker.0 00000100:00100000:2.0:1782222132.715005:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222132.715034:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222132.715043:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1868795081770112:0@lo:400:kworker.0 00000100:00100000:3.0:1782222132.715068:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1868795081769728:0@lo:400:kworker.0 00000100:00100000:2.0:1782222132.715075:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222132.715098:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1782222132.715102:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222132.715109:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081768960:0@lo:400:kworker.0 00000100:00100000:3.0:1782222132.715126:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1868795081770240:0@lo:400:kworker.0 00000100:00100000:2.0:1782222132.715146:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222132.715161:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222132.715178:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1868795081769472:0@lo:400:kworker.0 00000100:00100000:3.0:1782222132.715199:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081769344 00000100:00100000:3.0:1782222132.715207:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081769344 00000100:00100000:2.0:1782222132.715221:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222132.715287:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081769984:0@lo:400:kworker.0 00000100:00100000:1.0:1782222132.715314:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081769088 00000100:00100000:2.0:1782222132.715315:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222132.715322:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081769088 00000100:00100000:2.0:1782222132.715338:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081770496:0@lo:400:kworker.0 00000100:00100000:1.0:1782222132.715353:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081769600 00000100:00100000:1.0:1782222132.715357:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081769600 00000100:00100000:2.0:1782222132.715364:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222132.715384:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081770112 00000100:00100000:1.0:1782222132.715388:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081770112 00000100:00100000:1.0:1782222132.715400:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081769728 00000100:00100000:1.0:1782222132.715402:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081769728 00000100:00100000:1.0:1782222132.715411:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081770240 00000100:00100000:1.0:1782222132.715413:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081770240 00000100:00100000:1.0:1782222132.715423:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081769472 00000100:00100000:1.0:1782222132.715425:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081769472 00000100:00100000:1.0:1782222132.715439:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1782222132.715446:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1868795081769088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222132.715612:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1782222132.715621:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1868795081769600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222132.719529:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081769856:0@lo:400:kworker.0 00000100:00100000:0.0:1782222132.719603:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222132.719645:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081770368:0@lo:400:kworker.0 00000100:00100000:0.0:1782222132.719664:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222132.719713:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081769216 00000100:00100000:0.0:1782222132.719720:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081769216 00000100:00100000:0.0:1782222132.719760:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1782222132.719767:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081769216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222132.719822:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081769216:12345-0@lo:400:kworker.0 Request processed in 54us (4788us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222132.719829:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1782222132.719853:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081768960 00000100:00100000:0.0:1782222132.719857:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081768960 00000100:00100000:0.0:1782222132.719880:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1782222132.719886:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3656:x1868795081768960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222132.719986:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1868795081769088:12345-0@lo:400:kworker.0 Request processed in 4538us (5084us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222132.719995:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1782222132.720015:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1782222132.720024:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07465e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1868795081770112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222132.720122:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1868795081769600:12345-0@lo:400:kworker.0 Request processed in 4500us (5115us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222132.720132:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1782222132.720146:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081769984 00000100:00100000:3.0:1782222132.720152:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081769984 00000100:00100000:2.0:1782222132.720155:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1782222132.720165:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1868795081769728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222132.720191:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081770496 00000100:00100000:3.0:1782222132.720197:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081770496 00000100:00100000:2.0:1782222132.720202:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1868795081769728:12345-0@lo:400:kworker.0 Request processed in 39us (5101us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222132.720209:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1782222132.720218:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081769856 00000100:00100000:3.0:1782222132.720222:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081769856 00000100:00100000:2.0:1782222132.720229:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1782222132.720263:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081770368 00000100:00100000:3.0:1782222132.720267:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081770368 00000100:00100000:2.0:1782222132.720269:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1868795081770240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222132.720306:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1868795081770240:12345-0@lo:400:kworker.0 Request processed in 40us (5149us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222132.720313:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1782222132.720318:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1782222132.720329:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07465e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081769984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222132.720336:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1782222132.720345:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07465e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1868795081769472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222132.720380:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07465e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081769984:12345-0@lo:400:kworker.0 Request processed in 55us (5064us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222132.720387:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07465e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1868795081769472:12345-0@lo:400:kworker.0 Request processed in 42us (5166us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222132.720389:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1782222132.720406:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1782222132.720412:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b784700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081770496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222132.720440:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b784700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081770496:12345-0@lo:400:kworker.0 Request processed in 29us (5076us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222132.720445:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1782222132.720455:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1782222132.720461:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f914380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081769856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222132.720491:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f914380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081769856:12345-0@lo:400:kworker.0 Request processed in 30us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222132.720497:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1782222132.720507:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1782222132.720512:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f914a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081770368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222132.720537:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f914a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081770368:12345-0@lo:400:kworker.0 Request processed in 25us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222132.720543:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:3.0:1782222132.720566:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782222132.720570:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782222132.720572:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782222132.720600:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1782222132.720608:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0875aad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081769344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222132.720640:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0875aad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081769344:12345-0@lo:400:kworker.0 Request processed in 33us (5737us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222132.720652:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1782222132.721592:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1782222132.723024:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081769216:0@lo:400:kworker.0 00010000:00080000:2.0:1782222132.723044:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0877155c00 x1868795081769728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222132.723053:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1868795081769728:0@lo:400:kworker.0 00010000:00080000:2.0:1782222132.723066:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0875aac380 x1868795081770240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222132.723074:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1868795081770240:0@lo:400:kworker.0 00000100:00100000:2.0:1782222132.723123:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081769344:0@lo:400:kworker.0 00010000:00080000:2.0:1782222132.723134:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0877154a80 x1868795081769856/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222132.723142:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081769856:0@lo:400:kworker.0 00010000:00080000:2.0:1782222132.723152:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0875aae680 x1868795081770368/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222132.723159:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081770368:0@lo:400:kworker.0 00000100:00100000:0.0:1782222132.723684:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3656:x1868795081768960:12345-0@lo:400:kworker.0 Request processed in 3794us (8535us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222132.723715:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1782222132.726776:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081768960:0@lo:400:kworker.0 00000100:00100000:2.0:1782222132.726800:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1868795081769472:0@lo:400:kworker.0 00010000:00080000:2.0:1782222132.726815:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0875aaf800 x1868795081769984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222132.726826:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081769984:0@lo:400:kworker.0 00010000:00080000:2.0:1782222132.726860:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0875aafb80 x1868795081770496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222132.726868:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081770496:0@lo:400:kworker.0 00000100:00100000:1.0:1782222132.726965:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07465e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1868795081770112:12345-0@lo:400:kworker.0 Request processed in 6940us (11887us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222132.726977:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1782222132.731796:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1868795081770112:0@lo:400:kworker.0 00000100:00100000:2.0:1782222132.731816:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1868795081769088:0@lo:400:kworker.0 00000100:00100000:2.0:1782222132.731829:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1868795081769600:0@lo:400:kworker.0 00010000:00010000:2.0:1782222132.784548:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782222132.907522:0:13542:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 09:42:10 (1782222130) === 00000100:00100000:3.0:1782222133.163518:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222133.163694:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222133.163812:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060705280 00000100:00100000:2.0:1782222133.163821:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060705280 00000100:00100000:2.0:1782222133.163873:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 2 00000100:00100000:2.0:1782222133.163883:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:77bf2c2c-f408-43f9-ae59-449550631d05+6:10501:x1868795060705280:12345-192.168.203.27@tcp:700:mkdir.0 00000100:00100000:2.0:1782222133.163965:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:77bf2c2c-f408-43f9-ae59-449550631d05+6:10501:x1868795060705280:12345-192.168.203.27@tcp:700:mkdir.0 Request processed in 82us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222133.163972:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 2 00000100:00100000:2.0:1782222133.166697:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222133.171574:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060705152 00000100:00100000:0.0:1782222133.171589:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060705152 00000100:00100000:2.0:1782222133.175367:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060705536 00000100:00100000:2.0:1782222133.175384:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060705536 00000100:00100000:2.0:1782222133.175418:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 22 00000100:00100000:2.0:1782222133.175428:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+7:2388:x1868795060705152:12345-192.168.203.27@tcp:41:mkdir.0 00000004:00000024:2.0:1782222133.175468:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1782222133.175568:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+7:2388:x1868795060705152:12345-192.168.203.27@tcp:41:mkdir.0 Request processed in 140us (12058us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222133.175575:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 22 00000100:00100000:2.0:1782222133.175606:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 23 00000100:00100000:2.0:1782222133.175612:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b784380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+6:10501:x1868795060705536:12345-192.168.203.27@tcp:36:mkdir.0 00010000:00010000:2.0:1782222133.175660:0:6528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782222133.175721:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82200/0xe2b7cc26e6811247 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558332 expref: 6 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.175741:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f087f92bf00) 00010000:00010000:2.0:1782222133.175762:0:6528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782222133.175849:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e68113a5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.175863:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e68113a5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.175873:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e68113a5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.177300:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e68113ac lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.177320:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e68113ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.177332:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e68113ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.177857:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e68113b3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.177867:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e68113b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.177885:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e68113b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782222133.177903:0:6528:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f74fd03f reply state 0000000017618759 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e68113b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.177915:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e68113b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.177922:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f087f92be00) 00010000:00010000:2.0:1782222133.177925:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782222133.177928:0:6528:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782222133.177934:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1782222133.177941:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e68113a5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.177948:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e68113a5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.177955:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e68113a5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.177962:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83000 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222133.177966:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e68113a5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.177973:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e68113a5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.177983:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f087f92ba00) 00010000:00010000:2.0:1782222133.177985:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782222133.177995:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e68113a5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.178001:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e68113a5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782222133.178018:0:6528:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f74fd03f reply state 0000000017618759 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e68113ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.178026:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e68113ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.178032:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f087f92b800) 00010000:00010000:2.0:1782222133.178034:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782222133.178036:0:6528:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1782222133.178114:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b784380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+7:10501:x1868795060705536:12345-192.168.203.27@tcp:36:mkdir.0 Request processed in 2498us (11423us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1782222133.178122:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 23 00000100:00100000:1.0:1782222133.225390:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222133.225493:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060705664 00000100:00100000:2.0:1782222133.225502:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060705664 00000100:00100000:2.0:1782222133.225562:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 24 00000100:00100000:2.0:1782222133.225572:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+7:10504:x1868795060705664:12345-192.168.203.27@tcp:101:chmod.0 00010000:00010000:2.0:1782222133.225594:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222133.225616:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e68113ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75583c5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.225679:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82200/0xe2b7cc26e68113c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.225693:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82200/0xe2b7cc26e68113c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.225729:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82200/0xe2b7cc26e68113c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782222133.225770:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782222133.225773:0:6528:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782222133.225803:0:6528:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82200/0xe2b7cc26e68113c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.225828:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e68113ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583c5 expref: 9 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.225845:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82200/0xe2b7cc26e68113c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583c5 expref: 8 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.225853:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f087f92ba00) 00010000:00010000:2.0:1782222133.225856:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782222133.225859:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb82200, rc 0) 00000100:00100000:2.0:1782222133.225922:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+8:10504:x1868795060705664:12345-192.168.203.27@tcp:101:chmod.0 Request processed in 351us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222133.225929:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 24 00000100:00100000:1.0:1782222133.232601:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222133.232775:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060705920 00000100:00100000:0.0:1782222133.232784:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060705920 00000100:00100000:0.0:1782222133.232840:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 25 00000100:00100000:0.0:1782222133.232849:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+8:10504:x1868795060705920:12345-192.168.203.27@tcp:36:chmod.0 00010000:00010000:0.0:1782222133.232901:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222133.232928:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82200/0xe2b7cc26e68113c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583c5 expref: 8 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.232948:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f087f92ba00) 00010000:00010000:0.0:1782222133.232959:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782222133.232986:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031600/0xe2b7cc26e68113c8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.232999:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031600/0xe2b7cc26e68113c8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.233008:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031600/0xe2b7cc26e68113c8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782222133.233197:0:6526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d8a9b153 reply state 00000000e0d9b27b transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031600/0xe2b7cc26e68113c8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.233211:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031600/0xe2b7cc26e68113c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.233217:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0747273400) 00010000:00010000:0.0:1782222133.233225:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1782222133.233228:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782222133.233268:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1782222133.233343:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+9:10504:x1868795060705920:12345-192.168.203.27@tcp:36:chmod.0 Request processed in 494us (748us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1782222133.233350:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 25 00000100:00100000:3.0:1782222133.276939:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222133.277058:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060706048 00000100:00100000:2.0:1782222133.277067:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060706048 00000100:00100000:2.0:1782222133.277128:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 26 00000100:00100000:2.0:1782222133.277139:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+9:10505:x1868795060706048:12345-192.168.203.27@tcp:101:chown.0 00010000:00010000:2.0:1782222133.277173:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222133.277192:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e68113cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75583cc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.277319:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82c00/0xe2b7cc26e68113d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.277333:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82c00/0xe2b7cc26e68113d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.277344:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82c00/0xe2b7cc26e68113d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782222133.277384:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782222133.277388:0:6528:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782222133.277430:0:6528:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82c00/0xe2b7cc26e68113d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.277454:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e68113cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583cc expref: 11 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.277480:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82c00/0xe2b7cc26e68113d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583cc expref: 10 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.277488:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0747273400) 00010000:00010000:2.0:1782222133.277491:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782222133.277496:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb82c00, rc 0) 00000100:00100000:2.0:1782222133.277559:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+10:10505:x1868795060706048:12345-192.168.203.27@tcp:101:chown.0 Request processed in 422us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222133.277566:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 26 00000100:00100000:1.0:1782222133.282166:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222133.282276:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060706176 00000100:00100000:0.0:1782222133.282285:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060706176 00000100:00100000:0.0:1782222133.282341:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 27 00000100:00100000:0.0:1782222133.282349:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+10:10505:x1868795060706176:12345-192.168.203.27@tcp:101:chown.0 00010000:00010000:0.0:1782222133.282367:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222133.282385:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031e00/0xe2b7cc26e68113dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75583d3 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.282451:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030a00/0xe2b7cc26e68113e4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.282465:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030a00/0xe2b7cc26e68113e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.282475:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030a00/0xe2b7cc26e68113e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.282486:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031400/0xe2b7cc26e68113eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.282492:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031400/0xe2b7cc26e68113eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.282498:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031400/0xe2b7cc26e68113eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.282586:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030e00/0xe2b7cc26e68113f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.282594:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030e00/0xe2b7cc26e68113f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.282601:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030e00/0xe2b7cc26e68113f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782222133.282639:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782222133.282642:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782222133.282661:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030e00/0xe2b7cc26e68113f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.282672:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030a00/0xe2b7cc26e68113e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.282679:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030a00/0xe2b7cc26e68113e4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.282685:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030a00/0xe2b7cc26e68113e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.282691:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0840030a00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222133.282706:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030a00/0xe2b7cc26e68113e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.282713:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030a00/0xe2b7cc26e68113e4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.282724:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0747273400) 00010000:00010000:0.0:1782222133.282732:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782222133.282736:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030a00/0xe2b7cc26e68113e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.282743:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030a00/0xe2b7cc26e68113e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.282758:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031400/0xe2b7cc26e68113eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.282764:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031400/0xe2b7cc26e68113eb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.282770:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031400/0xe2b7cc26e68113eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.282775:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0840031400 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222133.282778:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031400/0xe2b7cc26e68113eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.282783:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031400/0xe2b7cc26e68113eb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.282789:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f087f92b800) 00010000:00010000:0.0:1782222133.282791:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782222133.282794:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031400/0xe2b7cc26e68113eb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.282799:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031400/0xe2b7cc26e68113eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.282822:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031e00/0xe2b7cc26e68113dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583d3 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.282844:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030e00/0xe2b7cc26e68113f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583d3 expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.282851:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f087f92be00) 00010000:00010000:0.0:1782222133.282854:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782222133.282856:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0840030e00, rc 0) 00000100:00100000:0.0:1782222133.282908:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+11:10505:x1868795060706176:12345-192.168.203.27@tcp:101:chown.0 Request processed in 559us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222133.282914:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 27 00000100:00100000:3.0:1782222133.286017:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222133.286113:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060706304 00000100:00100000:2.0:1782222133.286123:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060706304 00000100:00100000:2.0:1782222133.286274:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 6 00000100:00100000:2.0:1782222133.286285:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:77bf2c2c-f408-43f9-ae59-449550631d05+11:10505:x1868795060706304:12345-192.168.203.27@tcp:900:chown.0 00000100:00100000:2.0:1782222133.286818:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:77bf2c2c-f408-43f9-ae59-449550631d05+11:10505:x1868795060706304:12345-192.168.203.27@tcp:900:chown.0 Request processed in 533us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222133.286828:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 6 00000100:00100000:2.0:1782222133.290624:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222133.290882:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060706560 00000100:00100000:3.0:1782222133.290893:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060706560 00000100:00100000:3.0:1782222133.290952:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 28 00000100:00100000:3.0:1782222133.290962:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+11:10505:x1868795060706560:12345-192.168.203.27@tcp:36:chown.0 00010000:00010000:3.0:1782222133.291014:0:6528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222133.291041:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030e00/0xe2b7cc26e68113f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583d3 expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.291062:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f087f92be00) 00010000:00010000:3.0:1782222133.291066:0:6528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782222133.291087:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458a00/0xe2b7cc26e68113f9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.291100:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458a00/0xe2b7cc26e68113f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.291110:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458a00/0xe2b7cc26e68113f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782222133.296516:0:6505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:3.0:1782222133.296645:0:6528:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e6c693b5 reply state 000000005b599c90 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458a00/0xe2b7cc26e68113f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.296673:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458a00/0xe2b7cc26e68113f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.296714:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f087f92be00) 00010000:00010000:1.0:1782222133.296717:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e68113ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.296718:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1782222133.296727:0:6528:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782222133.296740:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e68113ac lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782222133.296747:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1782222133.296750:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e68113ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.296759:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83800 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222133.296766:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e68113ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.296774:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e68113ac lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.296792:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f087f92b800) 00010000:00010000:1.0:1782222133.296795:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222133.296800:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e68113ac lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.296807:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e68113ac lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.296834:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e68113b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.296852:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e68113b3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.296859:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e68113b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.296863:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb82600 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222133.296866:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e68113b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1782222133.296870:0:6528:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00010000:00010000:1.0:1782222133.296874:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e68113b3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222133.296895:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+9:10505:x1868795060706560:12345-192.168.203.27@tcp:36:chown.0 Request processed in 5930us (6275us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1782222133.296905:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 28 00010000:00010000:2.0:1782222133.296998:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458a00/0xe2b7cc26e68113f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.297012:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458a00/0xe2b7cc26e68113f9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.297019:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458a00/0xe2b7cc26e68113f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.297025:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0841458a00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222133.297031:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458a00/0xe2b7cc26e68113f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.297038:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458a00/0xe2b7cc26e68113f9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.297050:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f087f92be00) 00010000:00010000:2.0:1782222133.297053:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782222133.297056:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458a00/0xe2b7cc26e68113f9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.297062:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458a00/0xe2b7cc26e68113f9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.297114:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f087f92be00) 00010000:00010000:1.0:1782222133.297117:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222133.297120:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e68113b3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.297680:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e68113b3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.297704:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031600/0xe2b7cc26e68113c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.297710:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031600/0xe2b7cc26e68113c8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.297716:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031600/0xe2b7cc26e68113c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.297721:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0840031600 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222133.297733:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031600/0xe2b7cc26e68113c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.297740:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031600/0xe2b7cc26e68113c8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.297752:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0747273400) 00010000:00010000:1.0:1782222133.297755:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782222133.297758:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031600/0xe2b7cc26e68113c8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.297763:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031600/0xe2b7cc26e68113c8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222133.322303:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222133.322668:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060706688 00000100:00100000:0.0:1782222133.322679:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060706688 00000100:00100000:0.0:1782222133.322741:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 29 00000100:00100000:0.0:1782222133.322750:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+6:10506:x1868795060706688:12345-192.168.203.27@tcp:101:touch.500 00010000:00010000:0.0:1782222133.322772:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222133.322792:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031400/0xe2b7cc26e6811400 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75583da expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782222133.327651:0:6526:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4809us 00010000:00010000:2.0:1782222133.353343:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811407 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.353363:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811407 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.353374:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811407 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.353390:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82a00/0xe2b7cc26e681140e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.353397:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82a00/0xe2b7cc26e681140e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.353403:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82a00/0xe2b7cc26e681140e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.353503:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811415 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.353512:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811415 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.353518:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811415 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782222133.353547:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782222133.353552:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782222133.353609:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811415 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.353628:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811407 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.353634:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811407 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.353642:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811407 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.353649:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83000 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222133.353653:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811407 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.353660:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811407 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.353674:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0747273400) 00010000:00010000:2.0:1782222133.353677:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782222133.353681:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811407 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.353686:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811407 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.353696:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82a00/0xe2b7cc26e681140e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.353701:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82a00/0xe2b7cc26e681140e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.353706:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82a00/0xe2b7cc26e681140e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.353717:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb82a00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222133.353720:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82a00/0xe2b7cc26e681140e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.353726:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82a00/0xe2b7cc26e681140e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.353735:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f087f92bf00) 00010000:00010000:2.0:1782222133.353737:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782222133.353740:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82a00/0xe2b7cc26e681140e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.353746:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82a00/0xe2b7cc26e681140e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.353783:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031400/0xe2b7cc26e6811400 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583da expref: 8 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.353801:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811415 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583da expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.353808:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f087f92b700) 00010000:00010000:2.0:1782222133.353810:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782222133.353813:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb83c00, rc 0) 00000100:00100000:2.0:1782222133.353887:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+7:10506:x1868795060706688:12345-192.168.203.27@tcp:101:touch.500 Request processed in 31136us (31591us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222133.353895:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 29 00000100:00100000:0.0:1782222133.359846:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222133.360170:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060706944 00000100:00100000:1.0:1782222133.360179:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060706944 00000100:00100000:1.0:1782222133.360270:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 30 00000100:00100000:1.0:1782222133.360280:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+7:10506:x1868795060706944:12345-192.168.203.27@tcp:101:touch.500 00010000:00010000:1.0:1782222133.360298:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222133.360317:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e681141c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75583e1 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.360425:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811423 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.360615:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811423 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.360629:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811423 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.364044:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e681142a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.364066:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e681142a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.364079:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e681142a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782222133.364719:0:8465:0:(osp_object.c:1673:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:1.0:1782222133.364879:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c600/0xe2b7cc26e6811431 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.364889:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c600/0xe2b7cc26e6811431 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.364898:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c600/0xe2b7cc26e6811431 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.364932:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811423 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.364939:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811423 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.364945:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811423 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.364951:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744d400 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222133.364955:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811423 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.364972:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811423 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.364985:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f087f92b700) 00010000:00010000:1.0:1782222133.364988:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222133.364992:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811423 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.364998:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811423 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782222133.365013:0:8465:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000029c56219 reply state 000000002a8a3cae transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e681142a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.365023:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e681142a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.365029:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x53e8e04c (ffff8f0842e7f700) 00010000:00010000:1.0:1782222133.365031:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782222133.365034:0:8465:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782222133.365067:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e681141c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583e1 expref: 10 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.365081:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c600/0xe2b7cc26e6811431 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583e1 expref: 9 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.365088:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f0842e7ff00) 00010000:00010000:1.0:1782222133.365090:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782222133.365092:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744c600, rc 0) 00000100:00100000:1.0:1782222133.365166:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+10:10506:x1868795060706944:12345-192.168.203.27@tcp:101:touch.500 Request processed in 4887us (5328us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1782222133.365181:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 30 00000100:00100000:1.0:1782222133.375541:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222133.375660:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060707200 00000100:00100000:3.0:1782222133.375671:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060707200 00000100:00100000:3.0:1782222133.375742:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 31 00000100:00100000:3.0:1782222133.375752:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+10:10506:x1868795060707200:12345-192.168.203.27@tcp:36:touch.500 00010000:00010000:3.0:1782222133.375807:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222133.375834:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c600/0xe2b7cc26e6811431 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583e1 expref: 10 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.375853:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f0842e7ff00) 00010000:00010000:3.0:1782222133.375863:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782222133.375917:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459e00/0xe2b7cc26e681143f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.375929:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459e00/0xe2b7cc26e681143f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.375939:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459e00/0xe2b7cc26e681143f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782222133.376035:0:6527:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005a73f709 reply state 0000000051ae01a3 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459e00/0xe2b7cc26e681143f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.376062:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459e00/0xe2b7cc26e681143f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.376068:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f087f8f2300) 00010000:00010000:3.0:1782222133.376071:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782222133.376073:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782222133.376176:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+11:10506:x1868795060707200:12345-192.168.203.27@tcp:36:touch.500 Request processed in 425us (644us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1782222133.376183:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 31 00000100:00100000:2.0:1782222133.381996:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222133.382343:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060707328 00000100:00100000:3.0:1782222133.382357:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060707328 00000100:00100000:3.0:1782222133.382411:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 32 00000100:00100000:3.0:1782222133.382421:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b785500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+11:10506:x1868795060707328:12345-192.168.203.27@tcp:101:touch.500 00010000:00010000:3.0:1782222133.382777:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222133.382800:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458a00/0xe2b7cc26e6811446 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75583e8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.382857:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458a00/0xe2b7cc26e6811446 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583e8 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.384364:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458a00/0xe2b7cc26e6811446 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583e8 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.384462:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f087f8f2300) 00010000:00010000:3.0:1782222133.384465:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782222133.384469:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0841458a00, rc 0) 00000100:00100000:3.0:1782222133.384654:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b785500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+12:10506:x1868795060707328:12345-192.168.203.27@tcp:101:touch.500 Request processed in 2233us (2666us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222133.384676:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 32 00000100:00100000:0.0:1782222133.400586:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222133.401204:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060707456 00000100:00100000:3.0:1782222133.401215:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060707456 00000100:00100000:3.0:1782222133.401309:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 24 00000100:00100000:3.0:1782222133.401317:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2386:x1868795060707456:12345-192.168.203.27@tcp:8:touch.500 00010000:00080000:3.0:1782222133.401350:0:8443:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 77bf2c2c-f408-43f9-ae59-449550631d05@192.168.203.27@tcp t0 exp 0000000000000000 cur 332 last 0 00000020:00000080:3.0:1782222133.401383:0:8443:0:(genops.c:1406:class_connect()) connect: client 77bf2c2c-f408-43f9-ae59-449550631d05, cookie 0xe2b7cc26e681144d 00002000:00100000:3.0:1782222133.401555:0:8443:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 77bf2c2c-f408-43f9-ae59-449550631d05/ffff8f0843cac000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782222133.401574:0:8443:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782222133.401710:0:8443:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1782222133.401743:0:8443:0:(import.c:65:import_set_state_nolock()) ffff8f0843cab000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782222133.401820:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77bf2c2c-f408-43f9-ae59-449550631d05+6:2386:x1868795060707456:12345-192.168.203.27@tcp:8:touch.500 Request processed in 501us (1244us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222133.401828:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 24 00000100:00100000:1.0:1782222133.413986:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222133.424897:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060707584 00000100:00100000:3.0:1782222133.424914:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060707584 00000100:00100000:3.0:1782222133.425048:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 25 00000100:00100000:3.0:1782222133.425058:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77bf2c2c-f408-43f9-ae59-449550631d05+6:0:x1868795060707584:12345-192.168.203.27@tcp:2:touch.500 00000100:00080000:0.0:1782222133.425146:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1782222133.442654:0:8436:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:0.0:1782222133.442674:0:8436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 77bf2c2c-f408-43f9-ae59-449550631d05 00000100:00100000:1.0:1782222133.443210:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77bf2c2c-f408-43f9-ae59-449550631d05+5:0:x1868795060707584:12345-192.168.203.27@tcp:2:touch.500 Request processed in 18142us (29220us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1782222133.443225:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 25 00000100:00100000:2.0:1782222133.448973:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222133.449090:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060707840 00000100:00100000:1.0:1782222133.449104:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060707840 00000100:00100000:1.0:1782222133.449176:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 2 00000100:00100000:1.0:1782222133.449189:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+12:10506:x1868795060707840:12345-192.168.203.27@tcp:35:touch.500 00000100:00100000:1.0:1782222133.451008:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+13:10506:x1868795060707840:12345-192.168.203.27@tcp:35:touch.500 Request processed in 516us (746us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1782222133.451034:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 2 00000100:00100000:0.0:1782222133.474106:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222133.474221:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060707968 00000100:00100000:3.0:1782222133.474290:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060707968 00000100:00100000:3.0:1782222133.474377:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 33 00000100:00100000:3.0:1782222133.474402:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+13:10507:x1868795060707968:12345-192.168.203.27@tcp:101:rm.0 00010000:00010000:3.0:1782222133.474437:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222133.474464:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0875803200/0xe2b7cc26e6811454 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75583ef expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.474578:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0875803800/0xe2b7cc26e681145b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.474596:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0875803800/0xe2b7cc26e681145b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.474608:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0875803800/0xe2b7cc26e681145b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782222133.474666:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782222133.474670:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782222133.474725:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0875803800/0xe2b7cc26e681145b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.474759:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0875803200/0xe2b7cc26e6811454 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583ef expref: 15 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.474780:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0875803800/0xe2b7cc26e681145b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583ef expref: 14 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.474790:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f087f92b700) 00010000:00010000:3.0:1782222133.474794:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782222133.474799:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0875803800, rc 0) 00000100:00100000:3.0:1782222133.474882:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+14:10507:x1868795060707968:12345-192.168.203.27@tcp:101:rm.0 Request processed in 494us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222133.474890:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 33 00000100:00100000:2.0:1782222133.479353:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222133.479930:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060708224 00000100:00100000:1.0:1782222133.479941:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060708224 00000100:00100000:1.0:1782222133.480096:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 34 00000100:00100000:1.0:1782222133.480106:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b786300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+14:10507:x1868795060708224:12345-192.168.203.27@tcp:101:rm.0 00010000:00010000:1.0:1782222133.480125:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222133.480153:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e6811462 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75583f6 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782222133.480284:0:8465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1782222133.480441:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e6811462 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583f6 expref: 16 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.480455:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0747273400) 00010000:00010000:1.0:1782222133.480472:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782222133.480478:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e6811462 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583f6 expref: 16 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.480492:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744c800, rc 0) 00000100:00100000:1.0:1782222133.480540:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b786300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+15:10507:x1868795060708224:12345-192.168.203.27@tcp:101:rm.0 Request processed in 436us (1198us total) trans 4294967305 rc 301/301 00000100:00100000:1.0:1782222133.480547:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 34 00000100:00100000:1.0:1782222133.487959:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222133.494736:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060708352 00000100:00100000:0.0:1782222133.494751:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060708352 00000100:00100000:0.0:1782222133.495011:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 3 00000100:00100000:0.0:1782222133.495034:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+15:10507:x1868795060708352:12345-192.168.203.27@tcp:37:rm.0 00000100:00100000:3.0:1782222133.504442:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+15:10507:x1868795060708352:12345-192.168.203.27@tcp:37:rm.0 Request processed in 9398us (16480us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222133.504470:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 3 00000100:00100000:2.0:1782222133.511525:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222133.511683:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060708608 00000100:00100000:1.0:1782222133.511693:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060708608 00000100:00100000:1.0:1782222133.511827:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 4 00000100:00100000:1.0:1782222133.511838:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087d4bac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+15:10507:x1868795060708608:12345-192.168.203.27@tcp:35:rm.0 00000100:00100000:1.0:1782222133.512529:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087d4bac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+16:10507:x1868795060708608:12345-192.168.203.27@tcp:35:rm.0 Request processed in 575us (896us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1782222133.512539:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 4 00000100:00100000:1.0:1782222133.517868:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222133.520817:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060708864 00000100:00100000:3.0:1782222133.520833:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060708864 00000100:00100000:2.0:1782222133.525635:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 35 00000100:00100000:2.0:1782222133.525651:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+16:10507:x1868795060708864:12345-192.168.203.27@tcp:101:rm.0 00010000:00010000:2.0:1782222133.525677:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222133.525696:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811470 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75583fd expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.525810:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e6811477 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.525825:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e6811477 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.525835:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e6811477 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782222133.525846:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1782222133.526012:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811470 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583fd expref: 19 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.526031:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e6811477 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583fd expref: 18 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222133.526040:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f087f92b700) 00010000:00010000:2.0:1782222133.526043:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782222133.526046:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb83800, rc 0) 00000100:00100000:2.0:1782222133.526192:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+18:10507:x1868795060708864:12345-192.168.203.27@tcp:101:rm.0 Request processed in 544us (8332us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1782222133.526206:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 35 00000100:00100000:0.0:1782222133.542816:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222133.542939:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060708992 00000100:00100000:3.0:1782222133.542950:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060708992 00000100:00100000:3.0:1782222133.543132:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 36 00000100:00100000:3.0:1782222133.543218:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+18:10507:x1868795060708992:12345-192.168.203.27@tcp:41:rm.0 00000004:00000024:3.0:1782222133.543316:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:3.0:1782222133.543607:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+18:10507:x1868795060708992:12345-192.168.203.27@tcp:41:rm.0 Request processed in 464us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222133.543617:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 36 00000100:00100000:1.0:1782222133.546704:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222133.546858:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060709120 00000100:00100000:0.0:1782222133.546868:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060709120 00000100:00100000:0.0:1782222133.546960:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 37 00000100:00100000:0.0:1782222133.546981:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+18:10507:x1868795060709120:12345-192.168.203.27@tcp:101:rm.0 00010000:00010000:0.0:1782222133.547003:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222133.547025:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030c00/0xe2b7cc26e6811485 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558404 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.547089:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030a00/0xe2b7cc26e681148c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.547103:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030a00/0xe2b7cc26e681148c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.547114:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030a00/0xe2b7cc26e681148c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.547125:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031400/0xe2b7cc26e6811493 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.547131:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031400/0xe2b7cc26e6811493 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.547137:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031400/0xe2b7cc26e6811493 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.547229:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031e00/0xe2b7cc26e681149a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.547290:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031e00/0xe2b7cc26e681149a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.547298:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031e00/0xe2b7cc26e681149a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782222133.547338:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:0.0:1782222133.547342:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782222133.547362:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031e00/0xe2b7cc26e681149a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.547374:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031e00/0xe2b7cc26e681149a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.547382:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030a00/0xe2b7cc26e681148c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.547402:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030a00/0xe2b7cc26e681148c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.547410:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030a00/0xe2b7cc26e681148c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.547423:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0840030a00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222133.547428:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030a00/0xe2b7cc26e681148c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.547434:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030a00/0xe2b7cc26e681148c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.547447:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f087f92b700) 00010000:00010000:0.0:1782222133.547450:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782222133.547823:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030a00/0xe2b7cc26e681148c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.547834:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030a00/0xe2b7cc26e681148c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.547853:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031400/0xe2b7cc26e6811493 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.547860:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031400/0xe2b7cc26e6811493 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.547866:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031400/0xe2b7cc26e6811493 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.547871:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0840031400 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222133.547874:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031400/0xe2b7cc26e6811493 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.547880:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031400/0xe2b7cc26e6811493 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.547888:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x53e8e04c (ffff8f0842e7f700) 00010000:00010000:0.0:1782222133.547891:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782222133.547894:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031400/0xe2b7cc26e6811493 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.547899:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031400/0xe2b7cc26e6811493 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.547929:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030c00/0xe2b7cc26e6811485 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558404 expref: 20 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.547955:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031e00/0xe2b7cc26e681149a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558404 expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.547961:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f087f8f2300) 00010000:00010000:0.0:1782222133.547964:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782222133.547966:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0840031e00, rc 0) 00000100:00100000:0.0:1782222133.548103:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+19:10507:x1868795060709120:12345-192.168.203.27@tcp:101:rm.0 Request processed in 1132us (1405us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222133.548111:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 37 00000100:00100000:2.0:1782222133.553022:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222133.553177:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060709376 00000100:00100000:1.0:1782222133.553187:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060709376 00000100:00100000:1.0:1782222133.553287:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 38 00000100:00100000:1.0:1782222133.553298:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b786d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+19:10507:x1868795060709376:12345-192.168.203.27@tcp:36:rm.0 00010000:00010000:1.0:1782222133.553347:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1782222133.553373:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031e00/0xe2b7cc26e681149a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558404 expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.553409:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458a00/0xe2b7cc26e6811446 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583e8 expref: 18 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.553655:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f087f8f2300) 00010000:00010000:1.0:1782222133.553669:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0875803800/0xe2b7cc26e681145b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583ef expref: 17 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.553678:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f087f92b700) 00010000:00010000:1.0:1782222133.553682:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782222133.553702:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e68114a1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.553715:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e68114a1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.553800:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e68114a1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.553813:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e68114a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.553820:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e68114a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.553826:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e68114a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.553908:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e68114af lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.553918:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e68114af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.553936:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e68114af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782222133.554617:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1782222133.554630:0:8465:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 332583393998ns, next at 333583391792ns, rc = 0 00010000:00010000:1.0:1782222133.554679:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e68114b6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.554689:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e68114b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.554698:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e68114b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.554706:0:8465:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e68114b6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.554712:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e68114b6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.554836:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e68114b6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.554902:0:8465:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782222133.554922:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e68114af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.554929:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e68114af lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.554935:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e68114af lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.554949:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744ce00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222133.554953:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e68114af lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.554961:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e68114af lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.554980:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f087f8f2300) 00010000:00010000:1.0:1782222133.554984:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782222133.554988:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e68114af lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.554994:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e68114af lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.555014:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e68114a1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.555019:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e68114a1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.555026:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e68114a1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.555030:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744c400 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222133.555033:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e68114a1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.555038:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e68114a1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.555056:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f087f92b700) 00010000:00010000:1.0:1782222133.555059:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222133.555062:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e68114a1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.555068:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e68114a1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782222133.555077:0:8465:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ed424db6 reply state 00000000cf52368f transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e68114a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.555088:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e68114a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.555094:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x53e8e04c (ffff8f0842e7f700) 00010000:00010000:1.0:1782222133.555096:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782222133.555098:0:8465:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782222133.555191:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b786d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+18:10507:x1868795060709376:12345-192.168.203.27@tcp:36:rm.0 Request processed in 1892us (2174us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1782222133.555199:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 38 00000100:00100000:1.0:1782222133.559676:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222133.560011:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060709632 00000100:00100000:3.0:1782222133.560020:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060709632 00000100:00100000:3.0:1782222133.560072:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 5 00000100:00100000:3.0:1782222133.560081:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+18:10507:x1868795060709632:12345-192.168.203.27@tcp:35:rm.0 00000100:00100000:3.0:1782222133.560641:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+19:10507:x1868795060709632:12345-192.168.203.27@tcp:35:rm.0 Request processed in 558us (969us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1782222133.560650:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 5 00010000:00010000:0.0:1782222133.562875:0:7468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782222133.562889:0:7468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e68114b6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.562900:0:7468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744c000 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:0.0:1782222133.562905:0:7468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e68114b6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.562915:0:7468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e68114b6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.562933:0:7468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f087f8f2300) 00010000:00010000:0.0:1782222133.562936:0:7468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782222133.562941:0:7468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e68114b6 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222133.562947:0:7468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e68114b6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222133.563050:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222133.563053:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222133.563055:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222133.564780:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222133.564922:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060709888 00000100:00100000:3.0:1782222133.564931:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060709888 00000100:00100000:3.0:1782222133.564997:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 39 00000100:00100000:3.0:1782222133.565008:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b787800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+19:10507:x1868795060709888:12345-192.168.203.27@tcp:36:rm.0 00010000:00010000:3.0:1782222133.565073:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1782222133.565098:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e6811477 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583fd expref: 19 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.565141:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811415 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583da expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.565151:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f087f92b700) 00010000:00010000:3.0:1782222133.565166:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82c00/0xe2b7cc26e68113d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583cc expref: 17 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.565175:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0747273400) 00010000:00010000:3.0:1782222133.565181:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782222133.565211:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0875803200/0xe2b7cc26e68114bd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.565223:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0875803200/0xe2b7cc26e68114bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.565272:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0875803200/0xe2b7cc26e68114bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.565293:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3e00/0xe2b7cc26e68114c4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.565305:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3e00/0xe2b7cc26e68114c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.565313:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3e00/0xe2b7cc26e68114c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.565412:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3c00/0xe2b7cc26e68114cb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.565441:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3c00/0xe2b7cc26e68114cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.565449:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3c00/0xe2b7cc26e68114cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782222133.565660:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1782222133.565674:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3c00/0xe2b7cc26e68114cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.565680:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3c00/0xe2b7cc26e68114cb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.565687:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3c00/0xe2b7cc26e68114cb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.565692:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08413d3c00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222133.565950:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3c00/0xe2b7cc26e68114cb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.565959:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3c00/0xe2b7cc26e68114cb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.565969:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f087f8f2700) 00010000:00010000:3.0:1782222133.565971:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782222133.565974:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3c00/0xe2b7cc26e68114cb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.565980:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3c00/0xe2b7cc26e68114cb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.566000:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0875803200/0xe2b7cc26e68114bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.566018:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0875803200/0xe2b7cc26e68114bd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.566025:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0875803200/0xe2b7cc26e68114bd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.566030:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0875803200 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222133.566034:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0875803200/0xe2b7cc26e68114bd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.566040:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0875803200/0xe2b7cc26e68114bd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.566048:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f087f8f2800) 00010000:00010000:3.0:1782222133.566051:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222133.566054:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0875803200/0xe2b7cc26e68114bd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.566059:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0875803200/0xe2b7cc26e68114bd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782222133.566071:0:6527:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c90933bf reply state 000000009f99460d transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3e00/0xe2b7cc26e68114c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.566081:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3e00/0xe2b7cc26e68114c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222133.566086:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f087f8f2400) 00010000:00010000:3.0:1782222133.566088:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782222133.566171:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782222133.566445:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b787800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+18:10507:x1868795060709888:12345-192.168.203.27@tcp:36:rm.0 Request processed in 1435us (1669us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1782222133.566461:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 39 00010000:00010000:0.0:1782222133.803115:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222134.827427:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782222135.275165:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782222135.275200:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087701ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081770624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782222135.275314:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222135.276155:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b785880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081770752:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782222135.276197:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222135.276503:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081770624 00000100:00100000:3.0:1782222135.276511:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081770624 00000100:00100000:3.0:1782222135.277553:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081770752 00000100:00100000:3.0:1782222135.277562:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081770752 00000100:00100000:2.0:1782222135.277643:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1782222135.277657:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081770624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782222135.277700:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782222135.277774:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081770624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (2459us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222135.277781:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1782222135.277799:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1782222135.277804:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f914700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081770752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782222135.277815:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782222135.277855:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f914700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081770752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (1657us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222135.277861:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:0.0:1782222135.277910:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1782222135.277957:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f087701ad80 x1868795081770624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222151 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222135.277975:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087701ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081770624:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1782222135.278020:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f086b785880 x1868795081770752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222151 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222135.278033:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b785880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081770752:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1782222135.850476:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222136.300436:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782222136.300465:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087701aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081770880:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782222136.300538:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222136.300783:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081770880 00000100:00100000:3.0:1782222136.300791:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081770880 00000100:00100000:3.0:1782222136.300842:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1782222136.300852:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081770880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782222136.300886:0:7480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1782222136.300942:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081770880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222136.300949:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1782222136.301030:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087701aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081770880:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782222136.301148:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081771008:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782222136.301176:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222136.301317:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081771008 00000100:00100000:2.0:1782222136.301322:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081771008 00000100:00100000:2.0:1782222136.301355:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1782222136.301362:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081771008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782222136.301380:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1782222136.301420:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081771008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222136.301426:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1782222136.301492:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081771008:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782222136.810598:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782222136.810629:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081771136:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782222136.810728:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222136.810826:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081771136 00000100:00100000:3.0:1782222136.810835:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081771136 00000100:00100000:3.0:1782222136.810903:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1782222136.810915:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087701bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081771136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782222136.810955:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222136.811009:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087701bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081771136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222136.811018:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:3.0:1782222136.811042:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782222136.811077:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0877018380 x1868795081771136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222152 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222136.811115:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081771136:0@lo:13:osp-pre-0-1.0 00000004:00080000:3.0:1782222136.811502:0:8886:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 335840266182ns, next at 336840263619ns, rc = 0 00000100:00100000:2.0:1782222136.811729:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081771264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782222136.811780:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222136.812481:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081771264 00000100:00100000:3.0:1782222136.812491:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081771264 00000100:00100000:3.0:1782222136.812553:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1782222136.812562:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b785180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081771264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782222136.812589:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222136.812646:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b785180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081771264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222136.812653:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:1.0:1782222136.812728:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782222136.812817:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0877018380 x1868795081771264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222152 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222136.812837:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081771264:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782222136.883325:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222137.255713:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222137.258150:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060710016 00000100:00100000:0.0:1782222137.258170:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060710016 00000100:00100000:0.0:1782222137.258284:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 342 00000100:00100000:0.0:1782222137.258296:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2390:x1868795060710016:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222137.258408:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2390:x1868795060710016:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 112us (2709us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222137.258417:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 342 00000100:00100000:0.0:1782222137.265849:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222137.265891:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222137.265916:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222137.265951:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222137.265981:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060710144 00000100:00100000:0.0:1782222137.265992:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060710144 00000100:00100000:0.0:1782222137.266055:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060710272 00000100:00100000:0.0:1782222137.266058:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060710272 00000100:00100000:0.0:1782222137.266071:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060710528 00000100:00100000:0.0:1782222137.266073:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060710528 00000100:00100000:0.0:1782222137.266102:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 234 00000100:00100000:0.0:1782222137.266112:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+18:2389:x1868795060710144:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222137.266223:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+18:2389:x1868795060710144:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 101us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222137.266231:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 234 00000100:00100000:0.0:1782222137.266277:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 235 00000100:00100000:0.0:1782222137.266284:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060710272:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222137.266312:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060710272:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 29us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222137.266318:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 235 00000100:00100000:0.0:1782222137.266330:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 236 00000100:00100000:0.0:1782222137.266337:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f914e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2390:x1868795060710528:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222137.266360:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f914e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2390:x1868795060710528:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 24us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222137.266367:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 236 00000100:00100000:0.0:1782222137.266385:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060710400 00000100:00100000:0.0:1782222137.266400:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060710400 00000100:00100000:0.0:1782222137.266426:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 111 00000100:00100000:0.0:1782222137.266432:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747295c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+5:2389:x1868795060710400:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222137.266460:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747295c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+5:2389:x1868795060710400:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 28us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222137.266471:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 111 00000100:00080000:0.0:1782222137.266487:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782222137.266491:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782222137.266493:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782222137.267280:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222137.267354:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060710656 00000100:00100000:1.0:1782222137.267360:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060710656 00000100:00100000:1.0:1782222137.267413:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 237 00000100:00100000:1.0:1782222137.267421:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2389:x1868795060710656:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222137.267472:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2389:x1868795060710656:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 52us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222137.267480:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 237 00000100:00080000:0.0:1782222137.267775:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:2.0:1782222137.528487:0:13690:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:1.0:1782222137.837406:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b785880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1868795081771520:0@lo:400:kworker.0 00000100:00100000:1.0:1782222137.837517:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222137.837614:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1868795081772032:0@lo:400:kworker.0 00000100:00100000:1.0:1782222137.837641:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222137.837666:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1868795081772544:0@lo:400:kworker.0 00000100:00100000:1.0:1782222137.837690:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222137.837722:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1782222137.837728:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b787100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081771648:0@lo:400:kworker.0 00000100:00100000:1.0:1782222137.837757:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222137.837781:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1868795081772160:0@lo:400:kworker.0 00000100:00100000:1.0:1782222137.837806:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222137.837823:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1868795081772672:0@lo:400:kworker.0 00000100:00100000:1.0:1782222137.837845:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222137.837883:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081771520 00000100:00100000:1.0:1782222137.837893:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081771520 00000100:00100000:1.0:1782222137.837948:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081772032 00000100:00100000:1.0:1782222137.837952:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081772032 00000100:00100000:1.0:1782222137.837979:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081772544 00000100:00100000:1.0:1782222137.837983:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081772544 00000100:00100000:1.0:1782222137.838015:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081772160 00000100:00100000:1.0:1782222137.838018:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081772160 00000100:00100000:1.0:1782222137.838032:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081772672 00000100:00100000:1.0:1782222137.838034:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081772672 00000100:00100000:1.0:1782222137.838052:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1782222137.838062:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1868795081771520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222137.838127:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1868795081771520:12345-0@lo:400:kworker.0 Request processed in 65us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222137.838135:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1782222137.838160:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1782222137.838167:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1868795081772032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222137.838195:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1868795081772032:12345-0@lo:400:kworker.0 Request processed in 29us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222137.838201:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1782222137.838228:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1782222137.838266:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1868795081772544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222137.838297:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1868795081772544:12345-0@lo:400:kworker.0 Request processed in 63us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222137.838303:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1782222137.838316:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1782222137.838322:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1868795081772160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222137.838350:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1868795081772160:12345-0@lo:400:kworker.0 Request processed in 28us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222137.838356:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1782222137.838369:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1782222137.838375:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1868795081772672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222137.838413:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1868795081772672:12345-0@lo:400:kworker.0 Request processed in 38us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222137.838419:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00010000:00080000:1.0:1782222137.838464:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0875aae300 x1868795081772160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222137.838480:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1868795081772160:0@lo:400:kworker.0 00010000:00080000:1.0:1782222137.838494:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0875aac380 x1868795081772672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222137.838503:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1868795081772672:0@lo:400:kworker.0 00000100:00100000:1.0:1782222137.838516:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b785880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1868795081771520:0@lo:400:kworker.0 00000100:00100000:1.0:1782222137.838526:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1868795081772032:0@lo:400:kworker.0 00000100:00100000:1.0:1782222137.838536:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1868795081772544:0@lo:400:kworker.0 00000100:00100000:0.0:1782222137.838872:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3654:1868795081771392:0@lo:400:kworker.0 00000100:00100000:0.0:1782222137.838924:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222137.838968:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1868795081771904:0@lo:400:kworker.0 00000100:00100000:0.0:1782222137.838995:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222137.839013:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081772416:0@lo:400:kworker.0 00000100:00100000:0.0:1782222137.839042:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222137.839060:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081772928:0@lo:400:kworker.0 00000100:00100000:0.0:1782222137.839082:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222137.839116:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1782222137.839124:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081771776:0@lo:400:kworker.0 00000100:00100000:0.0:1782222137.839149:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222137.839170:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081772288:0@lo:400:kworker.0 00000100:00100000:0.0:1782222137.839190:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222137.839215:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081772800:0@lo:400:kworker.0 00000100:00100000:0.0:1782222137.839281:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782222137.839308:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782222137.839313:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782222137.839324:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081771648 00000100:00100000:0.0:1782222137.839330:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081771648 00000100:00100000:0.0:1782222137.839373:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081771776 00000100:00100000:0.0:1782222137.839376:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081771776 00000100:00100000:0.0:1782222137.839390:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1782222137.839397:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081771648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222137.839438:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081771648:12345-0@lo:400:kworker.0 Request processed in 41us (1680us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222137.839446:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1782222137.839458:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1782222137.839464:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747294700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081771776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222137.839491:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747294700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081771776:12345-0@lo:400:kworker.0 Request processed in 27us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222137.839496:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1782222137.839512:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081772416 00000100:00100000:0.0:1782222137.839515:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081772416 00000100:00100000:0.0:1782222137.839531:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081772928 00000100:00100000:0.0:1782222137.839534:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081772928 00000100:00100000:0.0:1782222137.839549:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081772288 00000100:00100000:0.0:1782222137.839551:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081772288 00000100:00100000:0.0:1782222137.839561:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081772800 00000100:00100000:0.0:1782222137.839563:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081772800 00000100:00100000:0.0:1782222137.839575:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1782222137.839580:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747296680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081772416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222137.839805:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081771392 00000100:00100000:1.0:1782222137.839810:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081771392 00000100:00100000:1.0:1782222137.839838:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1782222137.839844:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3654:x1868795081771392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222137.839877:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3654:x1868795081771392:12345-0@lo:400:kworker.0 Request processed in 33us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222137.839884:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1782222137.839915:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081771904 00000100:00100000:1.0:1782222137.839918:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081771904 00000100:00100000:1.0:1782222137.839935:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1782222137.839940:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1868795081771904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222137.839983:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1868795081771904:12345-0@lo:400:kworker.0 Request processed in 42us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222137.839991:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1782222137.840012:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1782222137.840019:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747297800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081772928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222137.840048:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747297800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081772928:12345-0@lo:400:kworker.0 Request processed in 31us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222137.840055:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1782222137.840067:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1782222137.840073:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747297480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081772288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222137.840113:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747297480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081772288:12345-0@lo:400:kworker.0 Request processed in 28us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222137.840120:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1782222137.840131:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1782222137.840137:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747294a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081772800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222137.840159:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747294a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081772800:12345-0@lo:400:kworker.0 Request processed in 24us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222137.840165:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1782222137.840216:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b787100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081771648:0@lo:400:kworker.0 00000100:00100000:0.0:1782222137.840343:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747296680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081772416:12345-0@lo:400:kworker.0 Request processed in 762us (1299us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222137.840418:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1782222137.840447:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081771776:0@lo:400:kworker.0 00010000:00080000:0.0:1782222137.840461:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0875aafb80 x1868795081772288/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222137.840472:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081772288:0@lo:400:kworker.0 00010000:00080000:0.0:1782222137.840482:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0877154380 x1868795081772800/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222137.840491:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081772800:0@lo:400:kworker.0 00000100:00100000:0.0:1782222137.840499:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3654:1868795081771392:0@lo:400:kworker.0 00000100:00100000:0.0:1782222137.840509:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1868795081771904:0@lo:400:kworker.0 00010000:00080000:0.0:1782222137.840518:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0875aaf800 x1868795081772416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222137.840526:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081772416:0@lo:400:kworker.0 00010000:00080000:0.0:1782222137.840535:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0877155180 x1868795081772928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222137.840543:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081772928:0@lo:400:kworker.0 00000100:00080000:0.0:1782222137.840572:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782222137.898479:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782222138.638060:0:13738:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff2ba377b0 20000000:00000080:2.0:1782222138.638080:0:13738:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f07476a5c00 uarg=0000000000000000 20000000:01000000:2.0:1782222138.638175:0:13738:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1782222138.638192:0:13738:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1782222138.638197:0:13738:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1782222138.642940:0:13739:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1782222138.643118:0:13738:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1782222138.653933:0:13738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1782222138.653998:0:13738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1782222138.654016:0:13738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1782222138.654037:0:13738:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1782222138.654061:0:13738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f087fb82200/0xe2b7cc26e68114d2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222138.654085:0:13738:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f087fb82400/0xe2b7cc26e681135f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583b7 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222138.654094:0:13738:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f087fb82e00/0xe2b7cc26e6811366 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583be expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222138.654114:0:13738:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f074744d200/0xe2b7cc26e6811374 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e681136d expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222138.654140:0:13738:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f087fb82800/0xe2b7cc26e6811382 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e681137b expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222138.654147:0:13738:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0841459800/0xe2b7cc26e6811390 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6811389 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222138.654154:0:13738:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0840030800/0xe2b7cc26e681139e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6811397 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222138.654163:0:13738:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f087fb82200/0xe2b7cc26e68114d2 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222138.654219:0:13738:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0840030800/0xe2b7cc26e681139e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e6811397 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222138.654255:0:13738:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0840030800/0xe2b7cc26e681139e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e6811397 expref: 23 pid: 6519 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222138.654282:0:13738:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877154a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13738:1868795081773056:0@lo:104: 00000100:00100000:2.0:1782222138.655449:0:13738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1782222138.658391:0:6505:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:1.0:1782222138.658449:0:6505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:1.0:1782222138.658465:0:6505:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:1.0:1782222138.658516:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e681142a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222138.658531:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e681142a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222138.658556:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e681142a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222138.658565:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744da00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222138.658571:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e681142a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222138.658582:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e681142a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222138.658591:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087701b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081773184:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782222138.658610:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x53e8e04c (ffff8f0842e7f700) 00010000:00010000:1.0:1782222138.658616:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222138.658623:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e681142a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222138.658631:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e681142a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222138.658668:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782222138.658676:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459e00/0xe2b7cc26e681143f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222138.658686:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459e00/0xe2b7cc26e681143f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222138.658692:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459e00/0xe2b7cc26e681143f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222138.658698:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0841459e00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222138.658704:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459e00/0xe2b7cc26e681143f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222138.658721:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459e00/0xe2b7cc26e681143f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222138.658733:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f087f8f2300) 00010000:00010000:1.0:1782222138.658736:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222138.658740:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459e00/0xe2b7cc26e681143f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222138.658746:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459e00/0xe2b7cc26e681143f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222138.658756:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081773184 00000100:00100000:3.0:1782222138.658766:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081773184 00010000:00010000:1.0:1782222138.658772:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e68114a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222138.658781:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e68114a8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222138.658788:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e68114a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222138.658794:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744dc00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222138.658798:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e68114a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222138.658805:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e68114a8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222138.658816:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x53e8e04c (ffff8f0842e7f700) 00010000:00010000:1.0:1782222138.658819:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222138.658823:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e68114a8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222138.658837:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e68114a8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222138.658842:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782222138.658862:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877018a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081773184:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782222138.658869:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3e00/0xe2b7cc26e68114c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222138.658878:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3e00/0xe2b7cc26e68114c4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222138.658884:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3e00/0xe2b7cc26e68114c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1782222138.658890:0:8440:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00010000:00010000:1.0:1782222138.658890:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08413d3e00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222138.658895:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3e00/0xe2b7cc26e68114c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222138.658905:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3e00/0xe2b7cc26e68114c4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222138.658915:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f087f8f2400) 00010000:00010000:1.0:1782222138.658917:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222138.658920:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3e00/0xe2b7cc26e68114c4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222138.658927:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3e00/0xe2b7cc26e68114c4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782222138.658928:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a3a8d34, atime: 0x6a3a8d34, ctime: 0x6a3a8d34, blocks: 0x0 00010000:00010000:3.0:1782222138.658953:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a3ed614/0xe2b7cc26e68114d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222138.658972:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=337s v=(0 0) 00010000:00010000:3.0:1782222138.658978:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782222138.658985:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a3ed614/0xe2b7cc26e68114d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222138.659012:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a3ed614/0xe2b7cc26e68114d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222138.659023:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a3ed614/0xe2b7cc26e68114d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222138.659030:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a3ed614/0xe2b7cc26e68114d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222138.659054:0:8440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782222138.659135:0:7468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782222138.659143:0:7468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a3ed614/0xe2b7cc26e68114d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222138.659169:0:7468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08413d2c00 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:1.0:1782222138.659174:0:7468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a3ed614/0xe2b7cc26e68114d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222138.659184:0:7468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a3ed614/0xe2b7cc26e68114d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222138.659214:0:7468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a3ed614/0xe2b7cc26e68114d9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222138.659223:0:7468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a3ed614/0xe2b7cc26e68114d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222138.659263:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877018a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3655:x1868795081773184:12345-0@lo:6:osp-syn-0-0.0 Request processed in 405us (594us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1782222138.659273:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1782222138.659295:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1782222138.659325:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f087701b800/2, rc 0, transno 4294967301 00000100:00100000:3.0:1782222138.659331:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087701b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081773184:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782222138.660553:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222138.660561:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222138.660564:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222138.661607:0:6510:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782222138.661633:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081773056 00000100:00100000:3.0:1782222138.661642:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081773056 00000100:00100000:3.0:1782222138.661772:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782222138.661851:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088165b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+3:13738:x1868795081773056:12345-0@lo:104: 00010000:00010000:3.0:1782222138.661869:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f087fb83200/0xe2b7cc26e6811397 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e681139e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222138.661953:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782222138.661972:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088165b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+3:13738:x1868795081773056:12345-0@lo:104: Request processed in 124us (6532us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222138.661979:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:3.0:1782222138.662058:0:13738:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0841459800/0xe2b7cc26e6811390 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e6811389 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222138.662071:0:13738:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f0841459800/0xe2b7cc26e6811390 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e6811389 expref: 23 pid: 6519 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222138.662085:0:13738:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087701b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13738:1868795081773312:0@lo:104: 00000100:00100000:3.0:1782222138.662114:0:13738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222138.662141:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081773312 00010000:00010000:2.0:1782222138.662192:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782222138.662199:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f087fb83200/0xe2b7cc26e6811397 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e681139e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222138.662218:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83200 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:2.0:1782222138.662222:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f087fb83200/0xe2b7cc26e6811397 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e681139e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222138.662231:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f087fb83200/0xe2b7cc26e6811397 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e681139e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782222138.662277:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f087fb83200/0xe2b7cc26e6811397 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e681139e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782222138.662285:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782222138.662329:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f087fb83200/0xe2b7cc26e6811397 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e681139e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222138.662336:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782222138.662365:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f087fb83200/0xe2b7cc26e6811397 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e681139e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222138.662372:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f087fb83200/0xe2b7cc26e6811397 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e681139e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222138.662379:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1782222138.662388:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222138.662392:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222138.662394:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782222138.662415:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081773440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782222138.662495:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222138.662682:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081773440 00000100:00100000:2.0:1782222138.662691:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081773440 00010000:00010000:2.0:1782222138.662733:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0840030800/0xe2b7cc26e681139e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6811397 expref: 24 pid: 6519 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222138.662774:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1782222138.662782:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3655:x1868795081773440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782222138.662804:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782222138.662810:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0840030800/0xe2b7cc26e681139e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6811397 expref: 24 pid: 6519 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222138.662824:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0840030800/0xe2b7cc26e681139e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e6811397 expref: 24 pid: 6519 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222138.662869:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782222138.662910:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3655:x1868795081773440:12345-0@lo:103:ldlm_bl.0 Request processed in 127us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222138.662919:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1782222138.663070:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081773440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782222138.663307:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081773312 00000100:00100000:3.0:1782222138.663367:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782222138.663377:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877019f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+3:13738:x1868795081773312:12345-0@lo:104: 00010000:00010000:3.0:1782222138.663388:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e6811389 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6811390 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222138.663454:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782222138.663460:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877019f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+3:13738:x1868795081773312:12345-0@lo:104: Request processed in 86us (1345us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222138.663468:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:2.0:1782222138.663485:0:13738:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f087fb82800/0xe2b7cc26e6811382 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e681137b expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222138.663494:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782222138.663502:0:13738:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f087fb82800/0xe2b7cc26e6811382 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e681137b expref: 23 pid: 6520 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222138.663503:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e6811389 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6811390 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222138.663547:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744d000 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:3.0:1782222138.663552:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e6811389 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e6811390 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222138.663554:0:13738:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877155c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13738:1868795081773568:0@lo:104: 00010000:00010000:3.0:1782222138.663588:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e6811389 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e6811390 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782222138.663596:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e6811389 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e6811390 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782222138.663602:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1782222138.663610:0:13738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782222138.663637:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e6811389 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811390 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222138.663647:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782222138.663672:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e6811389 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811390 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222138.663680:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e6811389 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811390 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222138.663794:0:13738:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f074744d200/0xe2b7cc26e6811374 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e681136d expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222138.663804:0:13738:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f074744d200/0xe2b7cc26e6811374 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e681136d expref: 23 pid: 6521 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222138.663812:0:13738:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877154380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13738:1868795081773824:0@lo:104: 00000100:00100000:2.0:1782222138.663836:0:13738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782222138.663869:0:13738:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f087fb82e00/0xe2b7cc26e6811366 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583be expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222138.663879:0:13738:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f087fb82e00/0xe2b7cc26e6811366 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583be expref: 12 pid: 6521 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222138.663889:0:13738:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881598e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13738:1868795081773952:192.168.203.27@tcp:104: 00010000:00010000:2.0:1782222138.663964:0:13738:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f087fb82400/0xe2b7cc26e681135f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583b7 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222138.664329:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222138.664333:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222138.664335:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222138.664353:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081773696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782222138.664403:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222138.664464:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081773696 00000100:00100000:3.0:1782222138.664469:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081773696 00010000:00010000:3.0:1782222138.664493:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0841459800/0xe2b7cc26e6811390 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6811389 expref: 24 pid: 6519 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222138.664518:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782222138.664526:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087701a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3653:x1868795081773696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782222138.664548:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222138.664554:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0841459800/0xe2b7cc26e6811390 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6811389 expref: 24 pid: 6519 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222138.665084:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081773568 00000100:00100000:1.0:1782222138.665095:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081773568 00000100:00100000:1.0:1782222138.665139:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081773824 00000100:00100000:1.0:1782222138.665142:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081773824 00000100:00100000:1.0:1782222138.665158:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782222138.665167:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877155180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+4:13738:x1868795081773568:12345-0@lo:104: 00010000:00010000:1.0:1782222138.665195:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f0841458600/0xe2b7cc26e681137b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6811382 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222138.665388:0:13738:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f087fb82400/0xe2b7cc26e681135f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583b7 expref: 12 pid: 6520 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222138.665402:0:13738:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747649180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13738:1868795081774080:192.168.203.27@tcp:104: 00000100:00100000:2.0:1782222138.665496:0:13738:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746444900 going to sleep for 11 seconds 00010000:00010000:2.0:1782222138.665523:0:13738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0840030800/0xe2b7cc26e681139e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e6811397 expref: 24 pid: 6519 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222138.665538:0:13738:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877154a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13738:1868795081773056:0@lo:104: 00000100:00100000:2.0:1782222138.665553:0:13738:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087701b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13738:1868795081773312:0@lo:104: 00000100:00100000:2.0:1782222138.665561:0:13738:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877155c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13738:1868795081773568:0@lo:104: 00010000:00010000:3.0:1782222138.665625:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0841459800/0xe2b7cc26e6811390 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e6811389 expref: 23 pid: 6519 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222138.665640:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1782222138.665649:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0841459800/0xe2b7cc26e6811390 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e6811389 expref: 23 pid: 6519 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222138.665663:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877155180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+4:13738:x1868795081773568:12345-0@lo:104: Request processed in 484us (2042us total) trans 0 rc 0/0 00010000:00010000:3.0:1782222138.665666:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782222138.665677:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782222138.665705:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782222138.665714:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088159bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+3:13738:x1868795081773824:12345-0@lo:104: 00010000:00010000:1.0:1782222138.665723:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f0841458c00/0xe2b7cc26e681136d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6811374 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222138.665761:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087701a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:3653:x1868795081773696:12345-0@lo:103:ldlm_bl.0 Request processed in 1232us (1354us total) trans 0 rc 0/0 00010000:00010000:1.0:1782222138.665786:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782222138.665794:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088159bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+3:13738:x1868795081773824:12345-0@lo:104: Request processed in 82us (1957us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222138.665801:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:1.0:1782222138.665823:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782222138.665829:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f0841458600/0xe2b7cc26e681137b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6811382 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222138.665837:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0841458600 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:1.0:1782222138.665842:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f0841458600/0xe2b7cc26e681137b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e6811382 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222138.665850:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f0841458600/0xe2b7cc26e681137b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e6811382 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782222138.665857:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f0841458600/0xe2b7cc26e681137b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e6811382 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782222138.665872:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1782222138.665887:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:1.0:1782222138.665910:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f0841458600/0xe2b7cc26e681137b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811382 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222138.665919:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782222138.665946:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f0841458600/0xe2b7cc26e681137b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811382 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222138.665953:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f0841458600/0xe2b7cc26e681137b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811382 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222138.665960:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3654:1868795081774208:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782222138.665972:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782222138.665977:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f0841458c00/0xe2b7cc26e681136d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6811374 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222138.665985:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0841458c00 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:1.0:1782222138.665989:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f0841458c00/0xe2b7cc26e681136d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e6811374 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222138.665996:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f0841458c00/0xe2b7cc26e681136d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e6811374 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782222138.666003:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f0841458c00/0xe2b7cc26e681136d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e6811374 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222138.666014:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1782222138.666017:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782222138.666033:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f0841458c00/0xe2b7cc26e681136d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811374 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222138.666039:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782222138.666069:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f0841458c00/0xe2b7cc26e681136d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811374 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222138.666071:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081774208 00000100:00100000:3.0:1782222138.666082:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081774208 00010000:00010000:1.0:1782222138.666083:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f0841458c00/0xe2b7cc26e681136d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6811374 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222138.666108:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222138.666111:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222138.666114:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f087fb82800/0xe2b7cc26e6811382 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e681137b expref: 22 pid: 6520 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222138.666115:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782222138.666128:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782222138.666143:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081774336:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782222138.666165:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782222138.666178:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877018380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:3654:x1868795081774208:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782222138.666187:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782222138.666262:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222138.666354:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222138.666362:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f087fb82800/0xe2b7cc26e6811382 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e681137b expref: 22 pid: 6520 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222138.666373:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f087fb82800/0xe2b7cc26e6811382 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e681137b expref: 22 pid: 6520 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222138.666402:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f087fb82800/0xe2b7cc26e6811382 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e681137b expref: 22 pid: 6520 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222138.666414:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782222138.666475:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877018380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:3654:x1868795081774208:12345-0@lo:103:ldlm_bl.0 Request processed in 300us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222138.666482:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782222138.666488:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081773696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782222138.666501:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081774336 00000100:00100000:3.0:1782222138.666507:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081774336 00010000:00010000:3.0:1782222138.666524:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f074744d200/0xe2b7cc26e6811374 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e681136d expref: 21 pid: 6521 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222138.666536:0:13738:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877154380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13738:1868795081773824:0@lo:104: 00000100:00100000:3.0:1782222138.666560:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782222138.666568:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:3656:x1868795081774336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782222138.666576:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222138.666580:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f074744d200/0xe2b7cc26e6811374 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e681136d expref: 21 pid: 6521 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222138.666589:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f074744d200/0xe2b7cc26e6811374 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e681136d expref: 21 pid: 6521 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222138.666599:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f074744d200/0xe2b7cc26e6811374 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e681136d expref: 21 pid: 6521 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222138.666608:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782222138.666646:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:3656:x1868795081774336:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222138.666652:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1782222138.666875:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3654:1868795081774208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782222138.667707:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081774336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782222138.670997:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222138.671216:0:13738:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881598e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13738:1868795081773952:192.168.203.27@tcp:104: 00000100:00100000:2.0:1782222138.671231:0:13738:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747649180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13738:1868795081774080:192.168.203.27@tcp:104: 00010000:00010000:2.0:1782222138.671462:0:13738:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f087fb82200/0xe2b7cc26e68114d2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222138.671532:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060710784 00000100:00100000:3.0:1782222138.671540:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060710784 00010000:00010000:3.0:1782222138.671576:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f087fb82e00/0xe2b7cc26e6811366 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583be expref: 13 pid: 6521 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222138.671617:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 50 00000100:00100000:3.0:1782222138.671627:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747295f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2389:x1868795060710784:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782222138.671643:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222138.671649:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f087fb82e00/0xe2b7cc26e6811366 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583be expref: 13 pid: 6521 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222138.671659:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f087fb82e00/0xe2b7cc26e6811366 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583be expref: 13 pid: 6521 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222138.671676:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f087fb82e00/0xe2b7cc26e6811366 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583be expref: 13 pid: 6521 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222138.671702:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782222138.671760:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747295f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2ca5b6e-1b2d-4770-b014-03af882e6158+12:2389:x1868795060710784:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 133us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222138.671767:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 50 00000100:00100000:0.0:1782222138.673185:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222138.673307:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060710912 00000100:00100000:3.0:1782222138.673316:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060710912 00010000:00010000:3.0:1782222138.673347:0:9532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f087fb82400/0xe2b7cc26e681135f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583b7 expref: 12 pid: 6520 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222138.673385:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 51 00000100:00100000:3.0:1782222138.673394:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747297100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2ca5b6e-1b2d-4770-b014-03af882e6158+12:2390:x1868795060710912:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782222138.673408:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222138.673445:0:9532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f087fb82400/0xe2b7cc26e681135f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583b7 expref: 12 pid: 6520 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222138.673456:0:9532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f087fb82400/0xe2b7cc26e681135f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583b7 expref: 12 pid: 6520 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222138.673474:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f087fb82400/0xe2b7cc26e681135f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75583b7 expref: 12 pid: 6520 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222138.673491:0:9532:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f087fb82200/0xe2b7cc26e68114d2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222138.673500:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fb82200/0xe2b7cc26e68114d2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222138.673518:0:9532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f087fb82200/0xe2b7cc26e68114d2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222138.673524:0:9532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f087fb82200/0xe2b7cc26e68114d2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222138.673530:0:9532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f087fb82200/0xe2b7cc26e68114d2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222138.673537:0:9532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f087fb82200/0xe2b7cc26e68114d2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222138.673542:0:9532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb82200 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:3.0:1782222138.673546:0:9532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f087fb82200/0xe2b7cc26e68114d2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222138.673554:0:9532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f087fb82200/0xe2b7cc26e68114d2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222138.673581:0:9532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f087fb82200/0xe2b7cc26e68114d2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222138.673592:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782222138.673611:0:13738:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f087fb82200/0xe2b7cc26e68114d2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222138.673623:0:13738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f087fb82200/0xe2b7cc26e68114d2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222138.673641:0:13738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f087fb82200/0xe2b7cc26e68114d2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222138.673648:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747297100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2ca5b6e-1b2d-4770-b014-03af882e6158+11:2390:x1868795060710912:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 252us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222138.673658:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 51 00010000:00010000:3.0:1782222138.925984:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782222139.562185:0:13788:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd7ac6c680 20000000:00000080:0.0:1782222139.562216:0:13788:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f07477d1c00 uarg=0000000000000000 20000000:01000000:0.0:1782222139.563450:0:13788:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1782222139.563466:0:13788:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1782222139.563471:0:13788:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1782222139.563953:0:13789:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1782222139.564102:0:13788:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1782222139.564190:0:13788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1782222139.564266:0:13788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1782222139.564286:0:13788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1782222139.564298:0:13788:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1782222139.564320:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f08413d3400/0xe2b7cc26e68114e0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222139.564335:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f08413d3400/0xe2b7cc26e68114e0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222139.564345:0:13788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f08413d3400/0xe2b7cc26e68114e0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222139.564352:0:13788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f08413d3400/0xe2b7cc26e68114e0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222139.564358:0:13788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f08413d3400/0xe2b7cc26e68114e0 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222139.564366:0:13788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f08413d3400/0xe2b7cc26e68114e0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222139.564551:0:13788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08413d3400 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:3.0:1782222139.564556:0:13788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f08413d3400/0xe2b7cc26e68114e0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222139.564565:0:13788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f08413d3400/0xe2b7cc26e68114e0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222139.564577:0:13788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f08413d3400/0xe2b7cc26e68114e0 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222139.564584:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f08413d3400/0xe2b7cc26e68114e0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222139.564590:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f08413d3400/0xe2b7cc26e68114e0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222139.814018:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222139.814317:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060711040 00000100:00100000:2.0:1782222139.814327:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060711040 00000100:00100000:2.0:1782222139.814389:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 344 00000100:00100000:2.0:1782222139.814398:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+11:6161:x1868795060711040:12345-192.168.203.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782222139.814415:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222139.814436:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f087fb82c00/0xe2b7cc26e68114e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x558f77f2f755840b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222139.814463:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fb82c00/0xe2b7cc26e68114e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755840b expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222139.814474:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f087fb82c00/0xe2b7cc26e68114e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755840b expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222139.814483:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb82c00, rc 0) 00000100:00100000:2.0:1782222139.814542:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+12:6161:x1868795060711040:12345-192.168.203.27@tcp:101:ll_cfg_requeue.0 Request processed in 144us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222139.814549:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 344 00000100:00100000:1.0:1782222139.820903:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222139.821022:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060711168 00000100:00100000:0.0:1782222139.821032:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060711168 00000100:00100000:0.0:1782222139.821106:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 345 00000100:00100000:0.0:1782222139.821116:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+12:6161:x1868795060711168:12345-192.168.203.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782222139.821330:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+12:6161:x1868795060711168:12345-192.168.203.27@tcp:501:ll_cfg_requeue.0 Request processed in 215us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222139.821339:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 345 00000100:00100000:0.0:1782222139.824109:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222139.824214:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060711296 00000100:00100000:1.0:1782222139.824223:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060711296 00000100:00100000:1.0:1782222139.824295:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 346 00000100:00100000:1.0:1782222139.824304:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+12:6161:x1868795060711296:12345-192.168.203.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782222139.825681:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+12:6161:x1868795060711296:12345-192.168.203.27@tcp:503:ll_cfg_requeue.0 Request processed in 1368us (1572us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222139.825692:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 346 00000100:00100000:1.0:1782222139.831840:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222139.832533:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060711424 00000100:00100000:2.0:1782222139.832543:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060711424 00000100:00100000:2.0:1782222139.832602:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 347 00000100:00100000:2.0:1782222139.832612:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+12:10791:x1868795060711424:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782222139.832761:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+12:10791:x1868795060711424:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 149us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222139.832776:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 347 00000100:00100000:2.0:1782222139.850587:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222139.854100:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060711552 00000100:00100000:1.0:1782222139.854114:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060711552 00000100:00100000:1.0:1782222139.854188:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 348 00000100:00100000:1.0:1782222139.854216:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+12:10791:x1868795060711552:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782222139.854437:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+12:10791:x1868795060711552:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 223us (3859us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222139.854446:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 348 00000100:00100000:3.0:1782222139.859080:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222139.859180:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060711680 00000100:00100000:0.0:1782222139.859190:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060711680 00000100:00100000:0.0:1782222139.859290:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 349 00000100:00100000:0.0:1782222139.859301:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+12:6161:x1868795060711680:12345-192.168.203.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782222139.859317:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222139.859333:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0840031e00/0xe2b7cc26e68114ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558412 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222139.859362:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0840031e00/0xe2b7cc26e68114ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558412 expref: 13 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222139.859600:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0840031e00/0xe2b7cc26e68114ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558412 expref: 13 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222139.859612:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0840031e00, rc 0) 00000100:00100000:0.0:1782222139.860510:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:6161:x1868795060711680:12345-192.168.203.27@tcp:101:ll_cfg_requeue.0 Request processed in 1206us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222139.860539:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 349 00000100:00100000:0.0:1782222139.877785:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222139.878131:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060711808 00000100:00100000:2.0:1782222139.878141:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060711808 00000100:00100000:2.0:1782222139.878210:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 350 00000100:00100000:2.0:1782222139.878219:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:6161:x1868795060711808:12345-192.168.203.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782222139.883995:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:6161:x1868795060711808:12345-192.168.203.27@tcp:501:ll_cfg_requeue.0 Request processed in 5766us (6206us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222139.884011:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 350 00000100:00100000:2.0:1782222139.886214:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222139.886337:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060711936 00000100:00100000:0.0:1782222139.886357:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060711936 00000100:00100000:1.0:1782222139.886604:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 351 00000100:00100000:1.0:1782222139.886617:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:6161:x1868795060711936:12345-192.168.203.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782222139.894284:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:6161:x1868795060711936:12345-192.168.203.27@tcp:503:ll_cfg_requeue.0 Request processed in 7657us (8065us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222139.894300:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 351 00000100:00100000:3.0:1782222139.901389:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222139.901652:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060712064 00000100:00100000:0.0:1782222139.901661:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060712064 00000100:00100000:0.0:1782222139.901730:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 352 00000100:00100000:0.0:1782222139.901740:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0850982850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:10795:x1868795060712064:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782222139.901897:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0850982850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:10795:x1868795060712064:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 157us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222139.901906:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 352 00000100:00100000:0.0:1782222139.906075:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222139.906171:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060712192 00000100:00100000:1.0:1782222139.906182:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060712192 00000100:00100000:1.0:1782222139.906266:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 353 00000100:00100000:1.0:1782222139.906277:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:10795:x1868795060712192:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782222139.906465:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:10795:x1868795060712192:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 189us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222139.906472:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 353 10000000:01000000:1.0:1782222139.946953:0:6523:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782222139.946961:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f08815e6800 from 7 10000000:01000000:1.0:1782222139.946967:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782222139.947020:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f074744c600/0xe2b7cc26e68114f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222139.947031:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f074744c600/0xe2b7cc26e68114f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222139.947041:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f074744c600/0xe2b7cc26e68114f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222139.947085:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081774464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782222139.947155:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222139.947284:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746166f00 going to sleep for 11 seconds 00010000:00010000:1.0:1782222139.948880:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222139.951790:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081774464 00000100:00100000:0.0:1782222139.951806:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081774464 00000100:00100000:2.0:1782222139.954120:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1782222139.954135:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0850980c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:6523:x1868795081774464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782222139.954153:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222139.954170:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f087fb82200/0xe2b7cc26e68114fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e68114f5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222139.954208:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fb82200/0xe2b7cc26e68114fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e68114f5 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222139.954219:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f087fb82200/0xe2b7cc26e68114fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68114f5 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222139.954227:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb82200, rc 0) 00000100:00100000:2.0:1782222139.954309:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0850980c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:6523:x1868795081774464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (7154us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222139.954316:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1782222139.954550:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081774464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782222139.954568:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f074744c600/0xe2b7cc26e68114f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68114fc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222139.954577:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f074744c600/0xe2b7cc26e68114f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e68114fc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222139.954649:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081774592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782222139.954681:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222139.954733:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f07474186c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782222139.954784:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081774592 00000100:00100000:2.0:1782222139.954790:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081774592 00000100:00100000:2.0:1782222139.954819:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1782222139.954826:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0850981450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:6523:x1868795081774592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782222139.954931:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0850981450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:6523:x1868795081774592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222139.954937:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1782222139.957126:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081774592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782222139.957187:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081774720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782222139.957297:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222139.957355:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f07474186c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782222139.957375:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081774720 00000100:00100000:0.0:1782222139.957380:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081774720 00000100:00100000:0.0:1782222139.957435:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1782222139.957444:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:6523:x1868795081774720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782222139.957562:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:6523:x1868795081774720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 118us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222139.957570:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1782222139.957616:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081774720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782222139.958953:0:13801:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474fca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:13801:1868795081774848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782222139.959020:0:13801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222139.959056:0:13801:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746166000 going to sleep for 11 seconds 00000100:00100000:0.0:1782222139.959115:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081774848 00000100:00100000:0.0:1782222139.959122:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081774848 00000100:00100000:0.0:1782222139.959162:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1782222139.959170:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0850980850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:13801:x1868795081774848:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782222139.959324:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0850980850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:13801:x1868795081774848:12345-0@lo:502:llog_process_th.0 Request processed in 154us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222139.959331:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1782222139.959673:0:13801:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474fca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:13801:1868795081774848:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782222139.959711:0:13801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782222139.959721:0:13801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782222139.959724:0:13801:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1782222139.959733:0:13801:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f08815e6800 00000020:00000080:2.0:1782222139.959736:0:13801:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1782222139.959794:0:13801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782222139.959797:0:13801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782222139.959798:0:13801:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1782222139.959801:0:13801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782222139.959804:0:13801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782222139.959805:0:13801:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1782222139.959808:0:13801:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f08815e6800 00000020:00000080:2.0:1782222139.959810:0:13801:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1782222139.959842:0:13801:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747649180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:13801:1868795081774976:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782222139.959882:0:13801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222139.959902:0:13801:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875bfc900 going to sleep for 11 seconds 00000100:00100000:0.0:1782222139.961694:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081774976 00000100:00100000:0.0:1782222139.961717:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081774976 00000100:00100000:0.0:1782222139.961775:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1782222139.961786:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0850980050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:13801:x1868795081774976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782222139.961953:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0850980050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:13801:x1868795081774976:12345-0@lo:502:llog_process_th.0 Request processed in 169us (2070us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222139.961966:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1782222139.962139:0:13801:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747649180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:13801:1868795081774976:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782222139.962174:0:13801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782222139.962181:0:13801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782222139.962183:0:13801:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1782222139.962188:0:13801:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1782222139.962691:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1782222139.962760:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782222139.962770:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f074744c600/0xe2b7cc26e68114f5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68114fc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222139.962782:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f074744c600/0xe2b7cc26e68114f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68114fc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782222139.962881:0:6523:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782222139.962885:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f087fb98800 from 7 10000000:01000000:0.0:1782222139.962888:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782222139.962926:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e6811503 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222139.962935:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e6811503 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222139.962945:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e6811503 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222139.962969:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081775104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782222139.963019:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222139.964534:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747418b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782222139.970944:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081775104 00000100:00100000:2.0:1782222139.970961:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081775104 00000100:00100000:2.0:1782222139.971015:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1782222139.971025:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0850982c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:6523:x1868795081775104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782222139.971044:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222139.971063:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f087fb82400/0xe2b7cc26e681150a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6811503 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222139.971105:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fb82400/0xe2b7cc26e681150a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6811503 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222139.971118:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f087fb82400/0xe2b7cc26e681150a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6811503 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222139.971127:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb82400, rc 0) 00000100:00100000:2.0:1782222139.971232:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0850982c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:6523:x1868795081775104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 208us (8212us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222139.971258:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1782222139.973448:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081775104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782222139.973475:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e6811503 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681150a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222139.973488:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e6811503 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e681150a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222139.973582:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087701aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081775232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782222139.973640:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222139.973673:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074725d240 going to sleep for 11 seconds 00000100:00100000:0.0:1782222139.974433:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081775232 00000100:00100000:0.0:1782222139.974442:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081775232 00000100:00100000:0.0:1782222139.974493:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1782222139.974513:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0850981050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:6523:x1868795081775232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782222139.974647:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0850981050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:6523:x1868795081775232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 146us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222139.974661:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1782222139.974697:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087701aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081775232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782222139.974733:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081775360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782222139.974774:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222139.974796:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747418780 going to sleep for 11 seconds 00000100:00100000:0.0:1782222139.974810:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081775360 00000100:00100000:0.0:1782222139.974813:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081775360 00000100:00100000:0.0:1782222139.974832:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1782222139.974837:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085541c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:6523:x1868795081775360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782222139.974908:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085541c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:6523:x1868795081775360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222139.974914:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1782222139.974953:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081775360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782222139.977763:0:13804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:13804:1868795081775488:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782222139.977843:0:13804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222139.977894:0:13804:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747418480 going to sleep for 11 seconds 00000100:00100000:1.0:1782222139.977959:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081775488 00000100:00100000:1.0:1782222139.977971:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081775488 00000100:00100000:1.0:1782222139.978019:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1782222139.978029:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085541e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:13804:x1868795081775488:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782222139.978156:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085541e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:13804:x1868795081775488:12345-0@lo:502:llog_process_th.0 Request processed in 128us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222139.978164:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1782222139.978369:0:13804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:13804:1868795081775488:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782222139.978575:0:13804:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782222139.978585:0:13804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782222139.978588:0:13804:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1782222139.978598:0:13804:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f087fb98800 00000020:00000080:2.0:1782222139.978601:0:13804:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1782222139.978663:0:13804:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782222139.978667:0:13804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782222139.978668:0:13804:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1782222139.978671:0:13804:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782222139.978673:0:13804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782222139.978674:0:13804:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1782222139.978677:0:13804:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f087fb98800 00000020:00000080:2.0:1782222139.978679:0:13804:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1782222139.978714:0:13804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747648700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:13804:1868795081775616:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782222139.978756:0:13804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222139.980294:0:13804:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875bfc900 going to sleep for 11 seconds 00000100:00100000:0.0:1782222139.981265:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081775616 00000100:00100000:0.0:1782222139.981275:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081775616 00000100:00100000:0.0:1782222139.981328:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1782222139.981336:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085541d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:13804:x1868795081775616:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782222139.982125:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085541d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:13804:x1868795081775616:12345-0@lo:502:llog_process_th.0 Request processed in 786us (3365us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222139.982135:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1782222139.982259:0:13804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747648700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:13804:1868795081775616:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782222139.982305:0:13804:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782222139.982315:0:13804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782222139.982318:0:13804:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1782222139.982326:0:13804:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1782222139.982669:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1782222139.982705:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782222139.982716:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e6811503 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681150a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222139.982727:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e6811503 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681150a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782222139.982738:0:6523:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782222139.982740:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f0849b46800 from 7 10000000:01000000:0.0:1782222139.982743:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782222139.982779:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e6811511 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222139.982787:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e6811511 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222139.983226:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e6811511 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222139.983276:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081775744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782222139.983332:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222139.983495:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081775744 00000100:00100000:2.0:1782222139.983503:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081775744 00000100:00100000:2.0:1782222139.983555:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1782222139.983564:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085541f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:6523:x1868795081775744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782222139.983576:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222139.983588:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f087fb82e00/0xe2b7cc26e6811518 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6811511 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222139.983611:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fb82e00/0xe2b7cc26e6811518 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6811511 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222139.983621:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f087fb82e00/0xe2b7cc26e6811518 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6811511 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222139.983630:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb82e00, rc 0) 00000100:00100000:2.0:1782222139.983661:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085541f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:6523:x1868795081775744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222139.983667:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1782222139.983779:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08490ed540 going to sleep for 11 seconds 00000100:00100000:0.0:1782222139.983798:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081775744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782222139.983811:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e6811511 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811518 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222139.983819:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e6811511 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6811518 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222139.983873:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081775872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782222139.983906:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222139.983934:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08490ed540 going to sleep for 11 seconds 00000100:00100000:1.0:1782222139.983987:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081775872 00000100:00100000:1.0:1782222139.983992:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081775872 00000100:00100000:1.0:1782222139.984022:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1782222139.984028:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:6523:x1868795081775872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782222139.984138:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:6523:x1868795081775872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222139.984144:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1782222139.985413:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081775872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782222139.985461:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081776000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782222139.985519:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222139.985557:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08490ed540 going to sleep for 11 seconds 00000100:00100000:1.0:1782222139.985648:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081776000 00000100:00100000:1.0:1782222139.985654:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081776000 00000100:00100000:1.0:1782222139.985698:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1782222139.985706:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:6523:x1868795081776000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782222139.985814:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:6523:x1868795081776000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222139.985822:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1782222139.985895:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081776000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782222139.986588:0:13805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087701ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:13805:1868795081776128:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782222139.986633:0:13805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222139.986660:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081776128 00000100:00100000:3.0:1782222139.986663:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081776128 00000100:00100000:3.0:1782222139.986688:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1782222139.986694:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:13805:x1868795081776128:12345-0@lo:502:llog_process_th.0 00000040:00080000:2.0:1782222139.986810:0:13806:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1782222139.986906:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:13805:x1868795081776128:12345-0@lo:502:llog_process_th.0 Request processed in 212us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222139.986913:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1782222139.986947:0:13805:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074725d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782222139.986963:0:13805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087701ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:13805:1868795081776128:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782222139.986985:0:13805:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782222139.986993:0:13805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782222139.986996:0:13805:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1782222139.987003:0:13805:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f0849b46800 00000020:00000080:3.0:1782222139.987005:0:13805:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1782222139.987064:0:13805:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782222139.987068:0:13805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782222139.987069:0:13805:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1782222139.987071:0:13805:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782222139.987074:0:13805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782222139.987075:0:13805:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1782222139.987078:0:13805:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f0849b46800 00000020:00000080:3.0:1782222139.987085:0:13805:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1782222139.987116:0:13805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087701ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:13805:1868795081776256:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782222139.987148:0:13805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222139.987166:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081776256 00000100:00100000:3.0:1782222139.987170:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081776256 00000100:00100000:3.0:1782222139.987202:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1782222139.987209:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:13805:x1868795081776256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782222139.987283:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:13805:x1868795081776256:12345-0@lo:502:llog_process_th.0 Request processed in 74us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222139.987288:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1782222139.987322:0:13805:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074725d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782222139.987332:0:13805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087701ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:13805:1868795081776256:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782222139.987359:0:13805:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782222139.987363:0:13805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782222139.987364:0:13805:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1782222139.987367:0:13805:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1782222139.987672:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1782222139.987692:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782222139.987768:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e6811511 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811518 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222139.987779:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e6811511 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811518 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782222139.987789:0:6523:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782222139.987792:0:6523:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f08490d0000 from 7 10000000:01000000:3.0:1782222139.987795:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782222139.987818:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f08413d3400/0xe2b7cc26e681151f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222139.987837:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f08413d3400/0xe2b7cc26e681151f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222139.987845:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f08413d3400/0xe2b7cc26e681151f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222139.987859:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087701ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081776384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782222139.987889:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222139.987907:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074725d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782222139.987920:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081776384 00000100:00100000:3.0:1782222139.987923:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081776384 00000100:00100000:3.0:1782222139.987944:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1782222139.987950:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:6523:x1868795081776384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782222139.987959:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222139.987970:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f08413d3c00/0xe2b7cc26e6811526 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e681151f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222139.987988:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f08413d3c00/0xe2b7cc26e6811526 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e681151f expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222139.987998:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f08413d3c00/0xe2b7cc26e6811526 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e681151f expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222139.988006:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f08413d3c00, rc 0) 00000100:00100000:3.0:1782222139.988032:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:6523:x1868795081776384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222139.988038:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1782222139.988073:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087701ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081776384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782222139.988084:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f08413d3400/0xe2b7cc26e681151f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811526 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222139.988647:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f08413d3400/0xe2b7cc26e681151f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6811526 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222139.988799:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087701ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081776512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782222139.988832:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222139.988847:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074725d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782222139.988863:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081776512 00000100:00100000:3.0:1782222139.988867:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081776512 00000100:00100000:3.0:1782222139.988889:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1782222139.988894:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:6523:x1868795081776512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782222139.989001:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:6523:x1868795081776512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222139.989009:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1782222139.989040:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087701ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081776512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782222139.989066:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087701ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081776640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782222139.989116:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222139.989130:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074725d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782222139.989141:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081776640 00000100:00100000:3.0:1782222139.989145:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081776640 00000100:00100000:3.0:1782222139.989162:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1782222139.989167:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:6523:x1868795081776640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782222139.989269:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:6523:x1868795081776640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222139.989281:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1782222139.989319:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087701ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:6523:1868795081776640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782222139.989577:0:13807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087701ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:13807:1868795081776768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782222139.989612:0:13807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222139.989631:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081776768 00000100:00100000:3.0:1782222139.989634:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081776768 00000100:00100000:3.0:1782222139.989656:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1782222139.989661:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:13807:x1868795081776768:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782222139.989735:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:13807:x1868795081776768:12345-0@lo:502:llog_process_th.0 Request processed in 73us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222139.989742:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1782222139.989769:0:13807:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074725da80 going to sleep for 11 seconds 00000100:00100000:3.0:1782222139.989781:0:13807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087701ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:13807:1868795081776768:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782222139.989801:0:13807:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782222139.989810:0:13807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782222139.989812:0:13807:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1782222139.989819:0:13807:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f08490d0000 00000020:00000080:3.0:1782222139.989822:0:13807:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1782222139.989866:0:13807:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782222139.989869:0:13807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782222139.989870:0:13807:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1782222139.989872:0:13807:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782222139.989875:0:13807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782222139.989876:0:13807:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1782222139.989879:0:13807:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f08490d0000 00000020:00000080:3.0:1782222139.989881:0:13807:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1782222139.989915:0:13807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087701ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:13807:1868795081776896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782222139.989946:0:13807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222139.989964:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081776896 00000100:00100000:3.0:1782222139.989968:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081776896 00000100:00100000:3.0:1782222139.989988:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1782222139.989994:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:13807:x1868795081776896:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782222139.990052:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:13807:x1868795081776896:12345-0@lo:502:llog_process_th.0 Request processed in 57us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222139.990059:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1782222139.990088:0:13807:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074725da80 going to sleep for 11 seconds 00000100:00100000:3.0:1782222139.990100:0:13807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087701ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:13807:1868795081776896:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782222139.990118:0:13807:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782222139.990122:0:13807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782222139.990123:0:13807:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1782222139.990126:0:13807:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1782222139.990185:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1782222139.990217:0:6523:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782222139.990227:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f08413d3400/0xe2b7cc26e681151f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811526 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222139.990260:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f08413d3400/0xe2b7cc26e681151f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811526 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782222140.023314:0:13809:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1782222140.394758:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081777152:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782222140.394903:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222140.394977:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087701ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081777024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782222140.395070:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222140.404462:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081777152 00000100:00100000:2.0:1782222140.404477:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081777152 00000100:00100000:2.0:1782222140.404578:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081777024 00000100:00100000:2.0:1782222140.404595:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081777024 00000100:00100000:2.0:1782222140.404622:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1782222140.404631:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081777152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782222140.404666:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782222140.404736:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081777152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (9832us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222140.404742:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1782222140.404759:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1782222140.404771:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081777024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782222140.404784:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1782222140.405009:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1782222140.408420:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747648700 x1868795081777152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222156 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222140.408449:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081777152:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782222140.408932:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081777024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4163us (13858us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222140.408944:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:3.0:1782222140.410306:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f087701ad80 x1868795081777024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222156 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222140.410331:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087701ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081777024:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782222140.970564:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782222141.035524:0:13806:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1782222141.035929:0:13809:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1782222141.422412:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782222141.422449:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087701ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081777280:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782222141.423009:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222141.423376:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081777280 00000100:00100000:2.0:1782222141.423385:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081777280 00000100:00100000:2.0:1782222141.423446:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1782222141.423454:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081777280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782222141.423501:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1782222141.423561:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081777280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222141.423569:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1782222141.424876:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087701ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081777280:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782222141.426734:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782222141.426756:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081777408:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782222141.426819:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222141.426932:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081777408 00000100:00100000:0.0:1782222141.426940:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081777408 00000100:00100000:0.0:1782222141.426993:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1782222141.427003:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087701ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081777408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782222141.427046:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1782222141.427102:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087701ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081777408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222141.427109:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1782222141.427301:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081777408:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782222141.930564:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087701aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081777536:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782222141.930642:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222141.931005:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081777536 00000100:00100000:3.0:1782222141.931015:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081777536 00000100:00100000:2.0:1782222141.931192:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782222141.931203:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081777664:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782222141.931263:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782222141.931346:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782222141.932333:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081777664 00000100:00100000:3.0:1782222141.932342:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081777664 00000100:00100000:3.0:1782222141.932404:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1782222141.932414:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081777536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782222141.932447:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222141.932507:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081777536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (1864us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222141.932524:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1782222141.932541:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1782222141.932546:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074764b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3654:x1868795081777664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782222141.932556:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222141.932580:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074764b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3654:x1868795081777664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (1318us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222141.932586:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1782222141.932647:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087701aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081777536:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782222141.933034:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081777664:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782222141.933070:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782222141.994579:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222142.375930:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222142.376015:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222142.376049:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222142.376079:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222142.376099:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222142.376117:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222142.376142:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060712448 00000100:00100000:2.0:1782222142.376151:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060712448 00000100:00100000:2.0:1782222142.376206:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060712576 00000100:00100000:2.0:1782222142.376209:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060712576 00000100:00100000:2.0:1782222142.376219:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060712960 00000100:00100000:2.0:1782222142.376221:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060712960 00000100:00100000:2.0:1782222142.376230:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060712832 00000100:00100000:2.0:1782222142.376232:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060712832 00000100:00100000:2.0:1782222142.376275:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 244 00000100:00100000:2.0:1782222142.376283:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+5:2388:x1868795060712448:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222142.376362:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+5:2388:x1868795060712448:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 79us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222142.376370:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 244 00000100:00100000:0.0:1782222142.376526:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060712704 00000100:00100000:0.0:1782222142.376531:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060712704 00000100:00100000:0.0:1782222142.376563:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 116 00000100:00100000:0.0:1782222142.376570:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+5:2388:x1868795060712704:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222142.376599:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+5:2388:x1868795060712704:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 30us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222142.376606:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 116 00000100:00080000:0.0:1782222142.376724:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782222142.376736:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782222142.376738:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782222142.376859:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 245 00000100:00100000:2.0:1782222142.376868:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+5:2387:x1868795060712576:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222142.376906:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+5:2387:x1868795060712576:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 40us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222142.376913:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 245 00000100:00100000:2.0:1782222142.376925:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 246 00000100:00100000:2.0:1782222142.376930:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074764b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2388:x1868795060712960:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222142.376958:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074764b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2388:x1868795060712960:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 28us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222142.376964:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 246 00000100:00100000:2.0:1782222142.376972:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 247 00000100:00100000:2.0:1782222142.376978:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074764a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2387:x1868795060712832:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222142.376994:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074764a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2387:x1868795060712832:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 16us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222142.376999:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 247 00000100:00100000:3.0:1782222142.377391:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060712320 00000100:00100000:3.0:1782222142.377398:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060712320 00000100:00100000:3.0:1782222142.377438:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 374 00000100:00100000:3.0:1782222142.377445:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2387:x1868795060712320:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222142.377491:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2387:x1868795060712320:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 46us (1572us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222142.377498:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 374 00000100:00100000:3.0:1782222142.954955:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081778048:0@lo:400:kworker.0 00000100:00100000:1.0:1782222142.955002:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087701b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1868795081777920:0@lo:400:kworker.0 00000100:00100000:3.0:1782222142.955030:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222142.955047:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222142.955083:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1868795081778560:0@lo:400:kworker.0 00000100:00100000:3.0:1782222142.955108:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222142.955118:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081778176:0@lo:400:kworker.0 00000100:00100000:3.0:1782222142.955127:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1868795081779072:0@lo:400:kworker.0 00000100:00100000:0.0:1782222142.955156:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222142.955168:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222142.955194:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081778688:0@lo:400:kworker.0 00000100:00100000:3.0:1782222142.955222:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081777920 00000100:00100000:0.0:1782222142.955225:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222142.955230:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081777920 00000100:00100000:0.0:1782222142.955278:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081779200:0@lo:400:kworker.0 00000100:00100000:0.0:1782222142.955304:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222142.955311:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081778560 00000100:00100000:3.0:1782222142.955316:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081778560 00000100:00100000:0.0:1782222142.955329:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1782222142.955337:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087701aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081777792:0@lo:400:kworker.0 00000100:00100000:3.0:1782222142.955344:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081779072 00000100:00100000:3.0:1782222142.955349:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081779072 00000100:00100000:0.0:1782222142.955371:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222142.955374:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1782222142.955384:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1868795081777920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222142.955402:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1868795081778304:0@lo:400:kworker.0 00000100:00100000:3.0:1782222142.955441:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1868795081777920:12345-0@lo:400:kworker.0 Request processed in 57us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222142.955449:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1782222142.955454:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222142.955468:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081778304 00000100:00100000:0.0:1782222142.955471:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081778816:0@lo:400:kworker.0 00000100:00100000:3.0:1782222142.955473:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081778304 00000100:00100000:3.0:1782222142.955496:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1782222142.955502:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222142.955521:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081779328:0@lo:400:kworker.0 00000100:00100000:3.0:1782222142.955531:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074751f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1868795081778560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222142.955545:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222142.955579:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074751f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1868795081778560:12345-0@lo:400:kworker.0 Request processed in 63us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222142.955581:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081777792 00000100:00100000:0.0:1782222142.955586:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081777792 00000100:00100000:3.0:1782222142.955590:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1782222142.955622:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1782222142.955629:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f085fdd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3653:x1868795081777792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222142.955666:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f085fdd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3653:x1868795081777792:12345-0@lo:400:kworker.0 Request processed in 37us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222142.955672:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1782222142.955699:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081778688 00000100:00100000:0.0:1782222142.955703:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081778688 00000100:00100000:0.0:1782222142.955728:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081779200 00000100:00100000:0.0:1782222142.955732:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081779200 00000100:00100000:0.0:1782222142.955746:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081778816 00000100:00100000:0.0:1782222142.955749:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081778816 00000100:00100000:0.0:1782222142.955763:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081779328 00000100:00100000:0.0:1782222142.955766:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081779328 00000100:00100000:2.0:1782222142.955785:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1782222142.955786:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1782222142.955799:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081778688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222142.955803:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1868795081779072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222142.956025:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1782222142.956034:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1868795081778304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222142.956116:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081778688:12345-0@lo:400:kworker.0 Request processed in 320us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222142.956123:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1782222142.956136:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1782222142.956143:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081779200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222142.956184:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081779200:12345-0@lo:400:kworker.0 Request processed in 42us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222142.956191:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1782222142.956201:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1782222142.956208:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3653:x1868795081778816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222142.956254:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3653:x1868795081778816:12345-0@lo:400:kworker.0 Request processed in 26us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222142.956261:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1782222142.956272:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1782222142.956278:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081779328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222142.956302:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081779328:12345-0@lo:400:kworker.0 Request processed in 25us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222142.956308:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1782222142.956324:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081778048 00000100:00100000:0.0:1782222142.956334:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081778048 00000100:00100000:0.0:1782222142.956362:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081778176 00000100:00100000:0.0:1782222142.956365:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081778176 00000100:00100000:0.0:1782222142.956377:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1782222142.956383:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074751ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081778048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222142.956419:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074751ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081778048:12345-0@lo:400:kworker.0 Request processed in 37us (1391us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222142.956425:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1782222142.957334:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1782222142.957347:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081778176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222142.957397:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081778176:12345-0@lo:400:kworker.0 Request processed in 54us (2241us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222142.957404:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1782222142.957902:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087701aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081777792:0@lo:400:kworker.0 00000100:00100000:0.0:1782222142.957920:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081778816:0@lo:400:kworker.0 00010000:00080000:0.0:1782222142.957934:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074751c700 x1868795081779328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222142.957944:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081779328:0@lo:400:kworker.0 00000100:00100000:0.0:1782222142.957954:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081778176:0@lo:400:kworker.0 00000100:00100000:0.0:1782222142.957964:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081778688:0@lo:400:kworker.0 00010000:00080000:0.0:1782222142.957974:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074751df80 x1868795081779200/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222142.957982:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081779200:0@lo:400:kworker.0 00000100:00080000:0.0:1782222142.958082:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782222142.958100:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782222142.958124:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081778048:0@lo:400:kworker.0 00010000:00080000:0.0:1782222142.958138:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0849b14e00 x1868795081778560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222142.958147:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1868795081778560:0@lo:400:kworker.0 00000100:00100000:1.0:1782222142.958960:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087701b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1868795081777920:0@lo:400:kworker.0 00000100:00100000:1.0:1782222142.958976:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1868795081778432:0@lo:400:kworker.0 00000100:00100000:1.0:1782222142.959035:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222142.959063:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074751ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1868795081778944:0@lo:400:kworker.0 00000100:00100000:1.0:1782222142.959087:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222142.959131:0:6527:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1782222142.959139:0:6527:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1782222142.959160:0:6526:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1782222142.959168:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081778432 00000100:00100000:1.0:1782222142.959183:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081778432 00000100:00100000:1.0:1782222142.959224:0:6526:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1782222142.959255:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081778944 00000100:00100000:1.0:1782222142.959258:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081778944 00000100:00100000:1.0:1782222142.959274:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1782222142.959280:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1868795081778432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222142.959333:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1868795081778432:12345-0@lo:400:kworker.0 Request processed in 52us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222142.959340:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1782222142.959356:0:6526:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1782222142.959361:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1782222142.959367:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1868795081778944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222142.959392:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1868795081778944:12345-0@lo:400:kworker.0 Request processed in 26us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222142.959398:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1782222142.959423:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1868795081778432:0@lo:400:kworker.0 00000100:00100000:2.0:1782222142.959709:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1868795081779072:12345-0@lo:400:kworker.0 Request processed in 3910us (4539us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222142.959717:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00010000:00080000:2.0:1782222142.959757:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074751c380 x1868795081779072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222142.959770:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1868795081779072:0@lo:400:kworker.0 00000100:00080000:2.0:1782222142.960805:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782222142.961756:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074751ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1868795081778944:0@lo:400:kworker.0 00000100:00100000:3.0:1782222142.967960:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1868795081778304:12345-0@lo:400:kworker.0 Request processed in 11916us (12495us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222142.967975:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1782222142.968603:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1868795081778304:0@lo:400:kworker.0 00010000:00010000:1.0:1782222143.018618:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782222143.998682:0:8436:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:1.0:1782222144.044676:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222145.066469:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222145.514630:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782222145.514724:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087719aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081779456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782222145.516387:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782222145.516413:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074764b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081779584:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782222145.516505:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222145.517043:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081779584 00000100:00100000:3.0:1782222145.517051:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081779584 00000100:00100000:3.0:1782222145.517125:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1782222145.517144:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747716d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081779584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782222145.517200:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222145.517288:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747716d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081779584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 154us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222145.517295:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:3.0:1782222145.517334:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074764b480 x1868795081779584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222161 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222145.517354:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074764b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081779584:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1782222145.517435:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782222145.520976:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222145.521214:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081779456 00000100:00100000:2.0:1782222145.521223:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081779456 00000100:00100000:2.0:1782222145.521331:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1782222145.521341:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081779456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782222145.521388:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782222145.521451:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081779456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222145.521466:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:0.0:1782222145.521533:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1782222145.521586:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f087719aa00 x1868795081779456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222161 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222145.521815:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087719aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081779456:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782222146.091223:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222146.539173:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782222146.539196:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081779712:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782222146.541617:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222146.541933:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081779840:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782222146.542164:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081779712 00000100:00100000:1.0:1782222146.542172:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081779712 00000100:00100000:1.0:1782222146.542255:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1782222146.542266:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074764aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081779712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782222146.542325:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1782222146.542374:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074764aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081779712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222146.542381:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1782222146.542917:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222146.542972:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081779712:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782222146.543295:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081779840 00000100:00100000:1.0:1782222146.543300:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081779840 00000100:00100000:1.0:1782222146.543337:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1782222146.543344:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074764b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081779840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782222146.543365:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1782222146.543409:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074764b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081779840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222146.543416:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1782222146.543836:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081779840:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782222147.051207:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782222147.051270:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081779968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782222147.051371:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222147.051540:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081779968 00000100:00100000:2.0:1782222147.051548:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081779968 00000100:00100000:2.0:1782222147.051615:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1782222147.051626:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b787100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081779968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782222147.051657:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782222147.051706:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b787100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081779968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222147.051712:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1782222147.051750:0:3656:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1782222147.051756:0:3656:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f087701b800, transno 4294967301 00000100:00100000:2.0:1782222147.051773:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081779968:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782222147.051840:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782222147.053024:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782222147.053040:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081780096:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782222147.053100:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222147.053169:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081780096 00000100:00100000:3.0:1782222147.053175:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081780096 00000100:00100000:3.0:1782222147.053295:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1782222147.053304:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081780096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782222147.053322:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222147.053388:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081780096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222147.053395:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1782222147.053447:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081780096:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1782222147.053643:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782222147.115035:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222147.497112:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222147.497177:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222147.497214:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222147.497281:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222147.497313:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222147.497342:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222147.497370:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060713216 00000100:00100000:0.0:1782222147.497381:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060713216 00000100:00100000:0.0:1782222147.497459:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060713344 00000100:00100000:0.0:1782222147.497463:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060713344 00000100:00100000:0.0:1782222147.497476:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060713728 00000100:00100000:0.0:1782222147.497491:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060713728 00000100:00100000:0.0:1782222147.497507:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060713600 00000100:00100000:0.0:1782222147.497510:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060713600 00000100:00100000:0.0:1782222147.497524:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 254 00000100:00100000:0.0:1782222147.497533:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+5:2389:x1868795060713216:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222147.497607:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+5:2389:x1868795060713216:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 74us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222147.497615:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 254 00000100:00100000:0.0:1782222147.497632:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 255 00000100:00100000:0.0:1782222147.497638:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060713344:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222147.497665:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060713344:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 27us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222147.497671:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 255 00000100:00100000:0.0:1782222147.497682:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 256 00000100:00100000:0.0:1782222147.497688:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2389:x1868795060713728:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222147.497730:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2389:x1868795060713728:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 41us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222147.497736:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 256 00000100:00100000:0.0:1782222147.497748:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 257 00000100:00100000:0.0:1782222147.497755:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074751ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2390:x1868795060713600:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222147.497777:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074751ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2390:x1868795060713600:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 23us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222147.497783:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 257 00000100:00100000:2.0:1782222147.498056:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060713088 00000100:00100000:2.0:1782222147.498062:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060713088 00000100:00100000:2.0:1782222147.498095:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 376 00000100:00100000:2.0:1782222147.498102:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2390:x1868795060713088:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222147.498130:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2390:x1868795060713088:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 29us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222147.498153:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 376 00000100:00080000:2.0:1782222147.498214:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782222147.498218:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782222147.498575:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060713472 00000100:00100000:3.0:1782222147.498581:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060713472 00000100:00100000:3.0:1782222147.498630:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 121 00000100:00100000:3.0:1782222147.498638:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+5:2389:x1868795060713472:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222147.498670:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+5:2389:x1868795060713472:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 32us (1455us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222147.498676:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 121 00000100:00080000:2.0:1782222147.498807:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782222148.074688:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081780608:0@lo:400:kworker.0 00000100:00100000:1.0:1782222148.074771:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222148.074831:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081781120:0@lo:400:kworker.0 00000100:00100000:1.0:1782222148.074854:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222148.074876:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081781632:0@lo:400:kworker.0 00000100:00100000:1.0:1782222148.074897:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222148.074927:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1782222148.074933:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081780480:0@lo:400:kworker.0 00000100:00100000:1.0:1782222148.074954:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222148.074972:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1868795081780992:0@lo:400:kworker.0 00000100:00100000:1.0:1782222148.074995:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222148.075118:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081780608 00000100:00100000:3.0:1782222148.075128:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081780608 00000100:00100000:3.0:1782222148.075192:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081780480 00000100:00100000:3.0:1782222148.075196:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081780480 00000100:00100000:3.0:1782222148.075212:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1782222148.075219:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081780608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222148.075307:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081780608:12345-0@lo:400:kworker.0 Request processed in 87us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222148.075315:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1782222148.075332:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1782222148.075338:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081780480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222148.075366:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081780480:12345-0@lo:400:kworker.0 Request processed in 29us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222148.075371:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1782222148.076170:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1868795081781504:0@lo:400:kworker.0 00000100:00100000:1.0:1782222148.076210:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222148.076987:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081780608:0@lo:400:kworker.0 00000100:00100000:1.0:1782222148.077110:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081780480:0@lo:400:kworker.0 00000100:00100000:2.0:1782222148.077774:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1868795081780352:0@lo:400:kworker.0 00000100:00100000:2.0:1782222148.077832:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222148.077897:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b785880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081780224:0@lo:400:kworker.0 00000100:00100000:0.0:1782222148.077949:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222148.077997:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1868795081780736:0@lo:400:kworker.0 00000100:00100000:0.0:1782222148.078036:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081781120 00000100:00100000:0.0:1782222148.078043:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081781120 00000100:00100000:0.0:1782222148.078085:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081781632 00000100:00100000:0.0:1782222148.078087:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081781632 00000100:00100000:0.0:1782222148.078110:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1782222148.078117:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081781120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222148.078178:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081781120:12345-0@lo:400:kworker.0 Request processed in 61us (3322us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222148.078184:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1782222148.078197:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1782222148.078202:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081781632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222148.078223:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081781632:12345-0@lo:400:kworker.0 Request processed in 21us (3325us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222148.078228:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1782222148.078324:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081780224 00000100:00100000:1.0:1782222148.078328:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081780224 00000100:00100000:1.0:1782222148.078355:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1782222148.078360:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3653:x1868795081780224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222148.078391:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3653:x1868795081780224:12345-0@lo:400:kworker.0 Request processed in 32us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222148.078397:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00080000:1.0:1782222148.078442:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782222148.078476:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081781120:0@lo:400:kworker.0 00010000:00080000:1.0:1782222148.078489:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474be680 x1868795081781632/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222148.078500:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081781632:0@lo:400:kworker.0 00000100:00100000:3.0:1782222148.082101:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081780992 00000100:00100000:3.0:1782222148.082118:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081780992 00000100:00100000:3.0:1782222148.082213:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081781504 00000100:00100000:3.0:1782222148.082232:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081781504 00000100:00100000:3.0:1782222148.082277:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081780352 00000100:00100000:3.0:1782222148.082280:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081780352 00000100:00100000:3.0:1782222148.082313:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1782222148.082322:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1868795081780992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222148.082417:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1868795081780992:12345-0@lo:400:kworker.0 Request processed in 96us (7420us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222148.082423:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1782222148.082437:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1782222148.082443:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1868795081781504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222148.082470:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1868795081781504:12345-0@lo:400:kworker.0 Request processed in 27us (6260us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222148.082476:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1782222148.082485:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1782222148.082492:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1868795081780352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222148.082517:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1868795081780352:12345-0@lo:400:kworker.0 Request processed in 27us (4685us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222148.082523:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00080000:3.0:1782222148.082549:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1782222148.082582:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0875aae300 x1868795081780992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222148.082596:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1868795081780992:0@lo:400:kworker.0 00010000:00080000:3.0:1782222148.082608:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474bf480 x1868795081781504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222148.082616:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1868795081781504:0@lo:400:kworker.0 00000100:00100000:1.0:1782222148.083265:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222148.083554:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081781248:0@lo:400:kworker.0 00000100:00100000:1.0:1782222148.083600:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222148.083639:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081781760:0@lo:400:kworker.0 00000100:00100000:1.0:1782222148.083678:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222148.083716:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b785880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081780224:0@lo:400:kworker.0 00000100:00100000:1.0:1782222148.083744:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081781248 00000100:00100000:1.0:1782222148.083748:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081781248 00000100:00100000:1.0:1782222148.083781:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081781760 00000100:00100000:1.0:1782222148.083784:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081781760 00000100:00100000:1.0:1782222148.083813:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1782222148.083820:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081781248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222148.083873:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081781248:12345-0@lo:400:kworker.0 Request processed in 54us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222148.083880:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1782222148.083897:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1782222148.083904:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081781760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222148.083930:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081781760:12345-0@lo:400:kworker.0 Request processed in 28us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222148.083936:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:1.0:1782222148.083959:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782222148.083978:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081781248:0@lo:400:kworker.0 00010000:00080000:1.0:1782222148.083989:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474bf100 x1868795081781760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222148.083997:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081781760:0@lo:400:kworker.0 00000100:00100000:3.0:1782222148.084461:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081780736 00000100:00100000:3.0:1782222148.084466:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081780736 00000100:00100000:3.0:1782222148.084539:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1782222148.084547:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1868795081780736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222148.084601:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1868795081780736:12345-0@lo:400:kworker.0 Request processed in 55us (1338us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222148.084607:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1782222148.084689:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1868795081780352:0@lo:400:kworker.0 00000100:00100000:2.0:1782222148.084697:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1868795081780864:0@lo:400:kworker.0 00000100:00100000:2.0:1782222148.084724:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222148.084775:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1868795081780736:0@lo:400:kworker.0 00000100:00100000:1.0:1782222148.087624:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081780864 00000100:00100000:1.0:1782222148.087848:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081780864 00000100:00080000:0.0:1782222148.087900:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782222148.087923:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1782222148.087955:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1868795081781376:0@lo:400:kworker.0 00000100:00100000:0.0:1782222148.088129:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1868795081780864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222148.088203:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1868795081780864:12345-0@lo:400:kworker.0 Request processed in 79us (3478us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222148.088253:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222148.088326:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1868795081780864:0@lo:400:kworker.0 00000100:00100000:2.0:1782222148.088349:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081781376 00000100:00100000:2.0:1782222148.088352:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081781376 00000100:00080000:2.0:1782222148.088368:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782222148.089564:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1782222148.090202:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1782222148.090221:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1868795081781376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222148.090379:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1868795081781376:12345-0@lo:400:kworker.0 Request processed in 166us (2143us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222148.090386:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1782222148.090474:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1868795081781376:0@lo:400:kworker.0 00010000:00010000:3.0:1782222148.138948:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222149.168414:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222150.186368:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222150.634617:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081782016:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782222150.634680:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782222150.634691:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222150.634713:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081781888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782222150.634754:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222150.634816:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081782016 00000100:00100000:1.0:1782222150.634824:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081782016 00000100:00100000:1.0:1782222150.634869:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081781888 00000100:00100000:1.0:1782222150.634873:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081781888 00000100:00100000:1.0:1782222150.634892:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1782222150.634900:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877199500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081782016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782222150.634928:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782222150.635270:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1782222150.635281:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081781888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782222150.635294:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782222150.635330:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081781888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222150.635336:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:2.0:1782222150.635360:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1782222150.635849:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0877199f80 x1868795081781888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222166 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222150.635949:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081781888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782222150.638979:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877199500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081782016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4068us (4278us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222150.638997:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:3.0:1782222150.639399:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0877154380 x1868795081782016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222166 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222150.639424:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081782016:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1782222151.210693:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782222151.274895:0:13806:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1782222151.276372:0:13809:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1782222151.659282:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081782144:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782222151.659356:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222151.659511:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081782144 00000100:00100000:3.0:1782222151.659519:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081782144 00000100:00100000:3.0:1782222151.659575:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1782222151.659584:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074751c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081782144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782222151.659632:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1782222151.659692:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074751c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081782144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222151.659699:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1782222151.659745:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081782144:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782222151.660337:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081782272:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782222151.660376:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222151.660470:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081782272 00000100:00100000:1.0:1782222151.660475:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081782272 00000100:00100000:1.0:1782222151.663043:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1782222151.663072:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074751df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081782272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782222151.663125:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1782222151.663471:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074751df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081782272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 411us (3092us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222151.663479:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1782222151.664070:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081782272:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782222152.170621:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782222152.170784:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782222152.170807:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081782528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782222152.170879:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222152.170959:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081782528 00000100:00100000:3.0:1782222152.170966:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081782528 00000100:00100000:3.0:1782222152.171019:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1782222152.171028:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877199f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081782528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782222152.171059:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222152.171115:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877199f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081782528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222152.171123:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1782222152.171178:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081782528:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782222152.171206:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782222152.172460:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081782400:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782222152.172522:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222152.172830:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081782400 00000100:00100000:3.0:1782222152.172838:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081782400 00000100:00100000:3.0:1782222152.172950:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1782222152.172959:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081782400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782222152.172981:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222152.173036:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081782400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222152.173044:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1782222152.173330:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081782400:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1782222152.181841:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782222152.236119:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222152.618899:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222152.619677:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060713856 00000100:00100000:2.0:1782222152.619694:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060713856 00000100:00100000:2.0:1782222152.619775:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 378 00000100:00100000:2.0:1782222152.619794:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2390:x1868795060713856:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222152.619907:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2390:x1868795060713856:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 122us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222152.619916:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 378 00000100:00100000:0.0:1782222152.622451:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222152.622737:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060713984 00000100:00100000:1.0:1782222152.622768:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060713984 00000100:00100000:1.0:1782222152.622863:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 264 00000100:00100000:1.0:1782222152.622879:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074751e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060713984:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222152.622993:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074751e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060713984:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 115us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222152.623001:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 264 00000100:00100000:0.0:1782222152.625192:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00080000:2.0:1782222152.625405:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782222152.626978:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060714240 00000100:00100000:1.0:1782222152.626996:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060714240 00000100:00100000:1.0:1782222152.627114:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 126 00000100:00100000:1.0:1782222152.627126:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074751c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77bf2c2c-f408-43f9-ae59-449550631d05+5:2389:x1868795060714240:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222152.627232:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074751c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77bf2c2c-f408-43f9-ae59-449550631d05+5:2389:x1868795060714240:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 108us (2054us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222152.627286:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 126 00000100:00080000:2.0:1782222152.627419:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782222152.628194:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222152.628231:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222152.628287:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222152.628418:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060714496 00000100:00100000:3.0:1782222152.628428:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060714496 00000100:00100000:3.0:1782222152.628490:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060714112 00000100:00100000:3.0:1782222152.628493:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060714112 00000100:00100000:3.0:1782222152.628510:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060714368 00000100:00100000:3.0:1782222152.628512:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060714368 00000100:00100000:3.0:1782222152.628548:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 265 00000100:00100000:3.0:1782222152.628566:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074751d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2389:x1868795060714496:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222152.628638:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074751d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2389:x1868795060714496:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 73us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222152.628645:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 265 00000100:00100000:3.0:1782222152.628659:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 266 00000100:00100000:3.0:1782222152.628665:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087701b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060714112:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222152.628685:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087701b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060714112:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 20us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222152.628691:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 266 00000100:00100000:3.0:1782222152.628699:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 267 00000100:00100000:3.0:1782222152.628704:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087701b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2390:x1868795060714368:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222152.628723:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087701b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2390:x1868795060714368:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 19us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222152.628730:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 267 00000100:00080000:3.0:1782222152.628746:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782222152.628749:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782222153.194745:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081782656:0@lo:400:kworker.0 00000100:00100000:3.0:1782222153.194871:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222153.195003:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081782656 00000100:00100000:1.0:1782222153.195015:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081782656 00000100:00100000:1.0:1782222153.195346:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1782222153.195361:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3656:x1868795081782656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222153.195554:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081782784:0@lo:400:kworker.0 00000100:00100000:0.0:1782222153.195612:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222153.195652:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782222153.195659:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081782912:0@lo:400:kworker.0 00000100:00100000:0.0:1782222153.195694:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222153.195732:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081782912 00000100:00100000:0.0:1782222153.195737:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081782912 00000100:00100000:0.0:1782222153.195772:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1782222153.195779:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087701aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081782912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222153.195836:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087701aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081782912:12345-0@lo:400:kworker.0 Request processed in 55us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222153.195844:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1782222153.195907:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081782912:0@lo:400:kworker.0 00000100:00100000:0.0:1782222153.195957:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0847003800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081783040:0@lo:400:kworker.0 00000100:00100000:0.0:1782222153.195989:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222153.196030:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081783040 00000100:00100000:0.0:1782222153.196034:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081783040 00000100:00100000:0.0:1782222153.196058:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1782222153.196064:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081783040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222153.196115:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081783040:12345-0@lo:400:kworker.0 Request processed in 50us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222153.196121:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1782222153.196145:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0847003800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081783040:0@lo:400:kworker.0 00000100:00100000:0.0:1782222153.196173:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081782784 00000100:00100000:0.0:1782222153.196177:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081782784 00000100:00100000:0.0:1782222153.196213:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1782222153.196220:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081782784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222153.196284:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081782784:12345-0@lo:400:kworker.0 Request processed in 64us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222153.196290:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1782222153.196316:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081782784:0@lo:400:kworker.0 00000100:00100000:2.0:1782222153.196657:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0847003480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1868795081783424:0@lo:400:kworker.0 00000100:00100000:2.0:1782222153.196695:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222153.196716:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0847002d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1868795081783936:0@lo:400:kworker.0 00000100:00100000:2.0:1782222153.196737:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222153.196756:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782222153.196762:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0847001500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1868795081783296:0@lo:400:kworker.0 00000100:00100000:2.0:1782222153.196783:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222153.196799:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0847002300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1868795081783808:0@lo:400:kworker.0 00000100:00100000:2.0:1782222153.196818:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222153.196840:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081783424 00000100:00100000:2.0:1782222153.196844:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081783424 00000100:00100000:2.0:1782222153.196884:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081783936 00000100:00100000:2.0:1782222153.196887:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081783936 00000100:00100000:2.0:1782222153.196901:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081783296 00000100:00100000:2.0:1782222153.196903:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081783296 00000100:00100000:2.0:1782222153.196914:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081783808 00000100:00100000:2.0:1782222153.196916:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081783808 00000100:00100000:2.0:1782222153.196931:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1782222153.196938:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847001f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1868795081783424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222153.196993:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847001f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1868795081783424:12345-0@lo:400:kworker.0 Request processed in 55us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222153.197001:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1782222153.197018:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1782222153.197024:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847003b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1868795081783936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222153.197050:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847003b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1868795081783936:12345-0@lo:400:kworker.0 Request processed in 27us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222153.197056:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1782222153.197067:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1782222153.197074:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847000a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1868795081783296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222153.197111:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847000a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1868795081783296:12345-0@lo:400:kworker.0 Request processed in 37us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222153.197116:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1782222153.197129:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1782222153.197134:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847000700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1868795081783808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222153.197160:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847000700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1868795081783808:12345-0@lo:400:kworker.0 Request processed in 26us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222153.197166:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1782222153.197202:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0847001500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1868795081783296:0@lo:400:kworker.0 00000100:00100000:2.0:1782222153.197211:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0847002300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1868795081783808:0@lo:400:kworker.0 00010000:00080000:2.0:1782222153.197225:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0847003480 x1868795081783424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222153.197267:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0847003480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1868795081783424:0@lo:400:kworker.0 00010000:00080000:2.0:1782222153.197290:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0847002d80 x1868795081783936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222153.197299:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0847002d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1868795081783936:0@lo:400:kworker.0 00000100:00080000:2.0:1782222153.197341:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782222153.197346:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782222153.197440:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3656:x1868795081782656:12345-0@lo:400:kworker.0 Request processed in 2080us (2567us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222153.197449:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1782222153.197668:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0847002680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081783552:0@lo:400:kworker.0 00000100:00100000:0.0:1782222153.197708:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222153.197749:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0847000e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081784064:0@lo:400:kworker.0 00000100:00100000:0.0:1782222153.197791:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222153.197824:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1782222153.197831:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0847000380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1868795081783168:0@lo:400:kworker.0 00000100:00100000:0.0:1782222153.197858:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222153.197879:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0847003100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081783680:0@lo:400:kworker.0 00000100:00100000:0.0:1782222153.197901:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222153.197921:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0847001880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081784192:0@lo:400:kworker.0 00000100:00100000:0.0:1782222153.197942:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222153.197972:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081783168 00000100:00100000:0.0:1782222153.197977:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081783168 00000100:00100000:0.0:1782222153.198014:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1782222153.198022:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1868795081783168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222153.198063:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1868795081783168:12345-0@lo:400:kworker.0 Request processed in 41us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222153.198069:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1782222153.198093:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081783552 00000100:00100000:0.0:1782222153.198108:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081783552 00000100:00100000:0.0:1782222153.198127:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081784064 00000100:00100000:0.0:1782222153.198129:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081784064 00000100:00100000:0.0:1782222153.198148:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081783680 00000100:00100000:0.0:1782222153.198150:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081783680 00000100:00100000:0.0:1782222153.198161:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081784192 00000100:00100000:0.0:1782222153.198163:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081784192 00000100:00100000:0.0:1782222153.198177:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1782222153.198183:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081783552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222153.198213:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081783552:12345-0@lo:400:kworker.0 Request processed in 31us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222153.198229:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1782222153.198271:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1782222153.198277:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847005180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081784064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222153.198309:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847005180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081784064:12345-0@lo:400:kworker.0 Request processed in 32us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222153.198315:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1782222153.198325:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1782222153.198331:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081783680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222153.198359:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081783680:12345-0@lo:400:kworker.0 Request processed in 28us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222153.198364:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1782222153.198375:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1782222153.198381:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847005500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081784192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222153.198406:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847005500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081784192:12345-0@lo:400:kworker.0 Request processed in 26us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222153.198412:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1782222153.198446:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0847000380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1868795081783168:0@lo:400:kworker.0 00000100:00100000:0.0:1782222153.198456:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0847003100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081783680:0@lo:400:kworker.0 00010000:00080000:0.0:1782222153.198467:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0847001880 x1868795081784192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222153.198477:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0847001880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081784192:0@lo:400:kworker.0 00000100:00100000:0.0:1782222153.198487:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0847002680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081783552:0@lo:400:kworker.0 00010000:00080000:0.0:1782222153.198499:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0847000e00 x1868795081784064/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222153.198515:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0847000e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081784064:0@lo:400:kworker.0 00000100:00080000:2.0:1782222153.198748:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782222153.198825:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081782656:0@lo:400:kworker.0 00010000:00010000:3.0:1782222153.260049:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222154.284010:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222155.310205:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222155.754515:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782222155.754548:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0847002d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081784320:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782222155.754643:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222155.754938:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081784320 00000100:00100000:3.0:1782222155.754948:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081784320 00000100:00100000:3.0:1782222155.755024:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1782222155.755052:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847003480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081784320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782222155.755111:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222155.755165:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847003480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081784320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 116us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222155.755173:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:2.0:1782222155.755441:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1782222155.755481:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0847002d80 x1868795081784320/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222171 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222155.755504:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0847002d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081784320:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782222155.755965:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081784448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782222155.756020:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222155.756092:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081784448 00000100:00100000:0.0:1782222155.756099:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081784448 00000100:00100000:0.0:1782222155.756159:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1782222155.756170:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847002d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081784448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782222155.756188:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782222155.756256:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847002d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081784448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222155.756264:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:2.0:1782222155.756349:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1782222155.756376:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0877198e00 x1868795081784448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222171 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222155.756393:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081784448:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782222156.330590:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782222156.778590:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782222156.778632:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081784576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782222156.778729:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222156.779892:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081784576 00000100:00100000:2.0:1782222156.779907:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081784576 00000100:00100000:0.0:1782222156.780128:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1782222156.780143:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081784576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782222156.780197:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1782222156.780342:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081784576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 202us (1612us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222156.780350:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1782222156.780540:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081784576:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782222156.780888:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081784704:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782222156.780935:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222156.781113:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081784704 00000100:00100000:2.0:1782222156.781119:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081784704 00000100:00100000:2.0:1782222156.781165:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1782222156.781175:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081784704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782222156.781225:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1782222156.781287:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081784704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222156.781294:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1782222156.781421:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081784704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782222157.292148:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087719aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081784832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782222157.292285:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222157.292410:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782222157.292418:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0847002300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081784960:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782222157.292448:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222157.292604:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081784832 00000100:00100000:2.0:1782222157.292616:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081784832 00000100:00100000:2.0:1782222157.292690:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081784960 00000100:00100000:2.0:1782222157.292694:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081784960 00000100:00100000:2.0:1782222157.292716:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1782222157.292726:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081784832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782222157.292769:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782222157.292828:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081784832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222157.292836:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1782222157.292856:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1782222157.292863:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081784960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782222157.292873:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782222157.292902:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081784960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222157.292909:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:1.0:1782222157.293688:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782222157.293757:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0847002300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081784960:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782222157.293777:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087719aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081784832:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782222157.354636:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222157.738589:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222157.738757:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222157.738795:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222157.738914:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060714880 00000100:00100000:3.0:1782222157.738928:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060714880 00000100:00100000:1.0:1782222157.739052:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060714752 00000100:00100000:1.0:1782222157.739058:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060714752 00000100:00100000:3.0:1782222157.739180:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 274 00000100:00100000:3.0:1782222157.739192:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:2387:x1868795060714880:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222157.739326:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:2387:x1868795060714880:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 136us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222157.739337:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 274 00000100:00080000:0.0:1782222157.746419:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782222157.746435:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782222157.750028:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060714624 00000100:00100000:2.0:1782222157.750049:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060714624 00000100:00100000:2.0:1782222157.750192:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 380 00000100:00100000:2.0:1782222157.750206:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2387:x1868795060714624:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222157.750364:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2387:x1868795060714624:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 160us (11788us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222157.750399:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 380 00000100:00100000:1.0:1782222157.751529:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 275 00000100:00100000:1.0:1782222157.751547:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847006680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+5:2387:x1868795060714752:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222157.751638:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847006680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+5:2387:x1868795060714752:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 96us (12840us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222157.751647:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 275 00000100:00100000:0.0:1782222157.757837:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222157.757942:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222157.758287:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060715008 00000100:00100000:1.0:1782222157.758300:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060715008 00000100:00100000:1.0:1782222157.758616:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 27 00000100:00100000:1.0:1782222157.758628:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847007100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77bf2c2c-f408-43f9-ae59-449550631d05+5:2386:x1868795060715008:12345-192.168.203.27@tcp:9:kworker.0 00000020:00000080:1.0:1782222157.758668:0:8443:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e681144d 00000100:00080000:1.0:1782222157.758678:0:8443:0:(import.c:65:import_set_state_nolock()) ffff8f0843cab000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782222157.758797:0:8443:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:1.0:1782222157.758992:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847007100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77bf2c2c-f408-43f9-ae59-449550631d05+2:2386:x1868795060715008:12345-192.168.203.27@tcp:9:kworker.0 Request processed in 366us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222157.759001:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 27 00010000:00010000:1.0:1782222157.759030:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222157.759948:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060715264 00000100:00100000:2.0:1782222157.759962:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060715264 00000100:00080000:0.0:1782222157.760013:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782222157.760020:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782222157.760035:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 276 00000100:00100000:2.0:1782222157.760048:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2387:x1868795060715264:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222157.760149:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2387:x1868795060715264:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 103us (2204us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222157.760158:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 276 00000100:00100000:0.0:1782222157.766313:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222157.767405:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060715136 00000100:00100000:3.0:1782222157.767424:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060715136 00000100:00100000:3.0:1782222157.767522:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 277 00000100:00100000:3.0:1782222157.767535:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847006d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2388:x1868795060715136:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222157.767661:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847006d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2388:x1868795060715136:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 128us (1372us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222157.767669:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 277 00000100:00080000:0.0:1782222157.770659:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782222158.315010:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0847007b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081785472:0@lo:400:kworker.0 00000100:00100000:0.0:1782222158.315120:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222158.315201:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0847005c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081785984:0@lo:400:kworker.0 00000100:00100000:0.0:1782222158.315276:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222158.315310:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08504cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081786496:0@lo:400:kworker.0 00000100:00100000:2.0:1782222158.315432:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081785472 00000100:00100000:2.0:1782222158.315442:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081785472 00000100:00100000:2.0:1782222158.315495:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1782222158.315504:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081785472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222158.315567:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081785472:12345-0@lo:400:kworker.0 Request processed in 63us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222158.315574:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1782222158.315919:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0847005880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1868795081785216:0@lo:400:kworker.0 00000100:00100000:3.0:1782222158.315961:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222158.315999:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0847004700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1868795081785728:0@lo:400:kworker.0 00000100:00100000:3.0:1782222158.316023:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222158.316047:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08504cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1868795081786240:0@lo:400:kworker.0 00000100:00100000:3.0:1782222158.316081:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222158.316105:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1782222158.316111:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0847004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081785088:0@lo:400:kworker.0 00000100:00100000:3.0:1782222158.316150:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222158.316172:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0847004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1868795081785600:0@lo:400:kworker.0 00000100:00100000:3.0:1782222158.316194:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222158.316209:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0847006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081786112:0@lo:400:kworker.0 00000100:00100000:3.0:1782222158.316231:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222158.316270:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08504c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081786624:0@lo:400:kworker.0 00000100:00100000:3.0:1782222158.316292:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222158.316322:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081785216 00000100:00100000:2.0:1782222158.316497:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081785728 00000100:00100000:2.0:1782222158.316504:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081785728 00000100:00100000:2.0:1782222158.316554:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081786240 00000100:00100000:2.0:1782222158.316557:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081786240 00000100:00100000:2.0:1782222158.316571:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081785600 00000100:00100000:2.0:1782222158.316574:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081785600 00000100:00100000:2.0:1782222158.316587:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1782222158.316594:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1868795081785728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222158.316642:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1868795081785728:12345-0@lo:400:kworker.0 Request processed in 48us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222158.316649:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1782222158.316677:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1782222158.316682:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1868795081786240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222158.316708:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1868795081786240:12345-0@lo:400:kworker.0 Request processed in 26us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222158.316714:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1782222158.316724:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1782222158.316728:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1868795081785600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222158.316748:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1868795081785600:12345-0@lo:400:kworker.0 Request processed in 20us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222158.316755:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1782222158.316786:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081785984 00000100:00100000:2.0:1782222158.316790:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081785984 00000100:00100000:2.0:1782222158.316811:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081786112 00000100:00100000:2.0:1782222158.316813:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081786112 00000100:00100000:2.0:1782222158.316822:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081786624 00000100:00100000:2.0:1782222158.316824:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081786624 00000100:00100000:2.0:1782222158.316836:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1782222158.316841:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081785984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222158.316870:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081785984:12345-0@lo:400:kworker.0 Request processed in 29us (1593us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222158.316875:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1782222158.316886:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1782222158.316891:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081786112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222158.316917:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081786112:12345-0@lo:400:kworker.0 Request processed in 26us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222158.316924:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1782222158.316934:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1782222158.316948:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081786624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222158.316978:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081786624:12345-0@lo:400:kworker.0 Request processed in 30us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222158.316984:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1782222158.317042:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0847004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1868795081785600:0@lo:400:kworker.0 00000100:00100000:2.0:1782222158.317054:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0847006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081786112:0@lo:400:kworker.0 00010000:00080000:2.0:1782222158.317082:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f08504c8e00 x1868795081786624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222158.317095:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08504c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081786624:0@lo:400:kworker.0 00000100:00100000:2.0:1782222158.317107:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0847004700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1868795081785728:0@lo:400:kworker.0 00000100:00100000:2.0:1782222158.317117:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08504cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1868795081786240:0@lo:400:kworker.0 00000100:00100000:1.0:1782222158.317625:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0847005f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081785344:0@lo:400:kworker.0 00000100:00100000:1.0:1782222158.317676:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222158.317722:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0847004000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1868795081785856:0@lo:400:kworker.0 00000100:00100000:1.0:1782222158.317748:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222158.317768:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08504ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1868795081786368:0@lo:400:kworker.0 00000100:00100000:1.0:1782222158.317791:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222158.317838:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081785344 00000100:00100000:1.0:1782222158.317844:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081785344 00000100:00100000:1.0:1782222158.317884:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1782222158.317892:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081785344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222158.317940:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081785344:12345-0@lo:400:kworker.0 Request processed in 48us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222158.317947:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1782222158.317974:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081785088 00000100:00100000:1.0:1782222158.317978:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081785088 00000100:00100000:1.0:1782222158.318017:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1782222158.318024:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3656:x1868795081785088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222158.318069:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3656:x1868795081785088:12345-0@lo:400:kworker.0 Request processed in 36us (1908us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222158.318076:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1782222158.318112:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081785856 00000100:00100000:1.0:1782222158.318116:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081785856 00000100:00100000:1.0:1782222158.318150:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081786368 00000100:00100000:1.0:1782222158.318153:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081786368 00000100:00100000:1.0:1782222158.318170:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1782222158.318176:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1868795081785856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222158.318220:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1868795081785856:12345-0@lo:400:kworker.0 Request processed in 30us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222158.318227:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1782222158.318278:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1782222158.318296:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1868795081786368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222158.318324:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1868795081786368:12345-0@lo:400:kworker.0 Request processed in 30us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222158.318330:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1782222158.318364:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0847005f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081785344:0@lo:400:kworker.0 00010000:00080000:1.0:1782222158.318376:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0847004000 x1868795081785856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222158.318387:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0847004000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1868795081785856:0@lo:400:kworker.0 00010000:00080000:1.0:1782222158.318395:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f08504ca300 x1868795081786368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222158.318402:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08504ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1868795081786368:0@lo:400:kworker.0 00000100:00080000:1.0:1782222158.318461:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782222158.318465:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782222158.318468:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782222158.318924:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081785216 00000100:00100000:3.0:1782222158.318981:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1782222158.318990:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087719aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1868795081785216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222158.319041:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087719aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1868795081785216:12345-0@lo:400:kworker.0 Request processed in 53us (3079us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222158.319047:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1782222158.319151:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222158.319215:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0847007b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081785472:0@lo:400:kworker.0 00000100:00100000:0.0:1782222158.319232:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0847005c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081785984:0@lo:400:kworker.0 00000100:00100000:3.0:1782222158.321185:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081786496 00000100:00100000:3.0:1782222158.321203:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081786496 00000100:00100000:3.0:1782222158.321339:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1782222158.321352:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081786496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222158.321487:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081786496:12345-0@lo:400:kworker.0 Request processed in 138us (2335us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222158.321496:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1782222158.322006:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0847004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081785088:0@lo:400:kworker.0 00000100:00100000:2.0:1782222158.322028:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0847005880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1868795081785216:0@lo:400:kworker.0 00000100:00080000:0.0:1782222158.322446:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1782222158.322488:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f08504cad80 x1868795081786496/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222158.322501:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08504cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081786496:0@lo:400:kworker.0 00010000:00010000:3.0:1782222158.383149:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222159.406729:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222160.427166:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222160.878001:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747503800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081786752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782222160.878093:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222160.878366:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081786752 00000100:00100000:3.0:1782222160.878375:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081786752 00000100:00100000:3.0:1782222160.878436:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1782222160.878445:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081786752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782222160.878477:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222160.878524:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081786752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222160.878531:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:0.0:1782222160.878592:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1782222160.878627:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747503800 x1868795081786752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222160.878645:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747503800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081786752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782222160.890264:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081786880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782222160.890337:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222160.890809:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081786880 00000100:00100000:3.0:1782222160.890819:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081786880 00000100:00100000:3.0:1782222160.890900:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1782222160.890911:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081786880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782222160.890935:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1782222160.891073:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782222160.891156:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081786880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 246us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222160.891165:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:0.0:1782222160.891315:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474bf480 x1868795081786880/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222160.891336:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081786880:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1782222161.450624:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782222161.518203:0:13809:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1782222161.519889:0:13806:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1782222161.898660:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782222161.898684:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081787008:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782222161.898751:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222161.898914:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081787008 00000100:00100000:1.0:1782222161.898923:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081787008 00000100:00100000:1.0:1782222161.898981:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1782222161.898990:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081787008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782222161.899023:0:7480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1782222161.899089:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081787008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222161.899097:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1782222161.899199:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081787008:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782222161.899449:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081787136:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782222161.899481:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222161.899619:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081787136 00000100:00100000:2.0:1782222161.899624:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081787136 00000100:00100000:2.0:1782222161.899660:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1782222161.899667:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081787136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782222161.899687:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1782222161.899725:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081787136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222161.899738:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1782222161.901092:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081787136:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782222162.410635:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782222162.410749:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0847000000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081787392:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782222162.410846:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222162.410969:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081787392 00000100:00100000:2.0:1782222162.410978:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081787392 00000100:00100000:2.0:1782222162.411065:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1782222162.411077:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847001c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081787392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782222162.411116:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782222162.411167:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847001c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081787392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222162.411176:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:2.0:1782222162.411200:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782222162.411276:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0847000000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081787392:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782222162.413649:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081787264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782222162.413821:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222162.414064:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081787264 00000100:00100000:1.0:1782222162.414075:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081787264 00000100:00100000:1.0:1782222162.414166:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1782222162.414178:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081787264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782222162.414406:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1782222162.414563:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782222162.422502:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081787264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8311us (8667us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222162.422523:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1782222162.423318:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081787264:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782222162.474480:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222162.864129:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222162.864170:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222162.864205:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222162.864229:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222162.864275:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222162.864310:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060715392 00000100:00100000:0.0:1782222162.864323:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060715392 00000100:00100000:0.0:1782222162.864387:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 382 00000100:00100000:0.0:1782222162.864399:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2387:x1868795060715392:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222162.864733:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2387:x1868795060715392:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 335us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222162.864742:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 382 00000100:00100000:0.0:1782222162.864788:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060715520 00000100:00100000:0.0:1782222162.864793:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060715520 00000100:00100000:0.0:1782222162.864836:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060715776 00000100:00100000:0.0:1782222162.864839:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060715776 00000100:00100000:0.0:1782222162.864855:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060715648 00000100:00100000:0.0:1782222162.864857:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060715648 00000100:00100000:0.0:1782222162.864870:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060715904 00000100:00100000:0.0:1782222162.864872:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060715904 00000100:00100000:0.0:1782222162.864887:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 284 00000100:00100000:0.0:1782222162.864894:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+5:2387:x1868795060715520:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222162.865085:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 285 00000100:00100000:1.0:1782222162.865096:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2387:x1868795060715776:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222162.865131:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2387:x1868795060715776:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 37us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222162.865138:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 285 00000100:00100000:1.0:1782222162.865155:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 286 00000100:00100000:1.0:1782222162.865161:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:2387:x1868795060715648:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222162.865187:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:2387:x1868795060715648:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 26us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222162.865193:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 286 00000100:00100000:1.0:1782222162.865206:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 287 00000100:00100000:1.0:1782222162.865212:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2387:x1868795060715904:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222162.865255:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2387:x1868795060715904:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 42us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222162.865261:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 287 00000100:00100000:0.0:1782222162.865324:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+5:2387:x1868795060715520:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 429us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222162.865332:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 284 00000100:00080000:0.0:1782222162.866289:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782222162.866296:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782222163.437913:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08504cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3654:1868795081787520:0@lo:400:kworker.0 00000100:00100000:0.0:1782222163.437983:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222163.438039:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08504ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1868795081788032:0@lo:400:kworker.0 00000100:00100000:0.0:1782222163.438067:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222163.438087:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07475a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081788544:0@lo:400:kworker.0 00000100:00100000:0.0:1782222163.438111:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222163.438127:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07475ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081789056:0@lo:400:kworker.0 00000100:00100000:0.0:1782222163.438143:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222163.438164:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1782222163.438170:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08504cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081787904:0@lo:400:kworker.0 00000100:00100000:0.0:1782222163.438205:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222163.438221:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08504c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081788416:0@lo:400:kworker.0 00000100:00100000:0.0:1782222163.438273:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222163.438290:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07475a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081788928:0@lo:400:kworker.0 00000100:00100000:0.0:1782222163.438310:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222163.438345:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08504c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1868795081787648:0@lo:400:kworker.0 00000100:00100000:0.0:1782222163.438367:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222163.438383:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08504ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1868795081788160:0@lo:400:kworker.0 00000100:00100000:0.0:1782222163.438401:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222163.438425:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07475ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1868795081788672:0@lo:400:kworker.0 00000100:00100000:0.0:1782222163.438442:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222163.438460:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1782222163.438465:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08504c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081787776:0@lo:400:kworker.0 00000100:00100000:0.0:1782222163.438481:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222163.438496:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08504cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1868795081788288:0@lo:400:kworker.0 00000100:00100000:0.0:1782222163.438513:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222163.438528:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07475a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1868795081788800:0@lo:400:kworker.0 00000100:00100000:0.0:1782222163.438546:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222163.438572:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081787520 00000100:00100000:0.0:1782222163.438579:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081787520 00000100:00100000:0.0:1782222163.438621:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1782222163.438630:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3654:x1868795081787520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222163.438678:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3654:x1868795081787520:12345-0@lo:400:kworker.0 Request processed in 48us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222163.438685:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1782222163.438718:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081788032 00000100:00100000:0.0:1782222163.438723:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081788032 00000100:00100000:0.0:1782222163.438741:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081787648 00000100:00100000:0.0:1782222163.438744:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081787648 00000100:00100000:0.0:1782222163.438754:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081788160 00000100:00100000:0.0:1782222163.438757:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081788160 00000100:00100000:0.0:1782222163.438778:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081788672 00000100:00100000:0.0:1782222163.438781:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081788672 00000100:00100000:0.0:1782222163.438793:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081788288 00000100:00100000:0.0:1782222163.438796:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081788288 00000100:00100000:0.0:1782222163.438807:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081788800 00000100:00100000:0.0:1782222163.438809:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081788800 00000100:00100000:0.0:1782222163.438822:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1782222163.438834:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1868795081788032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222163.438868:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1868795081788032:12345-0@lo:400:kworker.0 Request processed in 34us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222163.438874:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1782222163.438887:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1782222163.438892:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1868795081787648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222163.438918:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1868795081787648:12345-0@lo:400:kworker.0 Request processed in 26us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222163.438924:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1782222163.438934:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1782222163.438939:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1868795081788160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222163.438962:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1868795081788160:12345-0@lo:400:kworker.0 Request processed in 23us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222163.438968:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1782222163.438978:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1782222163.438983:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1868795081788672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222163.439007:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1868795081788672:12345-0@lo:400:kworker.0 Request processed in 24us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222163.439014:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1782222163.439036:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1782222163.439042:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1868795081788288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222163.439068:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1868795081788288:12345-0@lo:400:kworker.0 Request processed in 27us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222163.439074:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1782222163.439084:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1782222163.439096:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1868795081788800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222163.439124:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1868795081788800:12345-0@lo:400:kworker.0 Request processed in 29us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222163.439130:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1782222163.439151:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081788544 00000100:00100000:0.0:1782222163.439154:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081788544 00000100:00100000:0.0:1782222163.439170:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081789056 00000100:00100000:0.0:1782222163.439173:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081789056 00000100:00100000:0.0:1782222163.439184:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081788416 00000100:00100000:0.0:1782222163.439187:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081788416 00000100:00100000:0.0:1782222163.439195:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081788928 00000100:00100000:0.0:1782222163.439198:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081788928 00000100:00100000:0.0:1782222163.439209:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1782222163.439215:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081788544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222163.439270:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081788544:12345-0@lo:400:kworker.0 Request processed in 54us (1157us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222163.439275:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1782222163.439287:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1782222163.439293:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081789056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222163.439318:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081789056:12345-0@lo:400:kworker.0 Request processed in 25us (1173us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222163.439324:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1782222163.439334:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1782222163.439339:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081788416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222163.439366:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081788416:12345-0@lo:400:kworker.0 Request processed in 26us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222163.439372:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1782222163.439390:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1782222163.439396:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081788928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222163.439424:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081788928:12345-0@lo:400:kworker.0 Request processed in 28us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222163.439429:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1782222163.439449:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081787904 00000100:00100000:0.0:1782222163.439452:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081787904 00000100:00100000:0.0:1782222163.439474:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081787776 00000100:00100000:0.0:1782222163.439476:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081787776 00000100:00100000:0.0:1782222163.439488:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1782222163.439493:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081787904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222163.439524:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081787904:12345-0@lo:400:kworker.0 Request processed in 30us (1318us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222163.439530:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1782222163.439540:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1782222163.439547:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081787776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222163.439572:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081787776:12345-0@lo:400:kworker.0 Request processed in 26us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222163.439578:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:0.0:1782222163.439617:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782222163.439621:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782222163.439623:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782222163.439654:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08504c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081787776:0@lo:400:kworker.0 00010000:00080000:0.0:1782222163.439667:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f08504cb100 x1868795081788288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222163.439677:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08504cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1868795081788288:0@lo:400:kworker.0 00010000:00080000:0.0:1782222163.439701:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07475a8380 x1868795081788800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222163.439709:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07475a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1868795081788800:0@lo:400:kworker.0 00000100:00100000:0.0:1782222163.439719:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08504c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1868795081787648:0@lo:400:kworker.0 00000100:00100000:0.0:1782222163.439729:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08504ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1868795081788160:0@lo:400:kworker.0 00000100:00100000:0.0:1782222163.439740:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07475ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1868795081788672:0@lo:400:kworker.0 00000100:00100000:0.0:1782222163.439775:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08504cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081787904:0@lo:400:kworker.0 00000100:00100000:0.0:1782222163.439783:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08504c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081788416:0@lo:400:kworker.0 00010000:00080000:0.0:1782222163.439792:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07475a9500 x1868795081788928/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222163.439799:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07475a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081788928:0@lo:400:kworker.0 00000100:00100000:0.0:1782222163.439806:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08504cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3654:1868795081787520:0@lo:400:kworker.0 00000100:00100000:0.0:1782222163.439814:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08504ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1868795081788032:0@lo:400:kworker.0 00000100:00100000:0.0:1782222163.439823:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07475a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081788544:0@lo:400:kworker.0 00010000:00080000:0.0:1782222163.439831:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07475ab480 x1868795081789056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222163.439838:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07475ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081789056:0@lo:400:kworker.0 00010000:00010000:1.0:1782222163.501362:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1782222163.958873:0:8436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 77bf2c2c-f408-43f9-ae59-449550631d05 00000020:00000080:0.0:1782222163.958883:0:8436:0:(genops.c:906:class_export_put()) final put ffff8f0843cac000/77bf2c2c-f408-43f9-ae59-449550631d05 00000020:00000080:2.0:1782222163.958946:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0843cac000/77bf2c2c-f408-43f9-ae59-449550631d05 for lustre-OST0000 00000020:00000080:2.0:1782222163.959000:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f0843cab000 for lustre-OST0000 00010000:00010000:0.0:1782222164.523478:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222165.548605:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222165.994790:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782222165.994823:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081789184:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782222165.995040:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222165.995068:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782222165.995083:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081789312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782222165.995538:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081789184 00000100:00100000:3.0:1782222165.995548:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081789184 00000100:00100000:3.0:1782222165.995633:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1782222165.995653:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847000000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081789184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782222165.995701:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1782222165.995768:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782222165.999779:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847000000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081789184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4115us (4725us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222165.999798:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00010000:00080000:2.0:1782222165.999984:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474bf480 x1868795081789184/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222166.000025:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081789184:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782222166.003388:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222166.003834:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081789312 00000100:00100000:3.0:1782222166.003847:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081789312 00000100:00100000:3.0:1782222166.003940:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1782222166.003953:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081789312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782222166.003986:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222166.004075:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081789312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222166.004083:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:1.0:1782222166.004377:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1782222166.004564:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747503100 x1868795081789312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222166.004589:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081789312:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782222166.570765:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222167.021906:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081789440:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782222167.022018:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222167.022133:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081789440 00000100:00100000:0.0:1782222167.022154:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081789440 00000100:00100000:0.0:1782222167.022215:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1782222167.022225:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081789440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782222167.022407:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1782222167.022471:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081789440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 246us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222167.022479:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1782222167.022544:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081789440:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782222167.025607:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782222167.025636:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747500700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081789568:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782222167.025735:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222167.025795:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081789568 00000100:00100000:3.0:1782222167.025805:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081789568 00000100:00100000:3.0:1782222167.025868:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1782222167.025878:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081789568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782222167.025926:0:7480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1782222167.025984:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081789568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222167.033363:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1782222167.033474:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747500700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081789568:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1782222167.471765:0:14070:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 09:42:44 (1782222164) 00000100:00100000:2.0:1782222167.530463:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782222167.530486:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0847002a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081789696:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782222167.530548:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222167.532355:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081789696 00000100:00100000:3.0:1782222167.532367:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081789696 00000100:00100000:3.0:1782222167.532424:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1782222167.532435:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847001180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081789696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782222167.532465:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222167.532534:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847001180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081789696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (1985us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222167.532542:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:3.0:1782222167.532565:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782222167.532603:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0847002a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081789696:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782222167.539935:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0847002a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081789824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782222167.540018:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222167.540150:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081789824 00000100:00100000:1.0:1782222167.540160:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081789824 00000100:00100000:1.0:1782222167.540230:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1782222167.540263:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081789824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782222167.540287:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782222167.541006:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081789824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 741us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222167.541017:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:2.0:1782222167.541418:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782222167.543734:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0847002a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081789824:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782222167.594369:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222167.977935:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222167.978004:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222167.978051:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222167.978087:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222167.978153:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222167.978410:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060716032 00000100:00100000:3.0:1782222167.978424:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060716032 00000100:00100000:3.0:1782222167.978506:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 384 00000100:00100000:3.0:1782222167.978518:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08672c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2389:x1868795060716032:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222167.978623:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08672c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2389:x1868795060716032:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 106us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222167.978632:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 384 00000100:00100000:1.0:1782222167.979620:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060716160 00000100:00100000:1.0:1782222167.979638:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060716160 00000100:00100000:1.0:1782222167.979720:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060716416 00000100:00100000:1.0:1782222167.979724:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060716416 00000100:00100000:1.0:1782222167.979744:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060716288 00000100:00100000:1.0:1782222167.979746:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060716288 00000100:00100000:1.0:1782222167.979758:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060716544 00000100:00100000:1.0:1782222167.979760:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060716544 00000100:00100000:1.0:1782222167.979779:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 294 00000100:00100000:1.0:1782222167.979788:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847002300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+5:2389:x1868795060716160:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222167.979864:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847002300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+5:2389:x1868795060716160:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 77us (1945us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222167.979872:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 294 00000100:00100000:1.0:1782222167.979891:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 295 00000100:00100000:1.0:1782222167.979897:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847000e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2389:x1868795060716416:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222167.979920:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847000e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2389:x1868795060716416:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 24us (1917us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222167.979925:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 295 00000100:00100000:1.0:1782222167.979935:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 296 00000100:00100000:1.0:1782222167.979956:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847002680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+5:2389:x1868795060716288:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222167.980004:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847002680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+5:2389:x1868795060716288:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 47us (1916us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222167.980010:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 296 00000100:00100000:1.0:1782222167.980021:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 297 00000100:00100000:1.0:1782222167.980027:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847001880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2389:x1868795060716544:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222167.980047:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847001880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2389:x1868795060716544:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 21us (1895us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222167.980053:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 297 00000100:00080000:2.0:1782222167.981611:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782222167.981627:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782222168.558451:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081789952:0@lo:400:kworker.0 00000100:00100000:3.0:1782222168.558564:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222168.558635:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1868795081790464:0@lo:400:kworker.0 00000100:00100000:3.0:1782222168.558664:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222168.558688:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08516d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081790976:0@lo:400:kworker.0 00000100:00100000:3.0:1782222168.558718:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222168.558734:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08516d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081791488:0@lo:400:kworker.0 00000100:00100000:3.0:1782222168.558754:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222168.558778:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1782222168.558785:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081790080:0@lo:400:kworker.0 00000100:00100000:3.0:1782222168.558807:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222168.558826:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1868795081790592:0@lo:400:kworker.0 00000100:00100000:3.0:1782222168.558846:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222168.558860:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08516d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1868795081791104:0@lo:400:kworker.0 00000100:00100000:3.0:1782222168.558893:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222168.558939:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081790336:0@lo:400:kworker.0 00000100:00100000:3.0:1782222168.558972:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222168.558974:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b785880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081790208:0@lo:400:kworker.0 00000100:00100000:3.0:1782222168.559010:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081790848:0@lo:400:kworker.0 00000100:00100000:3.0:1782222168.559047:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222168.559077:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08516d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081791360:0@lo:400:kworker.0 00000100:00100000:0.0:1782222168.559087:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222168.559315:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081789952 00000100:00100000:1.0:1782222168.559328:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081789952 00000100:00100000:1.0:1782222168.559397:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1782222168.559519:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222168.559560:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081790464 00000100:00100000:3.0:1782222168.559564:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081790464 00000100:00100000:3.0:1782222168.559597:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081790080 00000100:00100000:3.0:1782222168.559600:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081790080 00000100:00100000:3.0:1782222168.559613:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081790592 00000100:00100000:3.0:1782222168.559626:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081790592 00000100:00100000:3.0:1782222168.559651:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081791104 00000100:00100000:3.0:1782222168.559654:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081791104 00000100:00100000:3.0:1782222168.559671:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1782222168.559680:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1868795081790464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222168.559747:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1868795081790464:12345-0@lo:400:kworker.0 Request processed in 68us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222168.559755:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1782222168.559775:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1782222168.559782:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081790080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222168.559811:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081790080:12345-0@lo:400:kworker.0 Request processed in 29us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222168.559817:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1782222168.559828:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1782222168.559834:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1868795081790592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222168.559878:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1868795081790592:12345-0@lo:400:kworker.0 Request processed in 43us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222168.559885:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1782222168.559897:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1782222168.559904:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08526a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1868795081791104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222168.559930:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08526a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1868795081791104:12345-0@lo:400:kworker.0 Request processed in 27us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222168.559937:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1782222168.559996:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081790080:0@lo:400:kworker.0 00000100:00100000:3.0:1782222168.560010:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1868795081790592:0@lo:400:kworker.0 00000100:00100000:3.0:1782222168.560032:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08516d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1868795081791104:0@lo:400:kworker.0 00000100:00100000:3.0:1782222168.560054:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1868795081790464:0@lo:400:kworker.0 00000100:00100000:3.0:1782222168.560129:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081790336 00000100:00100000:3.0:1782222168.560133:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081790336 00000100:00100000:3.0:1782222168.560160:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081790208 00000100:00100000:3.0:1782222168.560164:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081790208 00000100:00100000:3.0:1782222168.560180:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1782222168.560186:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08526a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081790336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222168.560227:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08526a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081790336:12345-0@lo:400:kworker.0 Request processed in 41us (1255us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222168.560259:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1782222168.560272:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1782222168.560278:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081790208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222168.560310:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081790208:12345-0@lo:400:kworker.0 Request processed in 32us (1234us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222168.560317:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1782222168.560336:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081790976 00000100:00100000:3.0:1782222168.560341:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081790976 00000100:00100000:3.0:1782222168.560360:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081791488 00000100:00100000:3.0:1782222168.560363:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081791488 00000100:00100000:3.0:1782222168.560375:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081790848 00000100:00100000:3.0:1782222168.560378:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081790848 00000100:00100000:3.0:1782222168.560388:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081791360 00000100:00100000:3.0:1782222168.560390:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081791360 00000100:00100000:3.0:1782222168.560402:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1782222168.560521:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3653:x1868795081789952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222168.560571:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3653:x1868795081789952:12345-0@lo:400:kworker.0 Request processed in 56us (2008us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222168.560577:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1782222168.560629:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081789952:0@lo:400:kworker.0 00000100:00080000:2.0:1782222168.560732:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782222168.560738:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782222168.562300:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081790976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222168.562438:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081790976:12345-0@lo:400:kworker.0 Request processed in 167us (3718us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222168.564253:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1782222168.564291:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081791488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222168.564433:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081791488:12345-0@lo:400:kworker.0 Request processed in 164us (5677us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222168.564441:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1782222168.564478:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1782222168.564485:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08526a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081790848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222168.564537:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08526a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081790848:12345-0@lo:400:kworker.0 Request processed in 53us (5490us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222168.564544:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1782222168.564557:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1782222168.564564:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08526a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081791360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222168.564596:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08526a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081791360:12345-0@lo:400:kworker.0 Request processed in 33us (5077us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222168.564603:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1782222168.564672:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08516d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081790976:0@lo:400:kworker.0 00010000:00080000:1.0:1782222168.564690:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f08516d0380 x1868795081791488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222168.564702:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08516d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081791488:0@lo:400:kworker.0 00000100:00100000:1.0:1782222168.564820:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081790336:0@lo:400:kworker.0 00000100:00100000:1.0:1782222168.564833:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081790848:0@lo:400:kworker.0 00010000:00080000:1.0:1782222168.564845:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f08516d3800 x1868795081791360/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222168.564855:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08516d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081791360:0@lo:400:kworker.0 00000100:00100000:3.0:1782222168.573160:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1782222168.576185:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b785880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081790208:0@lo:400:kworker.0 00000100:00100000:0.0:1782222168.576202:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1868795081790720:0@lo:400:kworker.0 00000100:00100000:0.0:1782222168.576280:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222168.576319:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08516d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1868795081791232:0@lo:400:kworker.0 00000100:00100000:0.0:1782222168.576341:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222168.576452:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081790720 00000100:00100000:1.0:1782222168.576467:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081790720 00000100:00100000:1.0:1782222168.576557:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081791232 00000100:00100000:1.0:1782222168.576560:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081791232 00000100:00100000:1.0:1782222168.576591:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1782222168.576602:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1868795081790720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222168.576713:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1868795081790720:12345-0@lo:400:kworker.0 Request processed in 112us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222168.576721:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1782222168.576742:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1782222168.576748:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1868795081791232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222168.576774:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1868795081791232:12345-0@lo:400:kworker.0 Request processed in 27us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222168.576780:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00080000:2.0:1782222168.576943:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1782222168.579942:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0875aaf800 x1868795081790720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222168.579962:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1868795081790720:0@lo:400:kworker.0 00010000:00080000:0.0:1782222168.579975:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f08516d1180 x1868795081791232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222168.579993:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08516d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1868795081791232:0@lo:400:kworker.0 00010000:00010000:3.0:1782222168.618671:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222169.474451:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222169.474671:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060716672 00000100:00100000:1.0:1782222169.474682:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060716672 00000100:00100000:1.0:1782222169.474761:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 40 00000100:00100000:1.0:1782222169.474772:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+5:11086:x1868795060716672:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782222169.474793:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222169.474874:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e681152d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558419 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222169.474938:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811534 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222169.474951:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811534 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222169.474963:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811534 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782222169.475020:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782222169.475025:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00080000:2.0:1782222169.475391:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:1.0:1782222169.475496:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811534 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222169.475534:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e681152d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558419 expref: 7 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222169.475553:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811534 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558419 expref: 6 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222169.475562:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0747402c00) 00010000:00010000:1.0:1782222169.475565:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782222169.475568:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744d400, rc 0) 00000100:00100000:1.0:1782222169.475672:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+6:11086:x1868795060716672:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 901us (1229us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222169.475690:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 40 00000100:00100000:0.0:1782222169.495352:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222169.495445:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060716800 00000100:00100000:1.0:1782222169.495455:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060716800 00000100:00100000:1.0:1782222169.495520:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 41 00000100:00100000:1.0:1782222169.495530:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+6:11087:x1868795060716800:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782222169.495551:0:13817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222169.495571:0:13817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e681153b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558420 expref: -99 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222169.495638:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e6811542 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222169.495651:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e6811542 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222169.495661:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e6811542 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222169.495695:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d000/0xe2b7cc26e6811549 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222169.495703:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d000/0xe2b7cc26e6811549 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222169.495710:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d000/0xe2b7cc26e6811549 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222169.495770:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d200/0xe2b7cc26e6811550 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222169.495779:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d200/0xe2b7cc26e6811550 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222169.495786:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d200/0xe2b7cc26e6811550 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782222169.495825:0:13817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782222169.495829:0:13817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782222169.495848:0:13817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d200/0xe2b7cc26e6811550 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222169.495861:0:13817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e6811542 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222169.495868:0:13817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e6811542 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222169.495874:0:13817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e6811542 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222169.495896:0:13817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744de00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222169.495900:0:13817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e6811542 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222169.495906:0:13817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e6811542 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222169.495917:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0747402c00) 00010000:00010000:1.0:1782222169.495921:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222169.495926:0:13817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e6811542 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222169.495932:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e6811542 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222169.495946:0:13817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d000/0xe2b7cc26e6811549 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222169.495953:0:13817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d000/0xe2b7cc26e6811549 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222169.495957:0:13817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d000/0xe2b7cc26e6811549 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222169.495962:0:13817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744d000 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222169.495965:0:13817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d000/0xe2b7cc26e6811549 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222169.495972:0:13817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d000/0xe2b7cc26e6811549 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222169.496002:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8f0747402800) 00010000:00010000:1.0:1782222169.496005:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222169.496008:0:13817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d000/0xe2b7cc26e6811549 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222169.496015:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d000/0xe2b7cc26e6811549 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222169.496058:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e681153b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558420 expref: 8 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222169.496072:0:13817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d200/0xe2b7cc26e6811550 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558420 expref: 7 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222169.496079:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f0747402900) 00010000:00010000:1.0:1782222169.496081:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782222169.496083:0:13817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744d200, rc 0) 00000100:00100000:1.0:1782222169.496153:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+7:11087:x1868795060716800:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 624us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222169.496161:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 41 00000100:00100000:2.0:1782222169.502895:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222169.505283:0:8889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060716928 00000100:00100000:3.0:1782222169.505299:0:8889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060716928 00000100:00100000:3.0:1782222169.505374:0:8889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 7 00000100:00100000:3.0:1782222169.505385:0:8889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847003100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:77bf2c2c-f408-43f9-ae59-449550631d05+7:11087:x1868795060716928:12345-192.168.203.27@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1782222169.505481:0:8889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847003100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:77bf2c2c-f408-43f9-ae59-449550631d05+7:11087:x1868795060716928:12345-192.168.203.27@tcp:900:lhsmtool_posix.0 Request processed in 97us (2593us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222169.505494:0:8889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 7 00000100:00100000:0.0:1782222169.520368:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222169.520574:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060717184 00000100:00100000:3.0:1782222169.520584:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060717184 00000100:00100000:3.0:1782222169.520648:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 42 00000100:00100000:3.0:1782222169.520658:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+7:11087:x1868795060717184:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782222169.520678:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222169.520697:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2600/0xe2b7cc26e6811557 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558427 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222169.520766:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e681155e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222169.520781:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e681155e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222169.520791:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e681155e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222169.529451:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e6811565 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222169.529494:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e6811565 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222169.529507:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e6811565 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222169.529643:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3e00/0xe2b7cc26e681156c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222169.529652:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3e00/0xe2b7cc26e681156c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222169.529658:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3e00/0xe2b7cc26e681156c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782222169.529669:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1782222169.529764:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e681155e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222169.529772:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e681155e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222169.529779:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e681155e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222169.529786:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08413d2800 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222169.529790:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e681155e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222169.529798:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e681155e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222169.529822:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f0747402900) 00010000:00010000:3.0:1782222169.529826:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222169.529830:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e681155e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222169.529836:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e681155e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222169.529851:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e6811565 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222169.529858:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e6811565 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222169.529863:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e6811565 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222169.529869:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08413d2c00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222169.529872:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e6811565 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222169.529879:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e6811565 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222169.529886:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8f087f8f2000) 00010000:00010000:3.0:1782222169.529888:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222169.529891:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e6811565 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222169.529896:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e6811565 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222169.530205:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2600/0xe2b7cc26e6811557 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558427 expref: 10 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222169.530221:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3e00/0xe2b7cc26e681156c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558427 expref: 9 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222169.530229:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f087f8f2900) 00010000:00010000:3.0:1782222169.530231:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222169.530293:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f08413d3e00, rc 0) 00000100:00100000:3.0:1782222169.530366:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+9:11087:x1868795060717184:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 9709us (10007us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1782222169.530376:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 42 00000100:00100000:0.0:1782222169.550912:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222169.551466:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060717312 00000100:00100000:1.0:1782222169.551476:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060717312 00000100:00100000:1.0:1782222169.551543:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 43 00000100:00100000:1.0:1782222169.551552:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+9:11087:x1868795060717312:12345-192.168.203.27@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1782222169.551654:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+9:11087:x1868795060717312:12345-192.168.203.27@tcp:59:lhsmtool_posix.0 Request processed in 103us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222169.551661:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 43 00000100:00100000:2.0:1782222169.556841:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222169.556923:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060717440 00000100:00100000:3.0:1782222169.556933:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060717440 00000100:00100000:3.0:1782222169.557016:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 44 00000100:00100000:3.0:1782222169.557027:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847000380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:11087:x1868795060717440:12345-192.168.203.27@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1782222169.558405:0:6526:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1325us 00000100:00080000:2.0:1782222169.559056:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782222169.580048:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847000380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:11087:x1868795060717440:12345-192.168.203.27@tcp:59:lhsmtool_posix.0 Request processed in 23006us (23201us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222169.580061:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 44 00010000:00010000:3.0:1782222169.642653:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782222169.706943:0:13809:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1782222169.708067:0:13806:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1782222170.667893:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222171.119584:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782222171.119608:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0847003800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081791616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782222171.119678:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222171.119753:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081791616 00000100:00100000:2.0:1782222171.119760:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081791616 00000100:00100000:2.0:1782222171.119813:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1782222171.119823:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847002a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081791616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782222171.119852:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782222171.119895:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847002a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081791616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222171.119917:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:2.0:1782222171.119937:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1782222171.119983:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0847003800 x1868795081791616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222171.120000:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0847003800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081791616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782222171.120183:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782222171.120193:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08516d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081791744:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782222171.120223:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222171.120271:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081791744 00000100:00100000:1.0:1782222171.120275:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081791744 00000100:00100000:1.0:1782222171.120302:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1782222171.120308:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08516d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081791744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782222171.120319:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782222171.120346:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08516d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081791744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222171.120352:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00010000:00080000:1.0:1782222171.120378:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f08516d3800 x1868795081791744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222171.120390:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08516d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081791744:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1782222171.121956:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782222171.696136:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782222171.758807:0:13806:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1782222171.762435:0:13809:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1782222171.850074:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222171.850143:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060717568 00000100:00100000:3.0:1782222171.850153:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060717568 00000100:00100000:3.0:1782222171.850259:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 45 00000100:00100000:3.0:1782222171.850271:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+9:11129:x1868795060717568:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1782222171.850291:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222171.850326:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2600/0xe2b7cc26e681157a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755842e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222171.850389:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e6811581 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222171.850403:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e6811581 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222171.850414:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e6811581 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222171.850429:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e6811588 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222171.850435:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e6811588 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222171.850441:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e6811588 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222171.850481:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e6811581 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222171.850488:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e6811581 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222171.850493:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e6811581 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222171.850499:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08413d2c00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222171.850503:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e6811581 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222171.850521:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e6811581 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222171.850533:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0747402c00) 00010000:00010000:3.0:1782222171.850536:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222171.850540:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e6811581 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222171.850546:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e6811581 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222171.850560:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e6811588 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222171.850566:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e6811588 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222171.850571:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e6811588 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222171.850575:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08413d2800 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222171.850578:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e6811588 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222171.850583:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e6811588 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222171.850589:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8f087f8f2000) 00010000:00010000:3.0:1782222171.850591:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222171.850593:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e6811588 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222171.850609:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e6811588 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222171.850640:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2600/0xe2b7cc26e681157a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755842e expref: 10 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222171.850651:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0747402c00) 00010000:00010000:3.0:1782222171.850653:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222171.850657:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2600/0xe2b7cc26e681157a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755842e expref: 10 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222171.850665:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f08413d2600, rc 0) 00000100:00100000:3.0:1782222171.850724:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+9:11129:x1868795060717568:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 456us (660us total) trans 0 rc 301/301 00000100:00100000:3.0:1782222171.850732:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 45 00000100:00080000:2.0:1782222171.850778:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782222171.855306:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222171.855778:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060717824 00000100:00100000:2.0:1782222171.855790:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060717824 00000100:00100000:2.0:1782222171.855856:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 46 00000100:00100000:2.0:1782222171.855866:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08526a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+9:11129:x1868795060717824:12345-192.168.203.27@tcp:36:lfs.0 00010000:00010000:2.0:1782222171.855927:0:13817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782222171.855957:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811534 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558419 expref: 9 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222171.855984:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0747402c00) 00010000:00010000:2.0:1782222171.855994:0:13817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782222171.856057:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e681158f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222171.856069:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e681158f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222171.856078:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e681158f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222171.856089:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811596 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222171.856107:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811596 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222171.856115:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811596 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222171.856609:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e681159d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222171.856620:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e681159d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222171.856626:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e681159d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782222171.856639:0:13817:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007ce7a09e reply state 00000000f0d73087 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e681159d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222171.856649:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e681159d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222171.856655:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f0849b72000) 00010000:00010000:2.0:1782222171.856657:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782222171.856660:0:13817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782222171.856665:0:13817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1782222171.856672:0:13817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e681158f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222171.856677:0:13817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e681158f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222171.856684:0:13817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e681158f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222171.856698:0:13817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb82800 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222171.856702:0:13817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e681158f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222171.856710:0:13817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e681158f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222171.856719:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0849b72400) 00010000:00010000:2.0:1782222171.856721:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782222171.856724:0:13817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e681158f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222171.856730:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e681158f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782222171.856743:0:13817:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007ce7a09e reply state 00000000f0d73087 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811596 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222171.856751:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811596 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222171.856756:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8f0849b72f00) 00010000:00010000:2.0:1782222171.856759:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782222171.856761:0:13817:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1782222171.856861:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08526a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+10:11129:x1868795060717824:12345-192.168.203.27@tcp:36:lfs.0 Request processed in 995us (1564us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1782222171.856869:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 46 00000100:00100000:2.0:1782222171.990683:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222171.990847:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060717952 00000100:00100000:0.0:1782222171.990858:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060717952 00000100:00100000:0.0:1782222171.991053:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 47 00000100:00100000:0.0:1782222171.991065:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847003800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+10:11137:x1868795060717952:12345-192.168.203.27@tcp:101:lctl.0 00010000:00010000:0.0:1782222171.991089:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222171.991114:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030a00/0xe2b7cc26e68115a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558435 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222171.991187:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031400/0xe2b7cc26e68115ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222171.991199:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031400/0xe2b7cc26e68115ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222171.991226:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031400/0xe2b7cc26e68115ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782222171.991298:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782222171.991302:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782222171.991347:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031400/0xe2b7cc26e68115ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222171.991382:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030a00/0xe2b7cc26e68115a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558435 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222171.991401:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031400/0xe2b7cc26e68115ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558435 expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222171.991409:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0851377900) 00010000:00010000:0.0:1782222171.991411:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782222171.991415:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0840031400, rc 0) 00000100:00100000:0.0:1782222171.991495:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847003800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+11:11137:x1868795060717952:12345-192.168.203.27@tcp:101:lctl.0 Request processed in 433us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222171.991502:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 47 00000100:00100000:0.0:1782222172.072605:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222172.072724:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060718080 00000100:00100000:1.0:1782222172.072733:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060718080 00000100:00100000:1.0:1782222172.072797:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 48 00000100:00100000:1.0:1782222172.072808:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+11:11143:x1868795060718080:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:1.0:1782222172.072829:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222172.072848:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e68115b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755843c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.072911:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e68115b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.072942:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e68115b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.072953:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e68115b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.072975:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68115c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.072982:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68115c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.072989:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68115c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.073072:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d000/0xe2b7cc26e68115c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.073081:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d000/0xe2b7cc26e68115c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.073088:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d000/0xe2b7cc26e68115c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782222172.073134:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1782222172.073138:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782222172.073176:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d000/0xe2b7cc26e68115c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.073188:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e68115b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.073204:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e68115b9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.073211:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e68115b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.073216:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744dc00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222172.073220:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e68115b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.073227:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e68115b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.073278:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0851377900) 00010000:00010000:1.0:1782222172.073282:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222172.073287:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e68115b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.073293:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e68115b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.073306:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68115c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.073312:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68115c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.073317:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68115c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.073322:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744de00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222172.073331:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68115c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.073337:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68115c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.073345:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8f0849b72f00) 00010000:00010000:1.0:1782222172.073348:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222172.073351:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68115c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.073356:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68115c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.073383:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e68115b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755843c expref: 13 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.073395:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d000/0xe2b7cc26e68115c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755843c expref: 12 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.073407:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f0849b72000) 00010000:00010000:1.0:1782222172.073409:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782222172.073412:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744d000, rc 0) 00000100:00100000:1.0:1782222172.073774:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+12:11143:x1868795060718080:12345-192.168.203.27@tcp:101:bash.0 Request processed in 966us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222172.073782:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 48 00000100:00100000:1.0:1782222172.078759:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222172.078832:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060718336 00000100:00100000:3.0:1782222172.078842:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060718336 00000100:00100000:3.0:1782222172.078906:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 49 00000100:00100000:3.0:1782222172.078917:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08516d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+12:11143:x1868795060718336:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:3.0:1782222172.078936:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222172.078955:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430a00/0xe2b7cc26e68115ce lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558443 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.079073:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431800/0xe2b7cc26e68115d5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.079106:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431800/0xe2b7cc26e68115d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.079130:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431800/0xe2b7cc26e68115d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.079205:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e68115dc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.079213:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e68115dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.079220:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e68115dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782222172.079803:0:8465:0:(osp_object.c:1673:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:3.0:1782222172.079938:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e68115e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.079948:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e68115e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.079967:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e68115e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.079999:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431800/0xe2b7cc26e68115d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.080006:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431800/0xe2b7cc26e68115d5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.080013:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431800/0xe2b7cc26e68115d5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.080025:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746431800 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222172.080029:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431800/0xe2b7cc26e68115d5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.080415:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431800/0xe2b7cc26e68115d5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.080431:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f0849b72000) 00010000:00010000:3.0:1782222172.080433:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222172.080438:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431800/0xe2b7cc26e68115d5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.080443:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431800/0xe2b7cc26e68115d5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782222172.080456:0:8465:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000191c8b5e reply state 00000000161dd189 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e68115dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.080467:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e68115dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.080474:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f087f8f2000) 00010000:00010000:3.0:1782222172.080476:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782222172.080478:0:8465:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782222172.080512:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430a00/0xe2b7cc26e68115ce lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558443 expref: 15 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.080526:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e68115e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558443 expref: 14 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.080695:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f087f8f2600) 00010000:00010000:3.0:1782222172.080698:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782222172.080701:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746431e00, rc 0) 00000100:00100000:3.0:1782222172.080772:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08516d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+15:11143:x1868795060718336:12345-192.168.203.27@tcp:101:bash.0 Request processed in 1857us (2021us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1782222172.080781:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 49 00000100:00100000:2.0:1782222172.095607:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222172.095904:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060718464 00000100:00100000:1.0:1782222172.095921:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060718464 00000100:00100000:1.0:1782222172.096001:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 28 00000100:00100000:1.0:1782222172.096037:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2386:x1868795060718464:12345-192.168.203.27@tcp:8:bash.0 00010000:00080000:1.0:1782222172.096076:0:8440:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 77bf2c2c-f408-43f9-ae59-449550631d05@192.168.203.27@tcp t0 exp 0000000000000000 cur 371 last 0 00000020:00000080:1.0:1782222172.096112:0:8440:0:(genops.c:1406:class_connect()) connect: client 77bf2c2c-f408-43f9-ae59-449550631d05, cookie 0xe2b7cc26e68115f1 00002000:00100000:1.0:1782222172.096124:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 77bf2c2c-f408-43f9-ae59-449550631d05/ffff8f07475f2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782222172.096135:0:8440:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782222172.096222:0:8440:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782222172.096277:0:8440:0:(import.c:65:import_set_state_nolock()) ffff8f07475f3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782222172.097704:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77bf2c2c-f408-43f9-ae59-449550631d05+6:2386:x1868795060718464:12345-192.168.203.27@tcp:8:bash.0 Request processed in 1663us (2097us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222172.097716:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 28 00000100:00100000:0.0:1782222172.102634:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222172.102703:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060718592 00000100:00100000:2.0:1782222172.102729:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060718592 00000100:00100000:2.0:1782222172.102821:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 29 00000100:00100000:2.0:1782222172.102831:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+6:0:x1868795060718592:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:2.0:1782222172.102849:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222172.102874:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b72f0ca3/0xe2b7cc26e68115f8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755844a expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782222172.102898:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782222172.102917:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=371s v=(0 0) 00010000:00010000:2.0:1782222172.102921:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782222172.102931:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b72f0ca3/0xe2b7cc26e68115f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755844a expref: 7 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222172.102950:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b72f0ca3/0xe2b7cc26e68115f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755844a expref: 7 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222172.102973:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb82800, rc 0) 00000100:00100000:2.0:1782222172.103050:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+7:0:x1868795060718592:12345-192.168.203.27@tcp:101:bash.0 Request processed in 209us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222172.103057:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 29 00000100:00080000:0.0:1782222172.108002:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782222172.116070:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222172.117402:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060718720 00000100:00100000:1.0:1782222172.117415:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060718720 00000100:00100000:1.0:1782222172.117486:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 30 00000100:00100000:1.0:1782222172.117497:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08526a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77bf2c2c-f408-43f9-ae59-449550631d05+7:11143:x1868795060718720:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:1.0:1782222172.117516:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222172.117537:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003f569ad/0xe2b7cc26e68115ff lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558451 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.117569:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b72f0ca3/0xe2b7cc26e68115f8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755844a expref: 8 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.117578:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222172.117582:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222172.117587:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003f569ad/0xe2b7cc26e68115ff lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558451 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.117827:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b72f0ca3/0xe2b7cc26e68115f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755844a expref: 8 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.117842:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b72f0ca3/0xe2b7cc26e68115f8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755844a expref: 8 pid: 8442 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222172.117856:0:8440:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08516d1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8440:1868795081791872:192.168.203.27@tcp:104: 00000100:00100000:1.0:1782222172.118734:0:8440:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08509133c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782222172.127044:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222172.127440:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060718848 00000100:00100000:3.0:1782222172.127450:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060718848 00010000:00010000:3.0:1782222172.127493:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b72f0ca3/0xe2b7cc26e68115f8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755844a expref: 9 pid: 8442 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222172.127543:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 52 00000100:00100000:3.0:1782222172.127553:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08429aac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77bf2c2c-f408-43f9-ae59-449550631d05+9:2390:x1868795060718848:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782222172.127568:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222172.127588:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b72f0ca3/0xe2b7cc26e68115f8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755844a expref: 9 pid: 8442 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.127601:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b72f0ca3/0xe2b7cc26e68115f8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755844a expref: 9 pid: 8442 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.127628:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782222172.127633:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782222172.127641:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000003f569ad/0xe2b7cc26e68115ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558451 expref: 9 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.127669:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003f569ad/0xe2b7cc26e68115ff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558451 expref: 9 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.127708:0:6511:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000003f569ad/0xe2b7cc26e68115ff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558451 expref: 9 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222172.127723:0:6511:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08526a4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6511:1868795081792000:192.168.203.27@tcp:105: 00000100:00100000:3.0:1782222172.127822:0:6511:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746444d80 going to sleep for 11 seconds 00010000:00010000:0.0:1782222172.128897:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b72f0ca3/0xe2b7cc26e68115f8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755844a expref: 9 pid: 8442 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222172.128921:0:8440:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08516d1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8440:1868795081791872:192.168.203.27@tcp:104: 00010000:00010000:0.0:1782222172.128969:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000003f569ad/0xe2b7cc26e68115ff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558451 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.128982:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744de00, rc 0) 00000100:00100000:0.0:1782222172.129025:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08526a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77bf2c2c-f408-43f9-ae59-449550631d05+8:11143:x1868795060718720:12345-192.168.203.27@tcp:101:bash.0 Request processed in 11530us (12962us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222172.129032:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 30 00000100:00100000:0.0:1782222172.135065:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222172.135160:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060719104 00000100:00100000:1.0:1782222172.135169:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060719104 00000100:00100000:1.0:1782222172.135271:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 6 00000100:00100000:1.0:1782222172.135282:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+15:11143:x1868795060719104:12345-192.168.203.27@tcp:35:bash.0 00000100:00100000:1.0:1782222172.135590:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+16:11143:x1868795060719104:12345-192.168.203.27@tcp:35:bash.0 Request processed in 309us (537us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1782222172.135599:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 6 00000100:00100000:3.0:1782222172.136121:0:6511:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08526a4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6511:1868795081792000:192.168.203.27@tcp:105: 00010000:00010000:3.0:1782222172.136143:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782222172.136191:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08429aac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77bf2c2c-f408-43f9-ae59-449550631d05+7:2390:x1868795060718848:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 8631us (9148us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222172.136201:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 52 00000100:00100000:2.0:1782222172.138407:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782222172.138430:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08526a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081792128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782222172.138495:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222172.138583:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081792128 00000100:00100000:3.0:1782222172.138590:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081792128 00000100:00100000:3.0:1782222172.138638:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1782222172.138648:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081792128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782222172.138685:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1782222172.138744:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081792128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222172.138752:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1782222172.138940:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08526a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081792128:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782222172.139131:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782222172.139143:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08526a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081792256:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782222172.139177:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222172.139696:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081792256 00000100:00100000:3.0:1782222172.139703:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081792256 00000100:00100000:3.0:1782222172.139742:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1782222172.139750:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081792256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782222172.139792:0:7480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1782222172.139836:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081792256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222172.139843:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1782222172.140312:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08526a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081792256:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782222172.225411:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222172.230004:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060719360 00000100:00100000:3.0:1782222172.230020:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060719360 00000100:00100000:2.0:1782222172.230338:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 50 00000100:00100000:2.0:1782222172.230350:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+16:11153:x1868795060719360:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1782222172.230374:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222172.230408:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6811606 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558458 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782222172.230508:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1782222172.230604:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6811606 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558458 expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222172.230619:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0851377900) 00010000:00010000:2.0:1782222172.230622:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782222172.230627:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6811606 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558458 expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222172.230642:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb83e00, rc 0) 00000100:00100000:2.0:1782222172.230716:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+17:11153:x1868795060719360:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 368us (5312us total) trans 4294967315 rc 301/301 00000100:00100000:2.0:1782222172.230732:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 50 00000100:00100000:2.0:1782222172.234717:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222172.234804:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060719616 00000100:00100000:3.0:1782222172.234817:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060719616 00000100:00100000:3.0:1782222172.234878:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 7 00000100:00100000:3.0:1782222172.234888:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847005c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+17:11153:x1868795060719616:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:3.0:1782222172.235129:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847005c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+18:11153:x1868795060719616:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 241us (423us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1782222172.235137:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 7 00000100:00100000:3.0:1782222172.346791:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222172.347000:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060719744 00000100:00100000:1.0:1782222172.347009:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060719744 00000100:00100000:1.0:1782222172.347131:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 51 00000100:00100000:1.0:1782222172.347142:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08526a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+18:11159:x1868795060719744:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:1.0:1782222172.347166:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222172.347186:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811614 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755845f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.347306:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e681161b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.347320:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e681161b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.347331:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e681161b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782222172.347375:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1782222172.347378:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782222172.347398:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e681161b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.347423:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811614 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755845f expref: 20 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.347440:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e681161b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755845f expref: 19 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.347449:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f0849b72000) 00010000:00010000:1.0:1782222172.347452:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782222172.347456:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744c800, rc 0) 00000100:00100000:1.0:1782222172.347521:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08526a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+19:11159:x1868795060719744:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 382us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222172.347528:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 51 00000100:00100000:2.0:1782222172.354461:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222172.354553:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060720000 00000100:00100000:3.0:1782222172.354563:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060720000 00000100:00100000:3.0:1782222172.354615:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 52 00000100:00100000:3.0:1782222172.354622:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+19:11159:x1868795060720000:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1782222172.354638:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222172.354653:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430a00/0xe2b7cc26e6811622 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558466 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.354751:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431800/0xe2b7cc26e6811629 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.354765:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431800/0xe2b7cc26e6811629 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.354793:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431800/0xe2b7cc26e6811629 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782222172.354805:0:8465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1782222172.354915:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430a00/0xe2b7cc26e6811622 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558466 expref: 22 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.354934:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431800/0xe2b7cc26e6811629 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558466 expref: 21 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.354943:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f087f8f2600) 00010000:00010000:3.0:1782222172.354946:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782222172.354949:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746431800, rc 0) 00000100:00100000:3.0:1782222172.355033:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+21:11159:x1868795060720000:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 409us (580us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1782222172.355040:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 52 00000100:00100000:2.0:1782222172.360066:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222172.360223:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060720256 00000100:00100000:1.0:1782222172.360252:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060720256 00000100:00100000:1.0:1782222172.360329:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 53 00000100:00100000:1.0:1782222172.360338:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847004000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+21:11159:x1868795060720256:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:1.0:1782222172.360363:0:13817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222172.360382:0:13817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811637 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755846d expref: -99 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.360483:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681163e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.360497:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681163e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.360508:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681163e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782222172.360520:0:13817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1782222172.360619:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811637 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755846d expref: 24 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.360635:0:13817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681163e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755846d expref: 23 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.360643:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f087f8f2600) 00010000:00010000:1.0:1782222172.360646:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1782222172.360649:0:13817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744d600, rc 0) 00000100:00100000:1.0:1782222172.360714:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847004000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+23:11159:x1868795060720256:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 377us (657us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1782222172.360722:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 53 00000100:00100000:2.0:1782222172.365986:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222172.366231:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222172.366323:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060720512 00000100:00100000:3.0:1782222172.366331:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060720512 00000100:00100000:3.0:1782222172.366392:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 31 00000100:00100000:3.0:1782222172.366402:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847004700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+7:2387:x1868795060720512:12345-192.168.203.27@tcp:1:lfs.0 00010000:00010000:3.0:1782222172.366442:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021dcff7d/0xe2b7cc26e681164c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.366459:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000003f569ad/0xe2b7cc26e68115ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558451 expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.366467:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782222172.366483:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782222172.366487:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021dcff7d/0xe2b7cc26e681164c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.366520:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000003f569ad/0xe2b7cc26e68115ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558451 expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.366532:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000003f569ad/0xe2b7cc26e68115ff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558451 expref: 7 pid: 8440 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222172.366546:0:8442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08526a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8442:1868795081792384:192.168.203.27@tcp:104: 00000100:00100000:3.0:1782222172.366621:0:8442:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746444b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782222172.367433:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060720384 00000100:00100000:0.0:1782222172.367441:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060720384 00000100:00100000:0.0:1782222172.367535:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 3 00000100:00100000:0.0:1782222172.367546:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847005f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77bf2c2c-f408-43f9-ae59-449550631d05+23:2389:x1868795060720384:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782222172.367557:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222172.367578:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431800/0xe2b7cc26e6811629 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558466 expref: 23 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.367596:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f087f8f2600) 00010000:00010000:0.0:1782222172.367600:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782222172.367646:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847005f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77bf2c2c-f408-43f9-ae59-449550631d05+22:2389:x1868795060720384:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 102us (1667us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222172.367662:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 3 00000100:00100000:0.0:1782222172.374218:0:8442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08526a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8442:1868795081792384:192.168.203.27@tcp:104: 00010000:00010000:0.0:1782222172.374281:0:8442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000021dcff7d/0xe2b7cc26e681164c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222172.375363:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222172.375763:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060720640 00000100:00100000:0.0:1782222172.375773:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060720640 00002000:00100000:0.0:1782222172.375820:0:8446:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff8f08516d1500 x1868795060720640/t0(0) o4->77bf2c2c-f408-43f9-ae59-449550631d05@192.168.203.27@tcp:138/0 lens 504/0 e 0 to 0 dl 1782222183 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782222172.375830:0:8446:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f08516d1500 with x1868795060720640 ext(0->12) 00010000:00010000:0.0:1782222172.375839:0:8446:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000003f569ad/0xe2b7cc26e68115ff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558451 expref: 8 pid: 8440 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.375854:0:8446:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000003f569ad/0xe2b7cc26e68115ff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558451 expref: 8 pid: 8440 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782222172.375861:0:8446:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8f08516d1500 00000100:00100000:0.0:1782222172.375892:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 0 00000100:00100000:0.0:1782222172.375900:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08516d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77bf2c2c-f408-43f9-ae59-449550631d05+8:2390:x1868795060720640:12345-192.168.203.27@tcp:4:lfs.0 00000001:00100000:3.0:1782222172.379548:0:9523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 77bf2c2c-f408-43f9-ae59-449550631d05 00000100:00100000:0.0:1782222172.385706:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08516d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77bf2c2c-f408-43f9-ae59-449550631d05+9:2390:x1868795060720640:12345-192.168.203.27@tcp:4:lfs.0 Request processed in 9795us (10336us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1782222172.385720:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 0 00002000:00100000:0.0:1782222172.385732:0:8446:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff8f08516d1500 x1868795060720640/t4294967300(0) o4->77bf2c2c-f408-43f9-ae59-449550631d05@192.168.203.27@tcp:138/0 lens 504/448 e 0 to 0 dl 1782222183 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782222172.385761:0:8446:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f08516d1500 with x1868795060720640 ext(0->12) 00010000:00010000:0.0:1782222172.385774:0:8446:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000003f569ad/0xe2b7cc26e68115ff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558451 expref: 9 pid: 8440 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.385791:0:8446:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000003f569ad/0xe2b7cc26e68115ff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558451 expref: 9 pid: 8440 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782222172.385799:0:8446:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8f08516d1500 00000100:00100000:2.0:1782222172.395135:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222172.395302:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060720768 00000100:00100000:1.0:1782222172.395316:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060720768 00010000:00010000:1.0:1782222172.395372:0:9532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000003f569ad/0xe2b7cc26e68115ff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558451 expref: 9 pid: 8440 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222172.395426:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 53 00000100:00100000:1.0:1782222172.395437:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847006a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77bf2c2c-f408-43f9-ae59-449550631d05+9:2390:x1868795060720768:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782222172.395459:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1782222172.395483:0:9532:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1782222172.395486:0:9532:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1782222171 00002000:00010000:1.0:1782222172.395489:0:9532:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1782222171 00002000:00010000:1.0:1782222172.395492:0:9532:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1782222171 00002000:00010000:1.0:1782222172.395494:0:9532:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1782222172.395501:0:9532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000003f569ad/0xe2b7cc26e68115ff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558451 expref: 9 pid: 8440 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.395517:0:9532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000003f569ad/0xe2b7cc26e68115ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558451 expref: 9 pid: 8440 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.395551:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003f569ad/0xe2b7cc26e68115ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558451 expref: 9 pid: 8440 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.395572:0:9532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782222172.395577:0:9532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782222172.395584:0:9532:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000021dcff7d/0xe2b7cc26e681164c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.395616:0:9532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021dcff7d/0xe2b7cc26e681164c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.395651:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782222172.395732:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847006a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77bf2c2c-f408-43f9-ae59-449550631d05+8:2390:x1868795060720768:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 297us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222172.395741:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 53 00010000:00010000:0.0:1782222172.396014:0:8442:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000021dcff7d/0xe2b7cc26e681164c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.396033:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021dcff7d/0xe2b7cc26e681164c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.396063:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021dcff7d/0xe2b7cc26e681164c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.396072:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021dcff7d/0xe2b7cc26e681164c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.396080:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021dcff7d/0xe2b7cc26e681164c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.396088:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746430a00 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:0.0:1782222172.396091:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021dcff7d/0xe2b7cc26e681164c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.396117:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021dcff7d/0xe2b7cc26e681164c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.396140:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021dcff7d/0xe2b7cc26e681164c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.396149:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021dcff7d/0xe2b7cc26e681164c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222172.396298:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847004700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+7:2387:x1868795060720512:12345-192.168.203.27@tcp:1:lfs.0 Request processed in 29892us (30062us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222172.396307:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 31 00000100:00100000:2.0:1782222172.408303:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222172.408469:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060721024 00000100:00100000:3.0:1782222172.408482:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060721024 00000100:00100000:3.0:1782222172.408560:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 8 00000100:00100000:3.0:1782222172.408573:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+22:11159:x1868795060721024:12345-192.168.203.27@tcp:35:lfs.0 00000004:00010000:3.0:1782222172.408661:0:6529:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681163e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755846d expref: 22 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782222172.408951:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:3.0:1782222172.409025:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1782222172.409508:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:3.0:1782222172.409556:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431400/0xe2b7cc26e6811653 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.409574:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e68115e3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558443 expref: 26 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.409595:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431400/0xe2b7cc26e6811653 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.409639:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e68115e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558443 expref: 26 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.409657:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e68115e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558443 expref: 26 pid: 8465 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222172.409675:0:6529:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08526a5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6529:1868795081792512:192.168.203.27@tcp:104: 00000100:00100000:3.0:1782222172.409792:0:6529:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08492a1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782222172.415297:0:6529:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08526a5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6529:1868795081792512:192.168.203.27@tcp:104: 00010000:00010000:3.0:1782222172.415342:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431400/0xe2b7cc26e6811653 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222172.415952:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222172.416126:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060721152 00000100:00100000:1.0:1782222172.416136:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060721152 00010000:00010000:1.0:1782222172.416188:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e68115e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558443 expref: 27 pid: 8465 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222172.416231:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 54 00000100:00100000:1.0:1782222172.416268:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+27:2390:x1868795060721152:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782222172.416288:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222172.416297:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e68115e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558443 expref: 27 pid: 8465 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.416313:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e68115e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558443 expref: 27 pid: 8465 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.416339:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e68115e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558443 expref: 27 pid: 8465 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.416357:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f087f8f2600) 00010000:00010000:1.0:1782222172.416370:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431400/0xe2b7cc26e6811653 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.416381:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431400/0xe2b7cc26e6811653 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.416389:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431400/0xe2b7cc26e6811653 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.416420:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782222172.416492:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+26:2390:x1868795060721152:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 228us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222172.416501:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 54 00010000:00010000:3.0:1782222172.416930:0:6529:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431400/0xe2b7cc26e6811653 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.416941:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431400/0xe2b7cc26e6811653 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782222172.417113:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:3.0:1782222172.417288:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:3.0:1782222172.417402:0:6529:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08526a5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6529:1868795081792640:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1782222172.417472:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222172.417520:0:6529:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08492a1780 going to sleep for 11 seconds 00000100:00100000:0.0:1782222172.417570:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081792640 00000100:00100000:0.0:1782222172.417584:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081792640 00000100:00100000:0.0:1782222172.417654:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1782222172.417665:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08526a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6529:x1868795081792640:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1782222172.417821:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08526a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6529:x1868795081792640:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 157us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222172.417829:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1782222172.420294:0:6529:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08526a5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6529:1868795081792640:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1782222172.420578:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:1.0:1782222172.420686:0:6529:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08516d3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6529:1868795081792768:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1782222172.420765:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222172.420797:0:6529:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08490ed540 going to sleep for 11 seconds 00000100:00100000:0.0:1782222172.421492:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081792768 00000100:00100000:0.0:1782222172.421506:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081792768 00000100:00100000:0.0:1782222172.421571:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1782222172.421581:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08516d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6529:x1868795081792768:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1782222172.421782:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08516d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6529:x1868795081792768:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 202us (1017us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1782222172.421806:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1782222172.423174:0:6529:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08516d3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6529:1868795081792768:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1782222172.423330:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:1.0:1782222172.423406:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431400/0xe2b7cc26e6811653 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.423420:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431400/0xe2b7cc26e6811653 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.423430:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431400/0xe2b7cc26e6811653 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.423438:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746431400 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222172.423458:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431400/0xe2b7cc26e6811653 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.423468:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431400/0xe2b7cc26e6811653 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.423488:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f087f8f2600) 00010000:00010000:1.0:1782222172.423492:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1782222172.423498:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431400/0xe2b7cc26e6811653 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.423505:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431400/0xe2b7cc26e6811653 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782222172.423655:0:6529:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1782222172.423732:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1782222172.423747:0:6529:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 371452511348ns, next at 372452508038ns, rc = 0 00000001:00080000:1.0:1782222172.423754:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:1.0:1782222172.423782:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f087f8f2600) 00010000:00010000:1.0:1782222172.423785:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1782222172.423794:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681163e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755846d expref: 30 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222172.423923:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+29:11159:x1868795060721024:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 15351us (15685us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1782222172.423934:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 8 00000020:00080000:1.0:1782222172.423941:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1782222172.435391:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222172.435478:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060721280 00000100:00100000:1.0:1782222172.435492:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060721280 00000100:00100000:1.0:1782222172.435565:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 54 00000100:00100000:1.0:1782222172.435576:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+29:11159:x1868795060721280:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:1.0:1782222172.435629:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222172.435660:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e681165a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558474 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.435733:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e681165a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558474 expref: 30 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.435751:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e681165a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558474 expref: 30 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.435772:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f08491d6600) 00010000:00010000:1.0:1782222172.435776:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782222172.435780:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744de00, rc 0) 00000100:00100000:1.0:1782222172.435855:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+30:11159:x1868795060721280:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 280us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222172.435863:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 54 00000100:00100000:2.0:1782222172.447231:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222172.447371:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060721536 00000100:00100000:0.0:1782222172.447384:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060721536 00000100:00100000:0.0:1782222172.447498:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 9 00000100:00100000:0.0:1782222172.447521:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087d4b8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+30:11159:x1868795060721536:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:0.0:1782222172.447875:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087d4b8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+31:11159:x1868795060721536:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 357us (656us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1782222172.447884:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 9 00000100:00100000:2.0:1782222172.569767:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222172.569871:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060721792 00000100:00100000:3.0:1782222172.569909:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060721792 00000100:00100000:3.0:1782222172.569997:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 55 00000100:00100000:3.0:1782222172.570008:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+31:11169:x1868795060721792:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1782222172.570041:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222172.570066:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811661 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755847b expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782222172.570218:0:8465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1782222172.570381:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811661 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755847b expref: 33 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.570398:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0851377900) 00010000:00010000:3.0:1782222172.570401:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782222172.570407:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811661 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755847b expref: 33 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.570424:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746431a00, rc 0) 00000100:00100000:3.0:1782222172.570512:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+32:11169:x1868795060721792:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 505us (759us total) trans 4294967329 rc 301/301 00000100:00100000:3.0:1782222172.570520:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 55 00000100:00100000:2.0:1782222172.579036:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222172.583279:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060721920 00000100:00100000:0.0:1782222172.583302:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060721920 00000100:00100000:0.0:1782222172.583467:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 56 00000100:00100000:0.0:1782222172.583481:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+32:11169:x1868795060721920:12345-192.168.203.27@tcp:34:lfs.0 00010000:00010000:0.0:1782222172.583604:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030800/0xe2b7cc26e681166f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.583626:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030800/0xe2b7cc26e681166f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.583639:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030800/0xe2b7cc26e681166f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.583651:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031600/0xe2b7cc26e6811676 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.583658:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031600/0xe2b7cc26e6811676 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.583664:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031600/0xe2b7cc26e6811676 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.583801:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030e00/0xe2b7cc26e681167d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.583811:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030e00/0xe2b7cc26e681167d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.583817:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030e00/0xe2b7cc26e681167d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782222172.583878:0:6528:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030e00/0xe2b7cc26e681167d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.583892:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030800/0xe2b7cc26e681166f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.583899:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030800/0xe2b7cc26e681166f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.583907:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030800/0xe2b7cc26e681166f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.583914:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0840030800 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222172.583919:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030800/0xe2b7cc26e681166f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.583927:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030800/0xe2b7cc26e681166f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.583940:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f0849b72000) 00010000:00010000:0.0:1782222172.583943:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782222172.583948:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030800/0xe2b7cc26e681166f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.583971:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030800/0xe2b7cc26e681166f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.583987:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031600/0xe2b7cc26e6811676 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.583993:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031600/0xe2b7cc26e6811676 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.583999:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031600/0xe2b7cc26e6811676 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.584003:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0840031600 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222172.584006:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031600/0xe2b7cc26e6811676 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.584012:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031600/0xe2b7cc26e6811676 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.584021:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f087f8f2000) 00010000:00010000:0.0:1782222172.584023:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782222172.584026:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031600/0xe2b7cc26e6811676 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.584032:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031600/0xe2b7cc26e6811676 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.584044:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030e00/0xe2b7cc26e681167d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.584051:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030e00/0xe2b7cc26e681167d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.584063:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030e00/0xe2b7cc26e681167d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.584068:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0840030e00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222172.584071:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030e00/0xe2b7cc26e681167d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.584077:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030e00/0xe2b7cc26e681167d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.584084:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f08491d6600) 00010000:00010000:0.0:1782222172.584087:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782222172.584089:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030e00/0xe2b7cc26e681167d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222172.584095:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030e00/0xe2b7cc26e681167d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222172.584206:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+32:11169:x1868795060721920:12345-192.168.203.27@tcp:34:lfs.0 Request processed in 727us (5186us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222172.584216:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 56 00000100:00100000:2.0:1782222172.597822:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222172.597923:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060722176 00000100:00100000:1.0:1782222172.597936:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060722176 00000100:00100000:1.0:1782222172.598011:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 10 00000100:00100000:1.0:1782222172.598023:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+32:11169:x1868795060722176:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:1.0:1782222172.598461:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+33:11169:x1868795060722176:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 438us (650us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1782222172.598470:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 10 00000100:00100000:3.0:1782222172.643686:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222172.643860:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060722432 00000100:00100000:1.0:1782222172.643874:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060722432 00000100:00100000:1.0:1782222172.643950:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 57 00000100:00100000:1.0:1782222172.643971:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08526a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+33:11173:x1868795060722432:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:1.0:1782222172.644028:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222172.644056:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811684 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558482 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.644166:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e681168b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.644195:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e681168b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.644208:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e681168b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.644220:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e6811692 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.644227:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e6811692 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.644275:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e6811692 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.644429:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811699 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.644438:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811699 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.644446:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811699 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782222172.644458:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1782222172.644563:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e681168b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.644584:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e681168b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.644592:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e681168b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.644599:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744dc00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222172.644604:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e681168b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.644613:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e681168b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.644627:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f0849b72000) 00010000:00010000:1.0:1782222172.644631:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222172.644636:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e681168b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.644642:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e681168b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.644658:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e6811692 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.644663:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e6811692 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.644670:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e6811692 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.644686:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744c400 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222172.644689:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e6811692 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.644695:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e6811692 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.644703:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f087f8f2000) 00010000:00010000:1.0:1782222172.644705:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222172.644708:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e6811692 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.644712:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e6811692 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.644761:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811684 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558482 expref: 36 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.644776:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811699 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558482 expref: 35 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222172.644783:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f08491d6600) 00010000:00010000:1.0:1782222172.644786:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782222172.644789:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744ce00, rc 0) 00000100:00100000:1.0:1782222172.644879:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08526a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+35:11173:x1868795060722432:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 910us (1210us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1782222172.644888:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 57 00000100:00100000:3.0:1782222172.654779:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782222172.654807:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08526a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081792896:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782222172.654900:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222172.655004:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222172.655040:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060722560 00000100:00100000:3.0:1782222172.655049:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060722560 00000100:00100000:3.0:1782222172.655106:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 58 00000100:00100000:3.0:1782222172.655143:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08526a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+35:11173:x1868795060722560:12345-192.168.203.27@tcp:54:lfs.0 00000100:00100000:1.0:1782222172.655434:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08412af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081793024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782222172.655477:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222172.655535:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081792896 00000100:00100000:2.0:1782222172.655540:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081792896 00000100:00100000:2.0:1782222172.655589:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081793024 00000100:00100000:2.0:1782222172.655593:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081793024 00010000:00010000:3.0:1782222172.655594:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e68116a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222172.655613:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00010000:00010000:3.0:1782222172.655617:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e68116a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222172.655622:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08526a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081792896:12345-0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1782222172.655636:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e68116a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00000024:2.0:1782222172.655653:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00010000:3.0:1782222172.655688:0:13817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e68116a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.655698:0:13817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e68116a7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.655706:0:13817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e68116a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222172.655708:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08526a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081792896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (808us total) trans 0 rc 0/0 00010000:00010000:3.0:1782222172.655722:0:13817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746431a00 already unused, calling callback (ffffffffc199b4f0) 00000100:00100000:2.0:1782222172.655725:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00010000:00010000:3.0:1782222172.655730:0:13817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e68116a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.655741:0:13817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e68116a7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222172.655749:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1782222172.655756:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08516d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081793024:12345-0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782222172.655759:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f08491d6600) 00010000:00010000:3.0:1782222172.655764:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00002000:00000024:2.0:1782222172.655768:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00010000:3.0:1782222172.655770:0:13817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e68116a7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.655779:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e68116a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1782222172.655837:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782222172.655985:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08526a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+35:11173:x1868795060722560:12345-192.168.203.27@tcp:54:lfs.0 Request processed in 851us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222172.655993:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 58 00000100:00100000:3.0:1782222172.656067:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08526a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081792896:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782222172.660268:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222172.660605:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060722816 00000100:00100000:0.0:1782222172.660619:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060722816 00000100:00100000:0.0:1782222172.660696:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 11 00000100:00100000:0.0:1782222172.660707:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08526a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+35:11173:x1868795060722816:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:0.0:1782222172.661043:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08526a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+36:11173:x1868795060722816:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 335us (816us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1782222172.661072:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 11 00000100:00100000:2.0:1782222172.666551:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08516d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081793024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10779us (11057us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222172.666571:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1782222172.669541:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08412af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081793024:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782222172.714539:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222172.938627:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222172.938787:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060723072 00000100:00100000:3.0:1782222172.938800:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060723072 00000100:00100000:3.0:1782222172.938933:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 59 00000100:00100000:3.0:1782222172.938946:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+36:11204:x1868795060723072:12345-192.168.203.27@tcp:101:cat.0 00010000:00010000:3.0:1782222172.939028:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222172.939053:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e68116ae lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558489 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.939727:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430600/0xe2b7cc26e68116b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.939749:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430600/0xe2b7cc26e68116b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.939764:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430600/0xe2b7cc26e68116b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782222172.939778:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1782222172.939935:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e68116ae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558489 expref: 39 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.939968:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430600/0xe2b7cc26e68116b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558489 expref: 38 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.939996:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f08491d6600) 00010000:00010000:3.0:1782222172.940000:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782222172.940417:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746430600, rc 0) 00000100:00100000:3.0:1782222172.940511:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+38:11204:x1868795060723072:12345-192.168.203.27@tcp:101:cat.0 Request processed in 1564us (1896us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1782222172.940521:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 59 00000100:00100000:0.0:1782222172.953448:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222172.953499:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222172.953597:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060723456 00000100:00100000:3.0:1782222172.953614:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060723456 00000100:00100000:3.0:1782222172.953778:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 4 00000100:00100000:3.0:1782222172.953789:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77bf2c2c-f408-43f9-ae59-449550631d05+38:2389:x1868795060723456:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782222172.953806:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222172.953833:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430600/0xe2b7cc26e68116b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558489 expref: 38 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222172.953850:0:9532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f08491d6600) 00010000:00010000:3.0:1782222172.953855:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782222172.953926:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77bf2c2c-f408-43f9-ae59-449550631d05+37:2389:x1868795060723456:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 139us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222172.953934:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 4 00000100:00100000:1.0:1782222172.954173:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060723328 00000100:00100000:1.0:1782222172.954184:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060723328 00000100:00100000:1.0:1782222172.954284:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 12 00000100:00100000:1.0:1782222172.954295:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+37:11204:x1868795060723328:12345-192.168.203.27@tcp:35:cat.0 00000100:00100000:1.0:1782222172.955068:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+38:11204:x1868795060723328:12345-192.168.203.27@tcp:35:cat.0 Request processed in 770us (1631us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1782222172.955079:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 12 00000100:00100000:2.0:1782222173.048640:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222173.049908:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060723712 00000100:00100000:3.0:1782222173.049926:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060723712 00000100:00100000:3.0:1782222173.050056:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 60 00000100:00100000:3.0:1782222173.050068:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+38:11210:x1868795060723712:12345-192.168.203.27@tcp:101:dd.0 00010000:00010000:3.0:1782222173.050099:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222173.050112:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1782222173.050401:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e681161b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755845f expref: 38 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.050428:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f0849b72000) 00010000:00010000:3.0:1782222173.050434:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782222173.050450:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430600/0xe2b7cc26e68116c3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558490 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1782222173.050911:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782222173.051045:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e68116ca lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222173.051065:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811699 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558482 expref: 38 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222173.051078:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e68116ca lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222173.051125:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811699 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558482 expref: 38 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222173.051156:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811699 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558482 expref: 38 pid: 6527 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222173.051174:0:8465:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08412af100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8465:1868795081793152:192.168.203.27@tcp:104: 00000100:00100000:2.0:1782222173.051315:0:8465:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746166b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782222173.060801:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222173.060928:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060723840 00000100:00100000:0.0:1782222173.060943:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060723840 00010000:00010000:0.0:1782222173.061010:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811699 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558482 expref: 39 pid: 6527 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222173.061065:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 55 00000100:00100000:0.0:1782222173.061077:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08526a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77bf2c2c-f408-43f9-ae59-449550631d05+39:2390:x1868795060723840:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782222173.061095:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222173.061108:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811699 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558482 expref: 39 pid: 6527 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.061124:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811699 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558482 expref: 39 pid: 6527 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.061153:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f08491d6600) 00010000:00010000:0.0:1782222173.061159:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e68116ca lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.061170:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e68116ca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.061189:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e68116ca lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.061231:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782222173.061342:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08526a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77bf2c2c-f408-43f9-ae59-449550631d05+39:2390:x1868795060723840:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 267us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222173.061351:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 55 00010000:00010000:2.0:1782222173.068136:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811699 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558482 expref: 38 pid: 6527 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222173.068172:0:8465:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08412af100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8465:1868795081793152:192.168.203.27@tcp:104: 00010000:00010000:2.0:1782222173.068202:0:8465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e68116ca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222173.068215:0:8465:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e68116ca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222173.068222:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e68116ca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782222173.068286:0:8465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1782222173.068495:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430600/0xe2b7cc26e68116c3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558490 expref: 39 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222173.068513:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e68116ca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558490 expref: 38 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222173.068524:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f08491d6600) 00010000:00010000:2.0:1782222173.068542:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782222173.068547:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb83e00, rc 0) 00000100:00100000:2.0:1782222173.068623:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+38:11210:x1868795060723712:12345-192.168.203.27@tcp:101:dd.0 Request processed in 18556us (19998us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1782222173.068635:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 60 00000100:00100000:3.0:1782222173.072355:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222173.072501:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060723968 00000100:00100000:1.0:1782222173.072514:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060723968 00000100:00100000:1.0:1782222173.072587:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 61 00000100:00100000:1.0:1782222173.072600:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08526a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+38:11210:x1868795060723968:12345-192.168.203.27@tcp:101:dd.0 00010000:00010000:1.0:1782222173.072633:0:13817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222173.072660:0:13817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e68116d8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558497 expref: -99 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222173.072707:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e68116df lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222173.072726:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e68116df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222173.072741:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e68116df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222173.072905:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e68116d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558497 expref: 40 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222173.072942:0:13817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e68116df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558497 expref: 39 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222173.072962:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f08491d6600) 00010000:00010000:1.0:1782222173.072966:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782222173.072969:0:13817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744c400, rc 0) 00000100:00100000:1.0:1782222173.073058:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08526a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+39:11210:x1868795060723968:12345-192.168.203.27@tcp:101:dd.0 Request processed in 460us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222173.073066:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 61 00000100:00100000:0.0:1782222173.081368:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222173.081551:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060724224 00000100:00100000:3.0:1782222173.081567:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060724224 00000100:00100000:3.0:1782222173.081650:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 62 00000100:00100000:3.0:1782222173.081663:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+39:11210:x1868795060724224:12345-192.168.203.27@tcp:36:dd.0 00010000:00010000:3.0:1782222173.081989:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e68116e6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.082010:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e68116e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.082026:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e68116e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782222173.082079:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:3.0:1782222173.082118:0:6528:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004169f2c3 reply state 000000003612b09a transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e68116e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.082133:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e68116e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.082167:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f08491d6600) 00010000:00010000:3.0:1782222173.082170:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782222173.082174:0:6528:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782222173.082363:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+42:11210:x1868795060724224:12345-192.168.203.27@tcp:36:dd.0 Request processed in 699us (1008us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1782222173.082372:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 62 00000020:00080000:3.0:1782222173.082378:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1782222173.097479:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222173.097529:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222173.097631:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060724352 00000100:00100000:2.0:1782222173.097641:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060724352 00000100:00100000:2.0:1782222173.097709:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 386 00000100:00100000:2.0:1782222173.097719:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08672c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2388:x1868795060724352:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222173.097786:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08672c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2388:x1868795060724352:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 69us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222173.097793:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 386 00000100:00100000:3.0:1782222173.099430:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222173.099460:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222173.099482:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222173.100081:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060724864 00000100:00100000:0.0:1782222173.100091:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060724864 00000100:00100000:0.0:1782222173.100167:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060724480 00000100:00100000:0.0:1782222173.100171:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060724480 00000100:00100000:0.0:1782222173.100205:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060724736 00000100:00100000:0.0:1782222173.100209:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060724736 00000100:00100000:0.0:1782222173.100227:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 304 00000100:00100000:0.0:1782222173.100261:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08526a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2388:x1868795060724864:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222173.100332:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08526a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2388:x1868795060724864:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 97us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222173.100339:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 304 00000100:00100000:0.0:1782222173.100356:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 305 00000100:00100000:0.0:1782222173.100362:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08526a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+5:2388:x1868795060724480:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222173.100386:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08526a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+5:2388:x1868795060724480:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 24us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222173.100392:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 305 00000100:00100000:0.0:1782222173.100405:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 306 00000100:00100000:0.0:1782222173.100410:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08526a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2388:x1868795060724736:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222173.100431:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08526a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2388:x1868795060724736:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 21us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222173.100455:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 306 00000100:00080000:3.0:1782222173.103372:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782222173.103383:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782222173.105312:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060724608 00000100:00100000:1.0:1782222173.105324:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060724608 00000100:00100000:1.0:1782222173.105439:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 143 00000100:00100000:1.0:1782222173.105449:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08526a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77bf2c2c-f408-43f9-ae59-449550631d05+7:2388:x1868795060724608:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222173.105538:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08526a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77bf2c2c-f408-43f9-ae59-449550631d05+7:2388:x1868795060724608:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 91us (8008us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222173.105545:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 143 00000100:00100000:3.0:1782222173.353528:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222173.353645:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060724992 00000100:00100000:0.0:1782222173.353655:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060724992 00000100:00100000:0.0:1782222173.353737:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 63 00000100:00100000:0.0:1782222173.353749:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087701a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+42:11224:x1868795060724992:12345-192.168.203.27@tcp:101:stat.0 00010000:00010000:0.0:1782222173.353774:0:13817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222173.353793:0:13817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031600/0xe2b7cc26e68116ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755849e expref: -99 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.353859:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030800/0xe2b7cc26e68116f4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.353873:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030800/0xe2b7cc26e68116f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.353884:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030800/0xe2b7cc26e68116f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.353895:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030e00/0xe2b7cc26e68116fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.353903:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030e00/0xe2b7cc26e68116fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.353910:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030e00/0xe2b7cc26e68116fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.353989:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030a00/0xe2b7cc26e6811702 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.354019:0:13817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e68116ca lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558490 expref: 43 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.354027:0:13817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030a00/0xe2b7cc26e6811702 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.354059:0:13817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e68116ca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558490 expref: 43 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.354073:0:13817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e68116ca lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558490 expref: 43 pid: 8465 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222173.354086:0:13817:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08412aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13817:1868795081793280:192.168.203.27@tcp:104: 00000100:00100000:0.0:1782222173.354166:0:13817:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875edfa80 going to sleep for 11 seconds 00000100:00100000:2.0:1782222173.357597:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222173.357721:0:13817:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08412aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13817:1868795081793280:192.168.203.27@tcp:104: 00010000:00010000:0.0:1782222173.357748:0:13817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030a00/0xe2b7cc26e6811702 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222173.357866:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060725248 00000100:00100000:1.0:1782222173.357874:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060725248 00000100:00100000:1.0:1782222173.357927:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 13 00000100:00100000:1.0:1782222173.357935:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+44:6159:x1868795060725248:12345-192.168.203.27@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1782222173.358637:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+45:6159:x1868795060725248:12345-192.168.203.27@tcp:35:ldlm_bl.0 Request processed in 698us (1044us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1782222173.358650:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 13 00000100:00100000:1.0:1782222173.361945:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222173.362064:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060725376 00000100:00100000:3.0:1782222173.362073:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060725376 00010000:00010000:3.0:1782222173.362118:0:9532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e68116ca lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558490 expref: 45 pid: 8465 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222173.362207:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 56 00000100:00100000:3.0:1782222173.362216:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08516d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77bf2c2c-f408-43f9-ae59-449550631d05+45:2389:x1868795060725376:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782222173.362231:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222173.362274:0:9532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e68116ca lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558490 expref: 45 pid: 8465 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.362288:0:9532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e68116ca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558490 expref: 45 pid: 8465 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.362321:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e68116ca lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558490 expref: 45 pid: 8465 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.362335:0:9532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f08491d6600) 00010000:00010000:3.0:1782222173.362341:0:9532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030a00/0xe2b7cc26e6811702 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.362350:0:9532:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030a00/0xe2b7cc26e6811702 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.362357:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030a00/0xe2b7cc26e6811702 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.362376:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782222173.362430:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08516d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77bf2c2c-f408-43f9-ae59-449550631d05+44:2389:x1868795060725376:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 215us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222173.362437:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 56 00010000:00010000:0.0:1782222173.362496:0:13817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030a00/0xe2b7cc26e6811702 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.362504:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030a00/0xe2b7cc26e6811702 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782222173.362555:0:13817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1782222173.362558:0:13817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782222173.362591:0:13817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030a00/0xe2b7cc26e6811702 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.362612:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030a00/0xe2b7cc26e6811702 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.362623:0:13817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030800/0xe2b7cc26e68116f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.362630:0:13817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030800/0xe2b7cc26e68116f4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.362637:0:13817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030800/0xe2b7cc26e68116f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.362642:0:13817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0840030800 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222173.362646:0:13817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030800/0xe2b7cc26e68116f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.362653:0:13817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030800/0xe2b7cc26e68116f4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.362662:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f0849b72000) 00010000:00010000:0.0:1782222173.362664:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782222173.362668:0:13817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030800/0xe2b7cc26e68116f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.362673:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030800/0xe2b7cc26e68116f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.362684:0:13817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030e00/0xe2b7cc26e68116fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.362690:0:13817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030e00/0xe2b7cc26e68116fb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.362714:0:13817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030e00/0xe2b7cc26e68116fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.362720:0:13817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0840030e00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222173.362722:0:13817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030e00/0xe2b7cc26e68116fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.362728:0:13817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030e00/0xe2b7cc26e68116fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.362735:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f087f8f2000) 00010000:00010000:0.0:1782222173.362737:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782222173.362740:0:13817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030e00/0xe2b7cc26e68116fb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.362745:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030e00/0xe2b7cc26e68116fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.362772:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031600/0xe2b7cc26e68116ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755849e expref: 44 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.362786:0:13817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030a00/0xe2b7cc26e6811702 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755849e expref: 43 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.362793:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f08491d6600) 00010000:00010000:0.0:1782222173.362795:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782222173.362797:0:13817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0840030a00, rc 0) 00000100:00100000:0.0:1782222173.362819:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087701a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+43:11224:x1868795060724992:12345-192.168.203.27@tcp:101:stat.0 Request processed in 9074us (9304us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222173.362834:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 63 00000100:00100000:0.0:1782222173.434347:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222173.434433:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060725632 00000100:00100000:3.0:1782222173.434442:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060725632 00000100:00100000:3.0:1782222173.434503:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 64 00000100:00100000:3.0:1782222173.434514:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+43:11230:x1868795060725632:12345-192.168.203.27@tcp:36:truncate.0 00010000:00010000:3.0:1782222173.434584:0:6528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222173.434622:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840030a00/0xe2b7cc26e6811702 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755849e expref: 43 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.434643:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f08491d6600) 00010000:00010000:3.0:1782222173.434648:0:6528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782222173.434838:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e6811709 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.434852:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e6811709 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.434862:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e6811709 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782222173.434904:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:3.0:1782222173.434925:0:6528:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000431d3968 reply state 00000000cae1ba7b transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e6811709 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.434938:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e6811709 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.434944:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f08491d6600) 00010000:00010000:3.0:1782222173.434962:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782222173.434964:0:6528:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782222173.435075:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+45:11230:x1868795060725632:12345-192.168.203.27@tcp:36:truncate.0 Request processed in 562us (737us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1782222173.435083:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 64 00000020:00080000:3.0:1782222173.435088:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1782222173.651467:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222173.651592:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060725760 00000100:00100000:2.0:1782222173.651603:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060725760 00000100:00100000:2.0:1782222173.651668:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 65 00000100:00100000:2.0:1782222173.651679:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08516d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+45:11244:x1868795060725760:12345-192.168.203.27@tcp:101:stat.0 00010000:00010000:2.0:1782222173.651711:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222173.651733:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6811710 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75584a5 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222173.651797:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811717 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222173.651827:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811717 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222173.651838:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811717 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222173.651851:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e681171e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222173.651858:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e681171e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222173.651864:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e681171e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222173.651934:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811725 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222173.651943:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811725 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222173.651965:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811725 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782222173.652008:0:8465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1782222173.652012:0:8465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782222173.652037:0:8465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811725 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222173.652048:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811725 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222173.652066:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811717 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222173.652072:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811717 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222173.652079:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811717 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222173.652085:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83c00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222173.652090:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811717 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222173.652109:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811717 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222173.652124:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f0849b72000) 00010000:00010000:2.0:1782222173.652138:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782222173.652144:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811717 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222173.652150:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811717 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222173.652162:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e681171e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222173.652417:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e681171e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222173.652426:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e681171e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222173.652439:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb82800 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222173.652442:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e681171e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222173.652448:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e681171e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222173.652457:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f087f8f2000) 00010000:00010000:2.0:1782222173.652460:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782222173.652463:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e681171e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222173.652469:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e681171e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222173.652499:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6811710 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584a5 expref: 47 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222173.652512:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811725 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584a5 expref: 46 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222173.652519:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f08491d6600) 00010000:00010000:2.0:1782222173.652521:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782222173.652524:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb82600, rc 0) 00000100:00100000:2.0:1782222173.652585:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08516d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+46:11244:x1868795060725760:12345-192.168.203.27@tcp:101:stat.0 Request processed in 907us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222173.652594:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 65 00000100:00100000:3.0:1782222173.674629:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081793664:0@lo:400:kworker.0 00000100:00100000:3.0:1782222173.674735:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222173.674774:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1868795081794176:0@lo:400:kworker.0 00000100:00100000:3.0:1782222173.674801:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222173.674816:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1868795081794688:0@lo:400:kworker.0 00000100:00100000:3.0:1782222173.674834:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222173.674856:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1782222173.674869:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1868795081793536:0@lo:400:kworker.0 00000100:00100000:3.0:1782222173.674891:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222173.674908:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1868795081794048:0@lo:400:kworker.0 00000100:00100000:3.0:1782222173.674927:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222173.674941:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1868795081794560:0@lo:400:kworker.0 00000100:00100000:3.0:1782222173.674980:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222173.675012:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081793664 00000100:00100000:3.0:1782222173.675019:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081793664 00000100:00100000:3.0:1782222173.675064:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1782222173.675073:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081793664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222173.675124:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081793664:12345-0@lo:400:kworker.0 Request processed in 52us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222173.675147:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1782222173.675289:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081793792:0@lo:400:kworker.0 00000100:00100000:0.0:1782222173.675321:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222173.675339:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081794304:0@lo:400:kworker.0 00000100:00100000:0.0:1782222173.675363:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222173.675383:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b785880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081794816:0@lo:400:kworker.0 00000100:00100000:0.0:1782222173.675403:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222173.675420:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1782222173.675425:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081793408:0@lo:400:kworker.0 00000100:00100000:0.0:1782222173.675448:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222173.675471:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1868795081793920:0@lo:400:kworker.0 00000100:00100000:0.0:1782222173.675491:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222173.675502:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081794432:0@lo:400:kworker.0 00000100:00100000:0.0:1782222173.675521:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222173.675535:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081794944:0@lo:400:kworker.0 00000100:00100000:0.0:1782222173.675554:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222173.675579:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081794304 00000100:00100000:0.0:1782222173.675583:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081794304 00000100:00100000:0.0:1782222173.675608:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081794816 00000100:00100000:0.0:1782222173.675611:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081794816 00000100:00100000:0.0:1782222173.675632:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081794432 00000100:00100000:0.0:1782222173.675634:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081794432 00000100:00100000:0.0:1782222173.675645:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081794944 00000100:00100000:0.0:1782222173.675647:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081794944 00000100:00100000:0.0:1782222173.675660:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1782222173.675679:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081794304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222173.675717:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081794304:12345-0@lo:400:kworker.0 Request processed in 39us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222173.675723:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1782222173.675736:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1782222173.675742:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081794816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222173.675765:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081794816:12345-0@lo:400:kworker.0 Request processed in 24us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222173.675771:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1782222173.675782:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1782222173.675787:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081794432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222173.675812:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081794432:12345-0@lo:400:kworker.0 Request processed in 26us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222173.675817:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1782222173.675827:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1782222173.675832:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3655:x1868795081794944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222173.675852:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3655:x1868795081794944:12345-0@lo:400:kworker.0 Request processed in 21us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222173.675857:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:0.0:1782222173.675869:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782222173.675895:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081794432:0@lo:400:kworker.0 00000100:00100000:0.0:1782222173.675905:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081794944:0@lo:400:kworker.0 00000100:00100000:0.0:1782222173.675913:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081794304:0@lo:400:kworker.0 00000100:00100000:0.0:1782222173.675922:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b785880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081794816:0@lo:400:kworker.0 00000100:00100000:0.0:1782222173.675982:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081794176 00000100:00100000:0.0:1782222173.675986:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081794176 00000100:00080000:0.0:1782222173.676001:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782222173.676017:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081794688 00000100:00100000:0.0:1782222173.676020:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081794688 00000100:00080000:0.0:1782222173.676029:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782222173.676038:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081793536 00000100:00100000:0.0:1782222173.676040:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081793536 00000100:00100000:0.0:1782222173.676049:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081794048 00000100:00100000:0.0:1782222173.676051:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081794048 00000100:00080000:0.0:1782222173.676059:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782222173.676069:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081794560 00000100:00100000:0.0:1782222173.676071:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081794560 00000100:00080000:0.0:1782222173.676081:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782222173.676091:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081793920 00000100:00100000:0.0:1782222173.676093:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081793920 00000100:00100000:0.0:1782222173.676105:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1782222173.676110:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1868795081794176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222173.676141:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1868795081794176:12345-0@lo:400:kworker.0 Request processed in 31us (1340us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222173.676147:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1782222173.676158:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1782222173.676163:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1868795081794688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222173.676202:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1868795081794688:12345-0@lo:400:kworker.0 Request processed in 39us (1367us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222173.676208:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1782222173.676218:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1782222173.676223:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1868795081793536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222173.676299:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1868795081793536:12345-0@lo:400:kworker.0 Request processed in 75us (1406us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222173.676310:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1782222173.676322:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1782222173.676327:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1868795081794048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222173.676353:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1868795081794048:12345-0@lo:400:kworker.0 Request processed in 27us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222173.676358:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1782222173.676367:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1782222173.676372:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1868795081794560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222173.676393:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1868795081794560:12345-0@lo:400:kworker.0 Request processed in 21us (1412us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222173.676398:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1782222173.676408:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1782222173.676413:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1868795081793920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222173.679420:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1868795081793536:0@lo:400:kworker.0 00000100:00100000:3.0:1782222173.679441:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1868795081794048:0@lo:400:kworker.0 00000100:00100000:3.0:1782222173.679453:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1868795081794560:0@lo:400:kworker.0 00000100:00100000:3.0:1782222173.679464:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081793664:0@lo:400:kworker.0 00010000:00080000:3.0:1782222173.679477:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0875aaf800 x1868795081794176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222173.679486:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1868795081794176:0@lo:400:kworker.0 00010000:00080000:3.0:1782222173.679496:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0875aae300 x1868795081794688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222173.679505:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1868795081794688:0@lo:400:kworker.0 00000100:00100000:0.0:1782222173.680091:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1868795081793920:12345-0@lo:400:kworker.0 Request processed in 29us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222173.680109:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1782222173.680182:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1868795081793920:0@lo:400:kworker.0 00000100:00100000:1.0:1782222173.680802:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081793408 00000100:00100000:1.0:1782222173.680810:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081793408 00000100:00100000:1.0:1782222173.680871:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1782222173.680891:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3655:x1868795081793408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222173.680998:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3655:x1868795081793408:12345-0@lo:400:kworker.0 Request processed in 109us (5547us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222173.681004:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1782222173.681051:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081793792 00000100:00100000:1.0:1782222173.681055:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081793792 00000100:00100000:1.0:1782222173.681079:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1782222173.681086:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081793792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222173.681121:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081793792:12345-0@lo:400:kworker.0 Request processed in 37us (5800us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222173.681139:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1782222173.681503:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081793408:0@lo:400:kworker.0 00000100:00100000:0.0:1782222173.681518:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081793792:0@lo:400:kworker.0 00000100:00100000:1.0:1782222173.735416:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222173.735512:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060726016 00000100:00100000:3.0:1782222173.735521:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060726016 00000100:00100000:3.0:1782222173.735580:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 66 00000100:00100000:3.0:1782222173.735589:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08516d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+46:11254:x1868795060726016:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1782222173.735608:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222173.735626:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e681172c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75584ac expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782222173.735715:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1782222173.735938:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e681172c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584ac expref: 48 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.735961:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0851377900) 00010000:00010000:3.0:1782222173.735964:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782222173.735968:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e681172c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584ac expref: 48 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.735981:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746431600, rc 0) 00000100:00100000:3.0:1782222173.736066:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08516d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+47:11254:x1868795060726016:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 478us (659us total) trans 4294967341 rc 301/301 00000100:00100000:3.0:1782222173.736073:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 66 00010000:00010000:3.0:1782222173.738364:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222173.747646:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222173.747786:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060726272 00000100:00100000:2.0:1782222173.747807:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060726272 00000100:00100000:2.0:1782222173.747867:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 14 00000100:00100000:2.0:1782222173.747877:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+47:11254:x1868795060726272:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:2.0:1782222173.748154:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+48:11254:x1868795060726272:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 278us (516us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1782222173.748162:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 14 00000100:00100000:1.0:1782222173.791869:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222173.792018:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060726528 00000100:00100000:3.0:1782222173.792029:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060726528 00000100:00100000:3.0:1782222173.792195:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 67 00000100:00100000:3.0:1782222173.792206:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08516d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+48:11260:x1868795060726528:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:3.0:1782222173.792272:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222173.792294:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e681173a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75584b3 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.792412:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811741 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.792427:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811725 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584a5 expref: 49 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.792436:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811741 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.792469:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811725 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584a5 expref: 49 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.792482:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811725 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584a5 expref: 49 pid: 8465 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222173.792496:0:8465:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08485a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8465:1868795081795072:192.168.203.27@tcp:104: 00000100:00100000:3.0:1782222173.792723:0:8465:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08492a1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782222173.795270:0:8465:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08485a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8465:1868795081795072:192.168.203.27@tcp:104: 00010000:00010000:3.0:1782222173.795303:0:8465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811741 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222173.797308:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222173.797976:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060726656 00000100:00100000:0.0:1782222173.797988:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060726656 00010000:00010000:0.0:1782222173.798032:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811725 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584a5 expref: 50 pid: 8465 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222173.798153:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 57 00000100:00100000:0.0:1782222173.798176:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08429ab850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77bf2c2c-f408-43f9-ae59-449550631d05+50:2389:x1868795060726656:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782222173.798194:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222173.798201:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811725 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584a5 expref: 50 pid: 8465 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.798215:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811725 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584a5 expref: 50 pid: 8465 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.798268:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811725 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584a5 expref: 50 pid: 8465 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.798285:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f08491d6600) 00010000:00010000:0.0:1782222173.798290:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811741 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.798299:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811741 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.798307:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811741 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.798340:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782222173.798410:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08429ab850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77bf2c2c-f408-43f9-ae59-449550631d05+49:2389:x1868795060726656:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 248us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222173.798419:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 57 00010000:00010000:3.0:1782222173.798515:0:8465:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811741 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.798523:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811741 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782222173.798549:0:8465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1782222173.798685:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e681173a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584b3 expref: 50 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.798712:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811741 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584b3 expref: 49 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.798720:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f08491d6600) 00010000:00010000:3.0:1782222173.798723:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782222173.798725:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746431c00, rc 0) 00000100:00100000:3.0:1782222173.798768:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08516d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+49:11260:x1868795060726528:12345-192.168.203.27@tcp:101:bash.0 Request processed in 6564us (6986us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1782222173.798775:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 67 00000100:00100000:1.0:1782222173.801056:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222173.801185:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060726912 00000100:00100000:3.0:1782222173.801195:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060726912 00000100:00100000:3.0:1782222173.801270:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 68 00000100:00100000:3.0:1782222173.801279:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08516d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+49:11260:x1868795060726912:12345-192.168.203.27@tcp:36:bash.0 00010000:00010000:3.0:1782222173.801600:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e681174f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.801616:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e681174f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.801627:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e681174f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782222173.801671:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:3.0:1782222173.801878:0:6528:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000afa95891 reply state 000000000e15caaf transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e681174f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.801893:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e681174f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.801901:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f08491d6600) 00010000:00010000:3.0:1782222173.801903:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782222173.801906:0:6528:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782222173.802073:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08516d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+52:11260:x1868795060726912:12345-192.168.203.27@tcp:36:bash.0 Request processed in 794us (1023us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1782222173.802081:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 68 00000020:00080000:3.0:1782222173.802086:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1782222173.817473:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222173.817670:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060727040 00000100:00100000:3.0:1782222173.817681:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060727040 00000100:00100000:3.0:1782222173.817811:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 69 00000100:00100000:3.0:1782222173.817821:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+52:11260:x1868795060727040:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:3.0:1782222173.817845:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222173.817863:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e6811756 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75584ba expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.817964:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e681175d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.817986:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811741 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584b3 expref: 53 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.817995:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e681175d lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.818028:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811741 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584b3 expref: 53 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.818051:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811741 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584b3 expref: 53 pid: 8465 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222173.818063:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08485a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6527:1868795081795200:192.168.203.27@tcp:104: 00000100:00100000:3.0:1782222173.818192:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08492a1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782222173.827780:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08485a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6527:1868795081795200:192.168.203.27@tcp:104: 00010000:00010000:3.0:1782222173.827812:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e681175d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222173.827985:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222173.828104:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060727168 00000100:00100000:3.0:1782222173.828111:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060727168 00010000:00010000:3.0:1782222173.828589:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811741 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584b3 expref: 54 pid: 8465 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222173.828633:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 58 00000100:00100000:3.0:1782222173.828643:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77bf2c2c-f408-43f9-ae59-449550631d05+54:2390:x1868795060727168:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782222173.828658:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222173.828664:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811741 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584b3 expref: 54 pid: 8465 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.828676:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811741 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584b3 expref: 54 pid: 8465 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.828698:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811741 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584b3 expref: 54 pid: 8465 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.828734:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f08491d6600) 00010000:00010000:3.0:1782222173.828739:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e681175d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.828749:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e681175d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.828757:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e681175d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.828776:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782222173.828901:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e681175d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.828916:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e681175d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782222173.829055:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1782222173.829060:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782222173.829084:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e681175d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.829269:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e6811756 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584ba expref: 54 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.829285:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e681175d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584ba expref: 53 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.829292:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f08491d6600) 00010000:00010000:0.0:1782222173.829295:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782222173.829298:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746431200, rc 0) 00000100:00100000:0.0:1782222173.829605:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+53:11260:x1868795060727040:12345-192.168.203.27@tcp:101:bash.0 Request processed in 11783us (12138us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222173.829615:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 69 00000100:00100000:3.0:1782222173.829725:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77bf2c2c-f408-43f9-ae59-449550631d05+52:2390:x1868795060727168:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 1082us (1740us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222173.829733:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 58 00000100:00100000:2.0:1782222173.837501:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222173.837595:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060727424 00000100:00100000:3.0:1782222173.837606:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060727424 00000100:00100000:3.0:1782222173.837666:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 15 00000100:00100000:3.0:1782222173.837677:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087d4bbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+52:11260:x1868795060727424:12345-192.168.203.27@tcp:35:bash.0 00000100:00100000:3.0:1782222173.837904:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087d4bbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+53:11260:x1868795060727424:12345-192.168.203.27@tcp:35:bash.0 Request processed in 228us (413us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1782222173.837912:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 15 00000100:00100000:1.0:1782222173.937816:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222173.937991:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060727680 00000100:00100000:3.0:1782222173.938003:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060727680 00000100:00100000:3.0:1782222173.938067:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 70 00000100:00100000:3.0:1782222173.938078:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08516d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+53:11270:x1868795060727680:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1782222173.938114:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222173.938147:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811764 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75584c1 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782222173.938291:0:8465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1782222173.938393:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811764 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584c1 expref: 55 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.938408:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0851377900) 00010000:00010000:3.0:1782222173.938411:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782222173.938416:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811764 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584c1 expref: 55 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.938431:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746431c00, rc 0) 00000100:00100000:3.0:1782222173.938548:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08516d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+54:11270:x1868795060727680:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 472us (741us total) trans 4294967347 rc 301/301 00000100:00100000:3.0:1782222173.938556:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 70 00000100:00100000:1.0:1782222173.943443:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222173.943541:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060727808 00000100:00100000:3.0:1782222173.943551:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060727808 00000100:00100000:3.0:1782222173.943644:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 71 00000100:00100000:3.0:1782222173.943654:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08516d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+54:11270:x1868795060727808:12345-192.168.203.27@tcp:34:lfs.0 00010000:00010000:3.0:1782222173.943746:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e6811772 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.943762:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e6811772 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.943773:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e6811772 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.943801:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811779 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.943808:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811779 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.943815:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811779 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.943887:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811780 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.943896:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811780 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.943903:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811780 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782222173.943961:0:6528:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811780 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.944048:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e6811772 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.944057:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e6811772 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.944064:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e6811772 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.944070:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746431000 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222173.944074:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e6811772 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.944089:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e6811772 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.944166:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f0849b72000) 00010000:00010000:3.0:1782222173.944258:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222173.944266:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e6811772 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.944272:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e6811772 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.944287:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811779 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.944292:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811779 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.944298:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811779 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.944303:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746430e00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222173.944305:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811779 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.944311:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811779 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.944319:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f087f8f2000) 00010000:00010000:3.0:1782222173.944323:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222173.944326:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811779 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.944340:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811779 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.944352:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811780 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.944357:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811780 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.944363:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811780 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.944368:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746430000 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222173.944371:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811780 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.944377:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811780 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.944385:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f08491d6600) 00010000:00010000:3.0:1782222173.944387:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222173.944391:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811780 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.944397:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811780 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222173.944522:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08516d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+54:11270:x1868795060727808:12345-192.168.203.27@tcp:34:lfs.0 Request processed in 867us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222173.944532:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 71 00000100:00100000:1.0:1782222173.946934:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222173.947281:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060728064 00000100:00100000:3.0:1782222173.947290:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060728064 00000100:00100000:3.0:1782222173.947338:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 16 00000100:00100000:3.0:1782222173.947347:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08516d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+54:11270:x1868795060728064:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:3.0:1782222173.947580:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08516d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+55:11270:x1868795060728064:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 233us (654us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1782222173.947588:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 16 00000100:00100000:1.0:1782222173.985536:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222173.985633:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060728320 00000100:00100000:0.0:1782222173.985643:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060728320 00000100:00100000:0.0:1782222173.985886:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 72 00000100:00100000:0.0:1782222173.985897:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08516d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+55:11273:x1868795060728320:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:0.0:1782222173.985922:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222173.985951:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8e00/0xe2b7cc26e6811787 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75584c8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.986046:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8000/0xe2b7cc26e681178e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.986060:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8000/0xe2b7cc26e681178e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.986072:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8000/0xe2b7cc26e681178e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.986083:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6811795 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.986090:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6811795 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.986107:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6811795 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222173.986650:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e681179c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222173.986662:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e681179c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222173.986670:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e681179c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782222173.986682:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1782222173.986791:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8000/0xe2b7cc26e681178e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222173.986799:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8000/0xe2b7cc26e681178e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222173.986805:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8000/0xe2b7cc26e681178e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222173.986810:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb8000 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222173.986814:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8000/0xe2b7cc26e681178e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222173.986822:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8000/0xe2b7cc26e681178e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222173.986833:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f0849b72000) 00010000:00010000:1.0:1782222173.986835:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222173.986839:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8000/0xe2b7cc26e681178e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222173.986845:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8000/0xe2b7cc26e681178e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222173.986856:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6811795 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222173.986861:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6811795 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222173.986866:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6811795 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222173.986871:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb8200 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222173.986880:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6811795 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222173.986886:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6811795 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222173.986894:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f087f8f2000) 00010000:00010000:1.0:1782222173.986896:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222173.986899:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6811795 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222173.986904:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6811795 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222173.986961:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8e00/0xe2b7cc26e6811787 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584c8 expref: 58 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222173.986975:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e681179c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584c8 expref: 57 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222173.986981:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f08491d6600) 00010000:00010000:1.0:1782222173.986983:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782222173.986986:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744da00, rc 0) 00000100:00100000:1.0:1782222173.987054:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08516d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+57:11273:x1868795060728320:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 1159us (1527us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1782222173.987062:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 72 00000100:00100000:1.0:1782222173.991118:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222173.991164:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222173.991301:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060728448 00000100:00100000:0.0:1782222173.991311:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060728448 00000100:00100000:0.0:1782222173.991366:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 73 00000100:00100000:0.0:1782222173.991376:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08516d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+57:11273:x1868795060728448:12345-192.168.203.27@tcp:54:lfs.0 00010000:00010000:0.0:1782222173.991442:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8a00/0xe2b7cc26e68117aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.991460:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8a00/0xe2b7cc26e68117aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.991471:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8a00/0xe2b7cc26e68117aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.991526:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8a00/0xe2b7cc26e68117aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.991534:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8a00/0xe2b7cc26e68117aa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.991541:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8a00/0xe2b7cc26e68117aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.991547:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb8a00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222173.991551:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8a00/0xe2b7cc26e68117aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.991558:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8a00/0xe2b7cc26e68117aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.991570:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f08491d6600) 00010000:00010000:0.0:1782222173.991573:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782222173.991578:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8a00/0xe2b7cc26e68117aa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222173.991584:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8a00/0xe2b7cc26e68117aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222173.991664:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08516d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+57:11273:x1868795060728448:12345-192.168.203.27@tcp:54:lfs.0 Request processed in 289us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222173.991672:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 73 00000100:00100000:3.0:1782222173.992182:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060728576 00000100:00100000:3.0:1782222173.992189:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060728576 00000100:00100000:3.0:1782222173.992267:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 5 00000100:00100000:3.0:1782222173.992277:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08516d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+57:2390:x1868795060728576:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782222173.992304:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222173.992321:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e681179c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584c8 expref: 57 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222173.992333:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f08491d6600) 00010000:00010000:3.0:1782222173.992336:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782222173.992363:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08516d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+56:2390:x1868795060728576:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 88us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222173.992369:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 5 00000100:00100000:1.0:1782222173.995837:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222173.995922:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060728832 00000100:00100000:3.0:1782222173.995932:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060728832 00000100:00100000:3.0:1782222173.995997:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 17 00000100:00100000:3.0:1782222173.996007:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08516d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+56:11273:x1868795060728832:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:3.0:1782222173.996272:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08516d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+57:11273:x1868795060728832:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 266us (442us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1782222173.996297:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 17 00000100:00100000:2.0:1782222174.124965:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222174.125055:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060729088 00000100:00100000:3.0:1782222174.125065:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060729088 00000100:00100000:3.0:1782222174.125135:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 74 00000100:00100000:3.0:1782222174.125146:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+57:11291:x1868795060729088:12345-192.168.203.27@tcp:101:cat.0 00010000:00010000:3.0:1782222174.125180:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222174.125200:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e68117b1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75584cf expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.125355:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e68117b8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.125371:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e68117b8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.125382:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e68117b8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782222174.125406:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1782222174.125513:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e68117b1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584cf expref: 60 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.125533:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e68117b8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584cf expref: 59 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.125541:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f08491d6600) 00010000:00010000:3.0:1782222174.125544:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1782222174.125546:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746430e00, rc 0) 00000100:00100000:3.0:1782222174.125621:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+59:11291:x1868795060729088:12345-192.168.203.27@tcp:101:cat.0 Request processed in 476us (664us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1782222174.125629:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 74 00000100:00100000:2.0:1782222174.154078:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222174.154276:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060729216 00000100:00100000:1.0:1782222174.154300:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060729216 00000100:00100000:1.0:1782222174.154368:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 75 00000100:00100000:1.0:1782222174.154378:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+59:11292:x1868795060729216:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:1.0:1782222174.154401:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222174.154423:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68117c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75584d6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.154495:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e68117cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.154510:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e68117cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.154520:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e68117cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782222174.154562:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1782222174.154566:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782222174.154585:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e68117cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.154612:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68117c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584d6 expref: 61 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.154630:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e68117cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584d6 expref: 60 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.154638:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f0849b72000) 00010000:00010000:1.0:1782222174.154641:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782222174.154644:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744da00, rc 0) 00000100:00100000:1.0:1782222174.154719:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+60:11292:x1868795060729216:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 341us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222174.154727:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 75 00000100:00100000:1.0:1782222174.161368:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222174.161453:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060729600 00000100:00100000:3.0:1782222174.161464:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060729600 00000100:00100000:3.0:1782222174.161526:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 18 00000100:00100000:3.0:1782222174.161536:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08516d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+60:11292:x1868795060729600:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:3.0:1782222174.161826:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08516d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+61:11292:x1868795060729600:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 291us (465us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1782222174.161834:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 18 00000100:00100000:2.0:1782222174.164055:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222174.164162:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060729728 00000100:00100000:1.0:1782222174.164180:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060729728 00000100:00100000:1.0:1782222174.164270:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 6 00000100:00100000:1.0:1782222174.164280:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77bf2c2c-f408-43f9-ae59-449550631d05+61:11292:x1868795060729728:12345-192.168.203.27@tcp:103:lfs.0 00010000:00010000:1.0:1782222174.164294:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1782222174.164317:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e681175d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584ba expref: 61 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.164340:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e68117b8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584cf expref: 60 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.164352:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e681165a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558474 expref: 59 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.164361:0:9532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f08491d6600) 00010000:00010000:1.0:1782222174.164365:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782222174.164422:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77bf2c2c-f408-43f9-ae59-449550631d05+58:11292:x1868795060729728:12345-192.168.203.27@tcp:103:lfs.0 Request processed in 142us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222174.164430:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 6 00000100:00100000:2.0:1782222174.166420:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222174.166510:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060729856 00000100:00100000:1.0:1782222174.166520:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060729856 00000100:00100000:1.0:1782222174.166576:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 76 00000100:00100000:1.0:1782222174.166585:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+58:11292:x1868795060729856:12345-192.168.203.27@tcp:58:lfs.0 00010000:00010000:1.0:1782222174.166729:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68117d4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.166746:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68117d4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.166755:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68117d4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782222174.167006:0:13817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782222174.167156:0:13817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1782222174.167273:0:13817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1782222174.170725:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+58:11292:x1868795060729856:12345-192.168.203.27@tcp:58:lfs.0 Request processed in 772us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222174.170740:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 76 00000100:00100000:2.0:1782222174.188362:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222174.188456:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060729984 00000100:00100000:3.0:1782222174.188467:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060729984 00000100:00100000:3.0:1782222174.188575:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 77 00000100:00100000:3.0:1782222174.188585:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+58:11294:x1868795060729984:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1782222174.188606:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222174.188627:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e68117db lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75584dd expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.188690:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e68117e2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.189003:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e68117e2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.189016:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e68117e2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.189029:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e68117e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.189053:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e68117e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.189060:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e68117e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.191051:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e68117f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.191071:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e68117f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.191082:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e68117f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782222174.191141:0:8465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1782222174.191145:0:8465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782222174.191164:0:8465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e68117f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.191186:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e68117f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.191195:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e68117e2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.191200:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e68117e2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.191206:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e68117e2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.191228:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746431000 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222174.191257:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e68117e2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.191266:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e68117e2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.191279:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f0849b72000) 00010000:00010000:3.0:1782222174.191282:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222174.191286:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e68117e2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.191292:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e68117e2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.191305:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e68117e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.191312:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e68117e9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.191318:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e68117e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.191322:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746431c00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222174.191324:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e68117e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.191329:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e68117e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.191349:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f087f8f2000) 00010000:00010000:3.0:1782222174.191351:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222174.191355:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e68117e9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.191360:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e68117e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.191397:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e68117db lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584dd expref: 60 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.191410:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e68117f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584dd expref: 59 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.191417:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f08491d6600) 00010000:00010000:3.0:1782222174.191420:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782222174.191422:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746430200, rc 0) 00000100:00100000:3.0:1782222174.191500:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+59:11294:x1868795060729984:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 2915us (3144us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222174.191509:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 77 00000001:00080000:2.0:1782222174.716758:0:6505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00010000:00010000:1.0:1782222174.716809:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811596 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.716828:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811596 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.716835:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811596 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782222174.716843:0:6505:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:1.0:1782222174.716843:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83200 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222174.716854:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811596 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1782222174.716866:0:6505:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f08492a1300 refcount 2 committed 0 result 0 batchid 1 00010000:00010000:1.0:1782222174.716867:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811596 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1782222174.716879:0:6505:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8f07474d6900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f08553296c0 00000020:00080000:2.0:1782222174.716885:0:6505:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8f07474d6200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f074740ba00 00010000:00010000:1.0:1782222174.716916:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8f0849b72f00) 00010000:00010000:1.0:1782222174.716920:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222174.716925:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811596 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.716932:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811596 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.716971:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e681159d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.716982:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e681159d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.716988:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e681159d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.716993:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83800 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222174.716997:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e681159d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.717002:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e681159d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.717010:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f0849b72000) 00010000:00010000:1.0:1782222174.717012:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222174.717015:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e681159d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.717020:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e681159d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.717059:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e68115dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.717066:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e68115dc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.717072:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e68115dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.717078:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746430c00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222174.717081:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e68115dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.717086:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e68115dc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.717095:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f087f8f2000) 00010000:00010000:1.0:1782222174.717097:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222174.717100:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e68115dc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.717106:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e68115dc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.717119:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e68116e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.717126:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e68116e6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.717131:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e68116e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.717141:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746431a00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222174.717145:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e68116e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.717151:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e68116e6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.717159:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f08491d6600) 00010000:00010000:1.0:1782222174.717161:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222174.717164:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e68116e6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.717170:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e68116e6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.717180:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e6811709 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.717186:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e6811709 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.717192:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e6811709 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.717197:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746430800 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222174.717200:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e6811709 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.717206:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e6811709 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.717224:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f08491d6600) 00010000:00010000:1.0:1782222174.717227:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222174.717231:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e6811709 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.717267:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e6811709 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.717278:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e681174f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.717285:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e681174f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.717290:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e681174f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.717296:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746430400 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222174.717298:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e681174f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.717304:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e681174f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.717315:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f08491d6600) 00010000:00010000:1.0:1782222174.717317:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222174.717320:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e681174f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222174.717325:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e681174f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1782222174.721327:0:6558:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1782222174.721624:0:6558:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1782222174.727454:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782222174.727484:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08412ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081795328:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782222174.727586:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222174.730670:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081795328 00000100:00100000:3.0:1782222174.730692:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081795328 00000100:00100000:3.0:1782222174.730904:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782222174.730929:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3654:x1868795081795328:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1782222174.730980:0:8443:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:3.0:1782222174.731015:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a3a8d5b, atime: 0x6a3a8d5b, ctime: 0x6a3a8d5b, blocks: 0x8 00010000:00010000:3.0:1782222174.731026:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000582ed91b/0xe2b7cc26e68117f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.731054:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=373s v=(0 0) 00010000:00010000:3.0:1782222174.731059:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782222174.731066:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000582ed91b/0xe2b7cc26e68117f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.731083:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000582ed91b/0xe2b7cc26e68117f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.731095:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000582ed91b/0xe2b7cc26e68117f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.731103:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000582ed91b/0xe2b7cc26e68117f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.732070:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782222174.732507:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3654:x1868795081795328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1587us (4918us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1782222174.732527:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000004:00080000:1.0:1782222174.732576:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f08412ab100/2, rc 0, transno 4294967302 00000100:00100000:1.0:1782222174.732597:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08412ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081795328:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782222174.735346:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782222174.735367:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000582ed91b/0xe2b7cc26e68117f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222174.735385:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746431c00 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:0.0:1782222174.735392:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000582ed91b/0xe2b7cc26e68117f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222174.735406:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000582ed91b/0xe2b7cc26e68117f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222174.735434:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000582ed91b/0xe2b7cc26e68117f7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222174.735442:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000582ed91b/0xe2b7cc26e68117f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222174.735476:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222174.735478:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222174.735480:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222174.762562:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782222174.830433:0:13806:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782222174.830445:0:13806:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782222174.830488:0:13806:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1782222174.830496:0:13806:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782222174.830630:0:13806:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08412ac700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1868795081795456:192.168.203.27@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782222174.830817:0:13806:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08428fc6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782222174.844946:0:13806:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08412ac700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1868795081795456:192.168.203.27@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1782222174.846346:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222174.846483:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060730112 00000100:00100000:2.0:1782222174.846492:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060730112 00000100:00100000:2.0:1782222174.846550:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 78 00000100:00100000:2.0:1782222174.846560:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+12:11305:x1868795060730112:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1782222174.846591:0:6526:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1782222174.846720:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+12:11305:x1868795060730112:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 Request processed in 160us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222174.846729:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 78 00000100:00100000:0.0:1782222174.857476:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222174.857604:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060730240 00000100:00100000:3.0:1782222174.857614:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060730240 00000100:00100000:3.0:1782222174.857673:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 79 00000100:00100000:3.0:1782222174.857684:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+12:11305:x1868795060730240:12345-192.168.203.27@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1782222174.857758:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e68117fe lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.857788:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e68117fe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.857800:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e68117fe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.857868:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e6811805 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.857876:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e6811805 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.857883:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e6811805 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.857914:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e681180c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.857922:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e681180c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.857929:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e681180c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782222174.857983:0:13817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1782222174.857987:0:13817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782222174.857999:0:13817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e681180c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.858010:0:13817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e68117fe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.858026:0:13817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e68117fe lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.858033:0:13817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e68117fe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.858045:0:13817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746430000 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222174.858049:0:13817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e68117fe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.858058:0:13817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e68117fe lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.858071:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f087f8f2900) 00010000:00010000:3.0:1782222174.858074:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222174.858078:0:13817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e68117fe lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.858084:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e68117fe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.858096:0:13817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e6811805 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.858103:0:13817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e6811805 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.858108:0:13817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e6811805 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.858113:0:13817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746431000 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222174.858123:0:13817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e6811805 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.858130:0:13817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e6811805 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.858140:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff8f087f8f1a00) 00010000:00010000:3.0:1782222174.858143:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222174.858145:0:13817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e6811805 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.858151:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e6811805 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.858166:0:13817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e681180c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.858172:0:13817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e681180c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.858178:0:13817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e681180c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.858183:0:13817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746431c00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222174.858186:0:13817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e681180c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.858192:0:13817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e681180c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.858200:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f08491d6600) 00010000:00010000:3.0:1782222174.858202:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222174.858212:0:13817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e681180c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.858219:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e681180c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222174.858324:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+12:11305:x1868795060730240:12345-192.168.203.27@tcp:34:lhsmtool_posix.0 Request processed in 641us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222174.858332:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 79 00000100:00100000:1.0:1782222174.862589:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222174.863137:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060730496 00000100:00100000:3.0:1782222174.863147:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060730496 00000100:00100000:3.0:1782222174.863216:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 80 00000100:00100000:3.0:1782222174.863226:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+12:11305:x1868795060730496:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782222174.863268:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222174.863287:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811813 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75584e4 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.863393:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e681181a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.863407:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e681181a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.863418:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e681181a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782222174.863430:0:8465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1782222174.863514:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e681181a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.863522:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e681181a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.863535:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e681181a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.863540:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746430800 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222174.863544:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e681181a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.863552:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e681181a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.863566:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f08491d6600) 00010000:00010000:3.0:1782222174.863569:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782222174.863573:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e681181a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.863579:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e681181a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.863619:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811813 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584e4 expref: 14 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.863629:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f087f8f2900) 00010000:00010000:3.0:1782222174.863631:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782222174.863635:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811813 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584e4 expref: 14 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.863644:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746430400, rc 0) 00000100:00100000:3.0:1782222174.863712:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+13:11305:x1868795060730496:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 487us (1132us total) trans 4294967353 rc 301/301 00000100:00100000:3.0:1782222174.863728:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 80 00000100:00100000:2.0:1782222174.870642:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222174.870738:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060730624 00000100:00100000:3.0:1782222174.870751:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060730624 00000100:00100000:3.0:1782222174.870812:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 81 00000100:00100000:3.0:1782222174.870822:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+13:11305:x1868795060730624:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1782222174.870858:0:6528:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1782222174.870998:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+13:11305:x1868795060730624:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 Request processed in 178us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222174.871006:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 81 00000100:00100000:1.0:1782222174.880530:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222174.880978:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060730880 00000100:00100000:0.0:1782222174.880989:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060730880 00000100:00100000:0.0:1782222174.881045:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 82 00000100:00100000:0.0:1782222174.881054:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+13:11305:x1868795060730880:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782222174.881076:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222174.881079:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782222174.881118:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e68117cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584d6 expref: 13 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222174.881137:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f0849b72000) 00010000:00010000:0.0:1782222174.881142:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782222174.881157:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e6811828 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75584eb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782222174.881565:0:6527:0:(osp_object.c:1673:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:0.0:1782222174.881726:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e681182f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222174.881739:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e681182f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222174.881749:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e681182f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222174.881802:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e6811828 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584eb expref: 15 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222174.881817:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e681182f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584eb expref: 14 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222174.881825:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f0851377c00) 00010000:00010000:0.0:1782222174.881827:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782222174.881830:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fcb9e00, rc 0) 00000100:00100000:0.0:1782222174.881897:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+14:11305:x1868795060730880:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 844us (1378us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1782222174.881916:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 82 00000100:00100000:0.0:1782222174.886815:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222174.905318:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060731136 00000100:00100000:3.0:1782222174.905334:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060731136 00000100:00100000:0.0:1782222174.905966:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 83 00000100:00100000:0.0:1782222174.905977:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+14:11305:x1868795060731136:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782222174.906035:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222174.906061:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e681182f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584eb expref: 14 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222174.906091:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f0851377c00) 00010000:00010000:0.0:1782222174.906099:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782222174.906121:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9400/0xe2b7cc26e681183d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222174.906134:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9400/0xe2b7cc26e681183d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222174.906144:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9400/0xe2b7cc26e681183d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222174.906157:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811844 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x8a69147a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222174.906175:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811844 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x8a69147a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222174.906181:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811844 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x8a69147a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222174.906223:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9400/0xe2b7cc26e681183d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222174.906268:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9400/0xe2b7cc26e681183d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222174.906274:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9400/0xe2b7cc26e681183d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222174.906280:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb9400 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222174.906463:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9400/0xe2b7cc26e681183d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222174.906472:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9400/0xe2b7cc26e681183d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222174.906481:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f0849b72000) 00010000:00010000:0.0:1782222174.906484:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782222174.906487:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9400/0xe2b7cc26e681183d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222174.906494:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9400/0xe2b7cc26e681183d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222174.906505:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811844 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x8a69147a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222174.906511:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811844 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x8a69147a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222174.906517:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811844 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x8a69147a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222174.906521:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb9a00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222174.906531:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811844 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x8a69147a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222174.906537:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811844 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x8a69147a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222174.906544:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x8a69147a (ffff8f0851377400) 00010000:00010000:0.0:1782222174.906547:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782222174.906549:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811844 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x8a69147a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222174.906555:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811844 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x8a69147a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222174.906642:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+13:11305:x1868795060731136:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 Request processed in 665us (19837us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782222174.906650:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 83 00000040:00080000:3.0:1782222174.908448:0:14219:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782222174.908456:0:14219:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782222174.908479:0:14219:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1782222174.908485:0:14219:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782222174.909748:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222174.915192:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060731264 00000100:00100000:3.0:1782222174.915206:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060731264 00000100:00100000:3.0:1782222174.915275:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 84 00000100:00100000:3.0:1782222174.915415:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+13:11305:x1868795060731264:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782222174.915434:0:13817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222174.915456:0:13817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e681184b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75584f2 expref: -99 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.915491:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e6811852 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.915506:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e6811852 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.915527:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e6811852 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.915626:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e681184b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584f2 expref: 15 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.915642:0:13817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e6811852 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584f2 expref: 14 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.915651:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:3.0:1782222174.915654:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782222174.915657:0:13817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746430800, rc 0) 00000100:00100000:3.0:1782222174.915721:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+14:11305:x1868795060731264:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 437us (5979us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222174.915728:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 84 00000100:00100000:3.0:1782222174.922657:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222174.922695:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060731520 00000100:00100000:3.0:1782222174.922706:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060731520 00000100:00100000:3.0:1782222174.922754:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 85 00000100:00100000:3.0:1782222174.922762:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+14:11305:x1868795060731520:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782222174.922846:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811859 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.922862:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811859 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.922873:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811859 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782222174.923062:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1782222174.923085:0:6527:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 373951835997ns, next at 374951833521ns, rc = 0 00000004:00010000:3.0:1782222174.923138:0:6527:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009de26dff reply state 00000000aa4cc966 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811859 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.923152:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811859 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.923159:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:3.0:1782222174.923162:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1782222174.923166:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782222174.923281:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+16:11305:x1868795060731520:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 Request processed in 518us (632us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1782222174.923430:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 85 00000100:00100000:3.0:1782222174.928654:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222174.928691:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060731648 00000100:00100000:3.0:1782222174.928700:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060731648 00000100:00100000:3.0:1782222174.928748:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 86 00000100:00100000:3.0:1782222174.928758:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+16:11305:x1868795060731648:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782222174.928782:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222174.928800:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e6811860 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75584f9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.928857:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e6811860 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584f9 expref: 17 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.928871:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e6811860 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584f9 expref: 17 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.928899:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:3.0:1782222174.928902:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782222174.928905:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746431000, rc 0) 00000100:00100000:3.0:1782222174.928968:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+17:11305:x1868795060731648:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 212us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222174.928975:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 86 00000100:00100000:3.0:1782222174.935579:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222174.935617:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060731776 00000100:00100000:3.0:1782222174.935628:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060731776 00000100:00100000:3.0:1782222174.935667:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 33 00000100:00100000:3.0:1782222174.935675:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2386:x1868795060731776:12345-192.168.203.27@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1782222174.935716:0:8440:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 77bf2c2c-f408-43f9-ae59-449550631d05@192.168.203.27@tcp t0 exp 0000000000000000 cur 373 last 0 00000020:00000080:3.0:1782222174.935744:0:8440:0:(genops.c:1406:class_connect()) connect: client 77bf2c2c-f408-43f9-ae59-449550631d05, cookie 0xe2b7cc26e6811867 00002000:00100000:3.0:1782222174.935757:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 77bf2c2c-f408-43f9-ae59-449550631d05/ffff8f0747d8d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782222174.935779:0:8440:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782222174.935857:0:8440:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1782222174.935887:0:8440:0:(import.c:65:import_set_state_nolock()) ffff8f0747d89000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782222174.935960:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77bf2c2c-f408-43f9-ae59-449550631d05+6:2386:x1868795060731776:12345-192.168.203.27@tcp:8:lhsmtool_posix.0 Request processed in 283us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222174.935968:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 33 00000100:00100000:1.0:1782222174.941572:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222174.941728:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060731904 00000100:00100000:0.0:1782222174.941738:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060731904 00000100:00100000:0.0:1782222174.941813:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 34 00000100:00100000:0.0:1782222174.941823:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+6:0:x1868795060731904:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1782222174.942978:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1782222174.976988:0:8436:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:1.0:1782222174.977006:0:8436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 77bf2c2c-f408-43f9-ae59-449550631d05 00000100:00100000:2.0:1782222174.977218:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+5:0:x1868795060731904:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 Request processed in 35388us (35645us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1782222174.977230:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 34 00000100:00100000:1.0:1782222174.984676:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222174.985051:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060732160 00000100:00100000:3.0:1782222174.985062:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060732160 00000100:00100000:3.0:1782222174.985122:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 19 00000100:00100000:3.0:1782222174.985133:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+17:11305:x1868795060732160:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1782222174.985381:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+18:11305:x1868795060732160:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 Request processed in 250us (714us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1782222174.985389:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 19 00000100:00100000:3.0:1782222174.989614:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222174.989693:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060732416 00000100:00100000:0.0:1782222174.989711:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060732416 00000100:00100000:0.0:1782222174.989865:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 87 00000100:00100000:0.0:1782222174.989879:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+18:11305:x1868795060732416:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1782222174.990053:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+18:11305:x1868795060732416:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 Request processed in 177us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222174.990062:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 87 00000100:00100000:3.0:1782222174.995538:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222174.995586:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060732544 00000100:00100000:3.0:1782222174.995599:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060732544 00000100:00100000:3.0:1782222174.995672:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 88 00000100:00100000:3.0:1782222174.995684:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+18:11305:x1868795060732544:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782222174.995716:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222174.995743:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e681186e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558500 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.995838:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811875 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.995854:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811875 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.995871:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811875 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782222174.995934:0:8465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782222174.995970:0:8465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811875 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.996002:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e681186e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558500 expref: 20 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.996047:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811875 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558500 expref: 19 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222174.996058:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:3.0:1782222174.996062:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1782222174.996067:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746430000, rc 0) 00000100:00100000:3.0:1782222174.996140:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+19:11305:x1868795060732544:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 458us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222174.996148:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 88 00000100:00100000:3.0:1782222174.999779:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222175.000378:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060732672 00000100:00100000:1.0:1782222175.000392:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060732672 00000100:00100000:1.0:1782222175.000472:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 35 00000100:00100000:1.0:1782222175.000484:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060732672:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782222175.000508:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222175.000533:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eed1730e/0xe2b7cc26e681187c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558507 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782222175.000566:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3a8d5e, blocks: 0x0 00010000:00010000:1.0:1782222175.000591:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=374s v=(0 0) 00010000:00010000:1.0:1782222175.000596:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222175.000608:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eed1730e/0xe2b7cc26e681187c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558507 expref: 6 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222175.000633:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eed1730e/0xe2b7cc26e681187c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558507 expref: 6 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222175.000659:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744ce00, rc 0) 00000100:00100000:1.0:1782222175.000735:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77bf2c2c-f408-43f9-ae59-449550631d05+6:2390:x1868795060732672:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 253us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222175.000744:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 35 00000100:00100000:3.0:1782222175.005026:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222175.005891:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060732928 00000100:00100000:1.0:1782222175.005908:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060732928 00000100:00100000:1.0:1782222175.006018:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 89 00000100:00100000:1.0:1782222175.006032:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+19:11305:x1868795060732928:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1782222175.006183:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+19:11305:x1868795060732928:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 Request processed in 153us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222175.006192:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 89 00000100:00080000:2.0:1782222175.006458:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782222175.020420:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222175.020469:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060733056 00000100:00100000:2.0:1782222175.020480:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060733056 00000100:00100000:2.0:1782222175.020543:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 36 00000100:00100000:2.0:1782222175.020555:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77bf2c2c-f408-43f9-ae59-449550631d05+6:11305:x1868795060733056:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782222175.020579:0:8443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222175.020605:0:8443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6515f7c/0xe2b7cc26e6811883 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755850e expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222175.020645:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eed1730e/0xe2b7cc26e681187c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558507 expref: 7 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222175.020678:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782222175.020684:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782222175.020690:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6515f7c/0xe2b7cc26e6811883 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755850e expref: 7 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222175.020735:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eed1730e/0xe2b7cc26e681187c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558507 expref: 7 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222175.020751:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eed1730e/0xe2b7cc26e681187c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558507 expref: 7 pid: 8440 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222175.020768:0:8443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08412ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8443:1868795081795584:192.168.203.27@tcp:104: 00000100:00100000:2.0:1782222175.020877:0:8443:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0870700a80 going to sleep for 11 seconds 00000100:00100000:1.0:1782222175.024144:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222175.024683:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060733184 00000100:00100000:3.0:1782222175.024693:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060733184 00010000:00010000:3.0:1782222175.024745:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eed1730e/0xe2b7cc26e681187c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558507 expref: 8 pid: 8440 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222175.024791:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 59 00000100:00100000:3.0:1782222175.024802:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074728c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+8:2389:x1868795060733184:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782222175.024821:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222175.024847:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eed1730e/0xe2b7cc26e681187c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558507 expref: 8 pid: 8440 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222175.024863:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eed1730e/0xe2b7cc26e681187c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558507 expref: 8 pid: 8440 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222175.024910:0:6513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782222175.024916:0:6513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782222175.024927:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6515f7c/0xe2b7cc26e6811883 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755850e expref: 8 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222175.024947:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6515f7c/0xe2b7cc26e6811883 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755850e expref: 8 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222175.024996:0:6513:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d6515f7c/0xe2b7cc26e6811883 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755850e expref: 8 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222175.025015:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08485a1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6513:1868795081795712:192.168.203.27@tcp:105: 00000100:00100000:3.0:1782222175.025116:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074765f6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1782222175.030067:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eed1730e/0xe2b7cc26e681187c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558507 expref: 8 pid: 8440 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222175.030103:0:8443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08412ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8443:1868795081795584:192.168.203.27@tcp:104: 00010000:00010000:2.0:1782222175.030154:0:8443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6515f7c/0xe2b7cc26e6811883 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755850e expref: 7 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222175.030175:0:8443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb83000, rc 0) 00000100:00100000:2.0:1782222175.030278:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77bf2c2c-f408-43f9-ae59-449550631d05+7:11305:x1868795060733056:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 9724us (9871us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222175.030307:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 36 00000100:00100000:0.0:1782222175.038087:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08485a1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6513:1868795081795712:192.168.203.27@tcp:105: 00010000:00010000:0.0:1782222175.038126:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782222175.038222:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074728c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+6:2389:x1868795060733184:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 13421us (14094us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222175.038255:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 59 00000100:00100000:3.0:1782222175.042974:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222175.046925:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060733312 00000100:00100000:1.0:1782222175.046954:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060733312 00002000:00100000:1.0:1782222175.047034:0:8448:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8f08485a2a00 x1868795060733312/t0(0) o4->77bf2c2c-f408-43f9-ae59-449550631d05@192.168.203.27@tcp:141/0 lens 504/0 e 0 to 0 dl 1782222186 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782222175.047049:0:8448:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f08485a2a00 with x1868795060733312 ext(0->8) 00002000:00010000:1.0:1782222175.047056:0:8448:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f08485a2a00 00000100:00100000:1.0:1782222175.047102:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 0 00000100:00100000:1.0:1782222175.047113:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77bf2c2c-f408-43f9-ae59-449550631d05+6:2390:x1868795060733312:12345-192.168.203.27@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1782222175.060180:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77bf2c2c-f408-43f9-ae59-449550631d05+8:2390:x1868795060733312:12345-192.168.203.27@tcp:4:lhsmtool_posix.0 Request processed in 13056us (17204us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1782222175.060195:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 0 00002000:00100000:1.0:1782222175.060223:0:8448:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8f08485a2a00 x1868795060733312/t4294967303(0) o4->77bf2c2c-f408-43f9-ae59-449550631d05@192.168.203.27@tcp:141/0 lens 504/448 e 0 to 0 dl 1782222186 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782222175.060251:0:8448:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f08485a2a00 with x1868795060733312 ext(0->8) 00002000:00010000:1.0:1782222175.060259:0:8448:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f08485a2a00 00000100:00100000:3.0:1782222175.069293:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222175.069384:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060733440 00000100:00100000:0.0:1782222175.069401:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060733440 00000100:00100000:0.0:1782222175.069492:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 90 00000100:00100000:0.0:1782222175.069506:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+19:11305:x1868795060733440:12345-192.168.203.27@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1782222175.077855:0:6505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:1.0:1782222175.077870:0:6505:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1782222175.077894:0:6505:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00010000:00010000:3.0:1782222175.077924:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811859 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1782222175.077929:0:6558:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1782222175.077954:0:6558:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:3.0:1782222175.077959:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811859 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222175.077972:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811859 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222175.077980:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746431c00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222175.077987:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811859 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222175.078018:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811859 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222175.078044:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:3.0:1782222175.078048:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782222175.078055:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811859 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222175.078061:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811859 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222175.078210:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08485a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081795840:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1782222175.078311:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222175.078382:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081795840 00000100:00100000:3.0:1782222175.078391:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081795840 00000100:00100000:3.0:1782222175.078464:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782222175.078476:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081795840:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1782222175.078646:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1782222175.078651:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1782222174 00002000:00010000:3.0:1782222175.078654:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1782222175.078657:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1782222174 -> 1782222174 00002000:00010000:3.0:1782222175.078659:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1782222175.078676:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+14:11305:x1868795060733440:12345-192.168.203.27@tcp:44:lhsmtool_posix.0 Request processed in 9165us (9383us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222175.078692:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 90 00000100:00100000:3.0:1782222175.078704:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3654:x1868795081795840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 228us (392us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1782222175.078714:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1782222175.078745:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1782222175.078785:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f08485a3800/2, rc 0, transno 4294967304 00000100:00100000:3.0:1782222175.078791:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08485a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081795840:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1782222175.095677:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222175.096334:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060733568 00000100:00100000:0.0:1782222175.096348:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060733568 00000100:00100000:0.0:1782222175.096426:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 38 00000100:00100000:0.0:1782222175.096439:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+8:2389:x1868795060733568:12345-192.168.203.27@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1782222175.104057:0:8436:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1782222175.104079:0:8436:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:0.0:1782222175.104345:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+6:2389:x1868795060733568:12345-192.168.203.27@tcp:16:lhsmtool_posix.0 Request processed in 7898us (8668us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222175.104358:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 38 00000100:00100000:1.0:1782222175.109758:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222175.110135:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060733824 00000100:00100000:3.0:1782222175.110150:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060733824 00000100:00100000:3.0:1782222175.110277:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 91 00000100:00100000:3.0:1782222175.110290:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074728ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+14:11305:x1868795060733824:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782222175.110345:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222175.110380:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811875 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558500 expref: 14 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222175.110400:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:3.0:1782222175.110405:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782222175.110437:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e681188a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222175.110452:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e681188a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222175.110463:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e681188a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782222175.110591:0:6526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000761d52c3 reply state 0000000069eede1f transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e681188a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222175.110604:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e681188a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222175.110623:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:3.0:1782222175.110626:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782222175.110628:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782222175.110739:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074728ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+15:11305:x1868795060733824:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 Request processed in 452us (997us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1782222175.110762:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 91 00000100:00100000:1.0:1782222175.120225:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222175.120878:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060733952 00000100:00100000:0.0:1782222175.120895:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060733952 00000100:00100000:0.0:1782222175.120981:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 39 00000100:00100000:0.0:1782222175.120994:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074728f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77bf2c2c-f408-43f9-ae59-449550631d05+6:2390:x1868795060733952:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1782222175.121260:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1782222175.121264:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1782222174 -> 1782222172 00002000:00010000:0.0:1782222175.121267:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1782222171 00002000:00010000:0.0:1782222175.121269:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1782222174 -> 1782222172 00002000:00010000:0.0:1782222175.121272:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1782222175.125609:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074728f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77bf2c2c-f408-43f9-ae59-449550631d05+7:2390:x1868795060733952:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 Request processed in 4598us (5374us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1782222175.125633:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 39 00000100:00100000:3.0:1782222175.130563:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222175.130669:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060734208 00000100:00100000:1.0:1782222175.130684:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060734208 00000100:00100000:1.0:1782222175.130750:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 92 00000100:00100000:1.0:1782222175.130761:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+15:11305:x1868795060734208:12345-192.168.203.27@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1782222175.130835:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811891 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222175.130852:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e6811852 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584f2 expref: 15 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222175.130861:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811891 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222175.130924:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e6811852 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584f2 expref: 15 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222175.130948:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e6811852 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584f2 expref: 15 pid: 13817 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222175.130962:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074728c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6527:1868795081795968:192.168.203.27@tcp:104: 00000100:00100000:1.0:1782222175.131061:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08492a1300 going to sleep for 11 seconds 00000100:00100000:1.0:1782222175.135758:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074728c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6527:1868795081795968:192.168.203.27@tcp:104: 00010000:00010000:1.0:1782222175.135787:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811891 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222175.137955:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222175.138038:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060734336 00000100:00100000:1.0:1782222175.138052:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060734336 00010000:00010000:1.0:1782222175.138099:0:9532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e6811852 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584f2 expref: 16 pid: 13817 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222175.138145:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 60 00000100:00100000:1.0:1782222175.138155:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77bf2c2c-f408-43f9-ae59-449550631d05+16:2389:x1868795060734336:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782222175.138171:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222175.138178:0:9532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e6811852 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584f2 expref: 16 pid: 13817 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222175.138205:0:9532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e6811852 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584f2 expref: 16 pid: 13817 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222175.138270:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e6811852 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584f2 expref: 16 pid: 13817 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222175.138289:0:9532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:1.0:1782222175.138294:0:9532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811891 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222175.138304:0:9532:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811891 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222175.138312:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811891 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222175.138341:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782222175.139356:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811891 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.139376:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811891 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.139564:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811891 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.139575:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811891 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.139584:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811891 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.139592:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744ce00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222175.139597:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811891 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.139617:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811891 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.139640:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:0.0:1782222175.139643:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1782222175.139650:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811891 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.139656:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811891 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222175.145139:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77bf2c2c-f408-43f9-ae59-449550631d05+15:2389:x1868795060734336:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 6971us (7194us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222175.145156:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 60 00000100:00100000:0.0:1782222175.145572:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+14:11305:x1868795060734208:12345-192.168.203.27@tcp:55:lhsmtool_posix.0 Request processed in 14800us (15012us total) trans 0 rc -22/-22 00000100:00100000:0.0:1782222175.145587:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 92 00000100:00100000:3.0:1782222175.149353:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222175.149471:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060734464 00000100:00100000:1.0:1782222175.149488:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060734464 00000100:00100000:1.0:1782222175.149561:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 40 00000100:00100000:1.0:1782222175.149572:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77bf2c2c-f408-43f9-ae59-449550631d05+7:2388:x1868795060734464:12345-192.168.203.27@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1782222175.149619:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000250f8522/0xe2b7cc26e6811898 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222175.149641:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6515f7c/0xe2b7cc26e6811883 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755850e expref: 7 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222175.149671:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222175.149676:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782222175.149681:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000250f8522/0xe2b7cc26e6811898 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222175.149719:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d6515f7c/0xe2b7cc26e6811883 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755850e expref: 7 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222175.149733:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d6515f7c/0xe2b7cc26e6811883 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755850e expref: 7 pid: 8443 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222175.149749:0:8443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074728c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8443:1868795081796096:192.168.203.27@tcp:104: 00000100:00100000:1.0:1782222175.154780:0:8443:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08492a1300 going to sleep for 11 seconds 00000100:00100000:1.0:1782222175.163491:0:8443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074728c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8443:1868795081796096:192.168.203.27@tcp:104: 00010000:00010000:1.0:1782222175.163523:0:8443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000250f8522/0xe2b7cc26e6811898 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222175.163707:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222175.164064:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060734592 00000100:00100000:0.0:1782222175.164076:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060734592 00010000:00010000:0.0:1782222175.164344:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d6515f7c/0xe2b7cc26e6811883 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755850e expref: 8 pid: 8443 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222175.164572:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 61 00000100:00100000:0.0:1782222175.164586:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849badf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77bf2c2c-f408-43f9-ae59-449550631d05+8:2390:x1868795060734592:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782222175.164679:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222175.164723:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d6515f7c/0xe2b7cc26e6811883 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755850e expref: 8 pid: 8443 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.164740:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d6515f7c/0xe2b7cc26e6811883 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755850e expref: 8 pid: 8443 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.164775:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6515f7c/0xe2b7cc26e6811883 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755850e expref: 8 pid: 8443 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.164798:0:6512:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782222175.164803:0:6512:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782222175.164811:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000250f8522/0xe2b7cc26e6811898 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.164843:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000250f8522/0xe2b7cc26e6811898 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.164879:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782222175.164956:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849badf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77bf2c2c-f408-43f9-ae59-449550631d05+7:2390:x1868795060734592:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 373us (1268us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222175.164965:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 61 00010000:00010000:1.0:1782222175.165222:0:8443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000250f8522/0xe2b7cc26e6811898 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222175.165256:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000250f8522/0xe2b7cc26e6811898 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222175.165290:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000250f8522/0xe2b7cc26e6811898 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222175.165313:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000250f8522/0xe2b7cc26e6811898 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222175.165323:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000250f8522/0xe2b7cc26e6811898 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222175.165331:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744c000 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:1.0:1782222175.165336:0:8443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000250f8522/0xe2b7cc26e6811898 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222175.165348:0:8443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000250f8522/0xe2b7cc26e6811898 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222175.165371:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000250f8522/0xe2b7cc26e6811898 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222175.165379:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000250f8522/0xe2b7cc26e6811898 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222175.165474:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77bf2c2c-f408-43f9-ae59-449550631d05+6:2388:x1868795060734464:12345-192.168.203.27@tcp:1:lhsmtool_posix.0 Request processed in 15901us (16134us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222175.165484:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 40 00000100:00100000:3.0:1782222175.175372:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222175.177154:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060734848 00000100:00100000:1.0:1782222175.177168:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060734848 00000100:00100000:1.0:1782222175.177259:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 93 00000100:00100000:1.0:1782222175.177285:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+14:11305:x1868795060734848:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1782222175.177720:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681189f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222175.177738:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e68116df lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558497 expref: 14 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222175.177748:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681189f lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222175.177786:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e68116df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558497 expref: 14 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222175.177799:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e68116df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558497 expref: 14 pid: 13817 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222175.177814:0:8465:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074728c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8465:1868795081796224:192.168.203.27@tcp:104: 00000100:00100000:1.0:1782222175.177895:0:8465:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08492a1300 going to sleep for 11 seconds 00000100:00100000:0.0:1782222175.187622:0:8465:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074728c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8465:1868795081796224:192.168.203.27@tcp:104: 00010000:00010000:0.0:1782222175.187674:0:8465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681189f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222175.192455:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222175.192672:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060734976 00000100:00100000:1.0:1782222175.192682:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060734976 00010000:00010000:1.0:1782222175.192722:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e68116df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558497 expref: 15 pid: 13817 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222175.192758:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 62 00000100:00100000:1.0:1782222175.192767:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08429a8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77bf2c2c-f408-43f9-ae59-449550631d05+15:2390:x1868795060734976:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782222175.192782:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222175.192788:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e68116df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558497 expref: 15 pid: 13817 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222175.192815:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e68116df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558497 expref: 15 pid: 13817 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222175.192838:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e68116df lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558497 expref: 15 pid: 13817 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222175.194595:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f08491d6600) 00010000:00010000:1.0:1782222175.194606:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681189f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222175.199134:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681189f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222175.199142:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681189f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222175.199193:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782222175.199286:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08429a8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77bf2c2c-f408-43f9-ae59-449550631d05+14:2390:x1868795060734976:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 6515us (6834us total) trans 0 rc 0/0 00010000:00010000:0.0:1782222175.199302:0:8465:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681189f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222175.199314:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 62 00010000:00010000:0.0:1782222175.199328:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681189f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.199858:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e68118a6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.199879:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e6811860 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584f9 expref: 14 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.199891:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e68118a6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.199965:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e6811860 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584f9 expref: 14 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.200006:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e6811860 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584f9 expref: 14 pid: 6528 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222175.200026:0:8465:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08412aaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8465:1868795081796352:192.168.203.27@tcp:104: 00000100:00100000:0.0:1782222175.200131:0:8465:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875edf480 going to sleep for 11 seconds 00000100:00100000:0.0:1782222175.204637:0:8465:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08412aaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8465:1868795081796352:192.168.203.27@tcp:104: 00010000:00010000:0.0:1782222175.204690:0:8465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e68118a6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222175.209777:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222175.209819:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060735104 00000100:00100000:3.0:1782222175.209828:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060735104 00010000:00010000:3.0:1782222175.209865:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e6811860 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584f9 expref: 15 pid: 6528 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222175.209909:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 63 00000100:00100000:3.0:1782222175.209919:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849badf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+15:2390:x1868795060735104:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782222175.209948:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222175.209955:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e6811860 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584f9 expref: 15 pid: 6528 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222175.209971:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e6811860 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584f9 expref: 15 pid: 6528 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222175.209994:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e6811860 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584f9 expref: 15 pid: 6528 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222175.210015:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:3.0:1782222175.210028:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e68118a6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222175.210039:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e68118a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222175.210046:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e68118a6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222175.210074:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782222175.210126:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849badf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+14:2390:x1868795060735104:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 207us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222175.210134:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 63 00010000:00010000:3.0:1782222175.212280:0:8465:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e68118a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222175.212297:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e68118a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782222175.212431:0:8465:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1782222175.212547:0:8465:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1782222175.212582:0:8465:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:3.0:1782222175.212680:0:8465:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8465:1868795081796480:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1782222175.212755:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222175.212792:0:8465:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074765fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1782222175.212816:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081796480 00000100:00100000:3.0:1782222175.212822:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081796480 00000100:00100000:3.0:1782222175.212866:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1782222175.212874:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:8465:x1868795081796480:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1782222175.215830:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:8465:x1868795081796480:12345-0@lo:1000:mdt00_003.0 Request processed in 2946us (3064us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222175.215857:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1782222175.215913:0:8465:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1782222175.215926:0:8465:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f08485a3800, transno 4294967304 00000100:00100000:0.0:1782222175.215967:0:8465:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8465:1868795081796480:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1782222175.216205:0:8465:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:0.0:1782222175.216335:0:8465:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08412aaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8465:1868795081796608:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1782222175.216493:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222175.216530:0:8465:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875edfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1782222175.218472:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081796608 00000100:00100000:3.0:1782222175.218489:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081796608 00000100:00100000:3.0:1782222175.218562:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1782222175.218573:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8465:x1868795081796608:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1782222175.218790:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8465:x1868795081796608:12345-0@lo:1000:mdt00_003.0 Request processed in 219us (2298us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1782222175.218800:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1782222175.218885:0:8465:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08412aaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8465:1868795081796608:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1782222175.218976:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e68118a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.218990:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e68118a6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.219000:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e68118a6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.219027:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb8c00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222175.219033:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e68118a6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.219043:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e68118a6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.219067:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:0.0:1782222175.219071:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782222175.219078:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e68118a6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.219085:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e68118a6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.219146:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68117d4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.219153:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68117d4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.219160:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68117d4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.219165:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744d400 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222175.219169:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68117d4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.219176:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68117d4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.219198:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f08491d6600) 00010000:00010000:0.0:1782222175.219201:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782222175.219205:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68117d4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.219212:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68117d4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.219279:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8800/0xe2b7cc26e68118ad lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.219300:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e68117f0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584dd expref: 17 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.219310:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8800/0xe2b7cc26e68118ad lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.219358:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e68117f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584dd expref: 17 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.219376:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e68117f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584dd expref: 17 pid: 8465 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222175.219407:0:8465:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08412ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8465:1868795081796736:192.168.203.27@tcp:104: 00000100:00100000:0.0:1782222175.219601:0:8465:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875edfc00 going to sleep for 11 seconds 00000100:00100000:2.0:1782222175.243030:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222175.243030:0:8465:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08412ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8465:1868795081796736:192.168.203.27@tcp:104: 00010000:00010000:0.0:1782222175.243072:0:8465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8800/0xe2b7cc26e68118ad lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222175.243104:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060735232 00000100:00100000:3.0:1782222175.243125:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060735232 00010000:00010000:3.0:1782222175.243203:0:9532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e68117f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584dd expref: 18 pid: 8465 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222175.243292:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 64 00000100:00100000:3.0:1782222175.243304:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77bf2c2c-f408-43f9-ae59-449550631d05+18:2390:x1868795060735232:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782222175.243320:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222175.243327:0:9532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e68117f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584dd expref: 18 pid: 8465 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222175.243343:0:9532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e68117f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584dd expref: 18 pid: 8465 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222175.243368:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e68117f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75584dd expref: 18 pid: 8465 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222175.243384:0:9532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f08491d6600) 00010000:00010000:3.0:1782222175.243402:0:9532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8800/0xe2b7cc26e68118ad lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222175.243412:0:9532:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8800/0xe2b7cc26e68118ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222175.243419:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8800/0xe2b7cc26e68118ad lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222175.243450:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782222175.243511:0:8465:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8800/0xe2b7cc26e68118ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222175.243514:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77bf2c2c-f408-43f9-ae59-449550631d05+17:2390:x1868795060735232:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 211us (487us total) trans 0 rc 0/0 00010000:00010000:0.0:1782222175.243535:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8800/0xe2b7cc26e68118ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222175.243543:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 64 00010000:00010000:0.0:1782222175.243567:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8800/0xe2b7cc26e68118ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.243577:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8800/0xe2b7cc26e68118ad lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.243585:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8800/0xe2b7cc26e68118ad lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.243592:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb8800 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222175.243596:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8800/0xe2b7cc26e68118ad lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.243605:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8800/0xe2b7cc26e68118ad lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.243621:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f08491d6600) 00010000:00010000:0.0:1782222175.243625:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782222175.243631:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8800/0xe2b7cc26e68118ad lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.243650:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8800/0xe2b7cc26e68118ad lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.243666:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681189f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.243682:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681189f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.243688:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681189f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.243693:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744d600 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222175.243697:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681189f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.243703:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681189f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.243712:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f08491d6600) 00010000:00010000:0.0:1782222175.243715:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782222175.243718:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681189f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.243725:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681189f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222175.243967:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+16:11305:x1868795060734848:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 Request processed in 66680us (68602us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1782222175.243980:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 93 00000020:00080000:0.0:1782222175.243987:0:8465:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1782222175.244079:0:13806:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782222175.244085:0:13806:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782222175.244104:0:13806:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1782222175.244111:0:13806:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782222175.248926:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222175.249090:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060735488 00000100:00100000:0.0:1782222175.249108:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060735488 00000100:00100000:0.0:1782222175.249208:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 20 00000100:00100000:0.0:1782222175.249222:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+16:11305:x1868795060735488:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1782222175.249758:0:6530:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1782222175.249801:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:0.0:1782222175.249843:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e68118b4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.249865:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e68118b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.249880:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e68118b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.249892:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e68118b4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.249900:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e68118b4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.249906:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e68118b4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222175.249930:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782222175.250066:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+18:11305:x1868795060735488:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 Request processed in 844us (1146us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1782222175.250076:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 20 00000020:00080000:0.0:1782222175.250083:0:6530:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782222175.251950:0:7468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782222175.251966:0:7468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e68118b4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222175.251978:0:7468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb8c00 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:3.0:1782222175.251983:0:7468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e68118b4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222175.251993:0:7468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e68118b4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222175.252010:0:7468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:3.0:1782222175.252013:0:7468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782222175.252036:0:7468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e68118b4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222175.252043:0:7468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e68118b4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222175.252059:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222175.252061:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222175.252062:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222175.786493:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782222176.235359:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782222176.235405:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074728c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081796864:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782222176.236800:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222176.237262:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081796864 00000100:00100000:0.0:1782222176.237271:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081796864 00000100:00100000:0.0:1782222176.237341:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1782222176.237352:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074728c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081796864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782222176.237400:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782222176.237467:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074728c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081796864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222176.237476:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:1.0:1782222176.238714:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782222176.238775:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074728c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081796864:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782222176.245426:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782222176.245449:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08412ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081796992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782222176.245738:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222176.247044:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081796992 00000100:00100000:1.0:1782222176.247058:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081796992 00000100:00100000:1.0:1782222176.247201:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1782222176.247224:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3655:x1868795081796992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782222176.247269:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782222176.247340:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3655:x1868795081796992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (1602us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222176.247347:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1782222176.247451:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08412ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081796992:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1782222176.247720:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782222176.810521:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782222176.938320:0:14270:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782222176.938331:0:14270:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782222176.938357:0:14270:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1782222176.938362:0:14270:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782222177.112774:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222177.112807:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060735744 00000100:00100000:3.0:1782222177.112816:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060735744 00000100:00100000:3.0:1782222177.112875:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 94 00000100:00100000:3.0:1782222177.112885:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+18:11323:x1868795060735744:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1782222177.112910:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222177.112962:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e68118bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558515 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.113060:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e68118c2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.113083:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e68118c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.113097:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e68118c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782222177.113108:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1782222177.113207:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e68118bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558515 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.113272:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e68118c2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558515 expref: 20 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.113280:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f0849b72000) 00010000:00010000:3.0:1782222177.113283:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782222177.113286:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746431000, rc 0) 00000100:00100000:3.0:1782222177.113342:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+20:11323:x1868795060735744:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 459us (579us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1782222177.113349:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 94 00000100:00080000:3.0:1782222177.113372:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782222177.145544:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222177.145631:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060735872 00000100:00100000:0.0:1782222177.145641:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060735872 00000100:00100000:0.0:1782222177.145702:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 95 00000100:00100000:0.0:1782222177.145713:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+20:11323:x1868795060735872:12345-192.168.203.27@tcp:34:lfs.0 00010000:00010000:0.0:1782222177.145781:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e68118d0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.145797:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e68118d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.145809:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e68118d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.145875:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e68118d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.145884:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e68118d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.145891:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e68118d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.146004:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9c00/0xe2b7cc26e68118de lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.146013:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9c00/0xe2b7cc26e68118de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.146019:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9c00/0xe2b7cc26e68118de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782222177.146061:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9c00/0xe2b7cc26e68118de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.146083:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e68118d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.146090:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e68118d0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.146097:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e68118d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.146103:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb8400 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222177.146106:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e68118d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.146114:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e68118d0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.146126:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f0849b72000) 00010000:00010000:0.0:1782222177.146130:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782222177.146134:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e68118d0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.146146:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e68118d0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.146158:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e68118d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.146164:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e68118d7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.146170:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e68118d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.146174:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb9200 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222177.146177:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e68118d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.146183:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e68118d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.146190:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f0851377000) 00010000:00010000:0.0:1782222177.146192:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782222177.146195:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e68118d7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.146200:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e68118d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.146222:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9c00/0xe2b7cc26e68118de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.146228:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9c00/0xe2b7cc26e68118de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.146271:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9c00/0xe2b7cc26e68118de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.146276:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb9c00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222177.146279:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9c00/0xe2b7cc26e68118de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.146285:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9c00/0xe2b7cc26e68118de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.146293:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f0851377c00) 00010000:00010000:0.0:1782222177.146296:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782222177.146299:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9c00/0xe2b7cc26e68118de lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.146305:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9c00/0xe2b7cc26e68118de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222177.146378:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+20:11323:x1868795060735872:12345-192.168.203.27@tcp:34:lfs.0 Request processed in 666us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222177.146385:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 95 00000100:00100000:3.0:1782222177.233835:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222177.233976:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060736128 00000100:00100000:0.0:1782222177.233987:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060736128 00000100:00100000:0.0:1782222177.234046:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 96 00000100:00100000:0.0:1782222177.234056:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+20:11326:x1868795060736128:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:0.0:1782222177.234077:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222177.234096:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9c00/0xe2b7cc26e68118e5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755851c expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.234181:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e68118ec lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.234195:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e68118ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.234204:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e68118ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.234218:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e68118f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.234225:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e68118f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.234231:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e68118f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.234631:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e68118fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.234640:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e68118fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.234647:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e68118fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782222177.234657:0:8465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1782222177.234741:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e68118ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.234748:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e68118ec lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.234755:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e68118ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.234760:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb9200 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222177.234764:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e68118ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.234771:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e68118ec lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.234782:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f0849b72000) 00010000:00010000:2.0:1782222177.234791:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782222177.234796:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e68118ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.234802:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e68118ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.234816:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e68118f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.234822:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e68118f3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.234828:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e68118f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.234834:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb8400 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222177.234836:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e68118f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.234842:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e68118f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.234850:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f0851377c00) 00010000:00010000:2.0:1782222177.234852:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782222177.234855:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e68118f3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.234860:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e68118f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.234900:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9c00/0xe2b7cc26e68118e5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755851c expref: 23 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.234935:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e68118fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755851c expref: 22 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.234942:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f0849b72200) 00010000:00010000:2.0:1782222177.234945:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782222177.234947:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb82600, rc 0) 00000100:00100000:2.0:1782222177.235010:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+22:11326:x1868795060736128:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 956us (1193us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1782222177.235018:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 96 00000100:00100000:1.0:1782222177.239344:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222177.239506:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060736256 00000100:00100000:3.0:1782222177.239516:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060736256 00000100:00100000:3.0:1782222177.239614:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 97 00000100:00100000:3.0:1782222177.239625:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074728c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+22:11326:x1868795060736256:12345-192.168.203.27@tcp:54:lfs.0 00010000:00010000:3.0:1782222177.239685:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811908 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.239700:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811908 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.239711:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811908 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.239747:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811908 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.239753:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811908 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.239771:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811908 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.239776:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746430200 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222177.239780:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811908 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.239787:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811908 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.239799:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f0849b72200) 00010000:00010000:3.0:1782222177.239802:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782222177.239806:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811908 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.239812:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811908 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222177.239888:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074728c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+22:11326:x1868795060736256:12345-192.168.203.27@tcp:54:lfs.0 Request processed in 265us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222177.239896:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 97 00000100:00100000:0.0:1782222177.251334:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222177.252161:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060736512 00000100:00100000:2.0:1782222177.252173:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060736512 00000100:00100000:2.0:1782222177.252228:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 21 00000100:00100000:2.0:1782222177.252257:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087d4bb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+22:11326:x1868795060736512:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:2.0:1782222177.252477:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087d4bb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+23:11326:x1868795060736512:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 240us (1154us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1782222177.252485:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 21 00000100:00100000:0.0:1782222177.258838:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08516d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081797248:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782222177.258965:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222177.259035:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782222177.259042:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08412af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081797120:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782222177.259066:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222177.259136:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081797248 00000100:00100000:2.0:1782222177.259145:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081797248 00000100:00100000:2.0:1782222177.259190:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081797120 00000100:00100000:2.0:1782222177.259193:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081797120 00000100:00100000:2.0:1782222177.259218:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1782222177.259228:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081797248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782222177.259279:0:7480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1782222177.259321:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081797248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222177.259343:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1782222177.259360:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1782222177.259366:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081797120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782222177.259393:0:7480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1782222177.259422:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081797120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222177.259427:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1782222177.259654:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08412af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081797120:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782222177.259667:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08516d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081797248:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782222177.290560:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222177.290669:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060736768 00000100:00100000:1.0:1782222177.290679:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060736768 00000100:00100000:1.0:1782222177.290751:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 98 00000100:00100000:1.0:1782222177.290762:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+23:10843:x1868795060736768:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:1.0:1782222177.290786:0:13817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222177.290804:0:13817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e681190f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558523 expref: -99 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.290904:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811916 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.290930:0:13817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e68118fa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755851c expref: 24 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.290940:0:13817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811916 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.290973:0:13817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e68118fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755851c expref: 24 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.291000:0:13817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e68118fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755851c expref: 24 pid: 8465 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222177.291014:0:13817:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08516d1180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13817:1868795081797376:192.168.203.27@tcp:104: 00000100:00100000:1.0:1782222177.291097:0:13817:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08492a1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782222177.294626:0:13817:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08516d1180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13817:1868795081797376:192.168.203.27@tcp:104: 00010000:00010000:1.0:1782222177.294654:0:13817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811916 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222177.296371:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222177.296963:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060736896 00000100:00100000:3.0:1782222177.296975:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060736896 00010000:00010000:3.0:1782222177.297018:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e68118fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755851c expref: 25 pid: 8465 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222177.297116:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 65 00000100:00100000:3.0:1782222177.297126:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+25:2390:x1868795060736896:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782222177.297140:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222177.297169:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e68118fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755851c expref: 25 pid: 8465 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.297182:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e68118fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755851c expref: 25 pid: 8465 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.297205:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e68118fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755851c expref: 25 pid: 8465 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.297221:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f0849b72200) 00010000:00010000:3.0:1782222177.297227:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811916 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.297295:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811916 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.297304:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811916 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.297325:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782222177.297378:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+24:2390:x1868795060736896:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 253us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222177.297392:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 65 00010000:00010000:1.0:1782222177.297455:0:13817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811916 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.297464:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811916 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782222177.297482:0:13817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1782222177.297614:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e681190f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558523 expref: 25 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.297628:0:13817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811916 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558523 expref: 24 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.297636:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f0849b72200) 00010000:00010000:1.0:1782222177.297639:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782222177.297641:0:13817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744ca00, rc 0) 00000100:00100000:1.0:1782222177.297667:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+24:10843:x1868795060736768:12345-192.168.203.27@tcp:101:bash.0 Request processed in 6908us (7117us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1782222177.297683:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 98 00000100:00100000:2.0:1782222177.308641:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222177.308719:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060737024 00000100:00100000:3.0:1782222177.308729:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060737024 00000100:00100000:3.0:1782222177.308783:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 99 00000100:00100000:3.0:1782222177.308793:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+24:10843:x1868795060737024:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:3.0:1782222177.308816:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222177.309376:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811924 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755852a expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.309430:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e681192b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.309444:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e681192b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.309455:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e681192b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.309568:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811924 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755852a expref: 26 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.309586:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e681192b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755852a expref: 25 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.309594:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f0849b72200) 00010000:00010000:3.0:1782222177.309597:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782222177.309600:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746430400, rc 0) 00000100:00100000:3.0:1782222177.309708:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+25:10843:x1868795060737024:12345-192.168.203.27@tcp:101:bash.0 Request processed in 915us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222177.309716:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 99 00000100:00100000:1.0:1782222177.316610:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222177.316795:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060737280 00000100:00100000:3.0:1782222177.316805:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060737280 00000100:00100000:3.0:1782222177.317080:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 100 00000100:00100000:3.0:1782222177.317093:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08516d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+25:10843:x1868795060737280:12345-192.168.203.27@tcp:36:bash.0 00010000:00010000:3.0:1782222177.317352:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811932 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.317387:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811932 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.317399:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811932 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782222177.317445:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:3.0:1782222177.317468:0:6528:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a8b436af reply state 0000000075817754 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811932 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.317480:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811932 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.317487:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f0849b72200) 00010000:00010000:3.0:1782222177.317490:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782222177.317494:0:6528:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1782222177.317562:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:3.0:1782222177.317663:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08516d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+29:10843:x1868795060737280:12345-192.168.203.27@tcp:36:bash.0 Request processed in 572us (1062us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1782222177.317671:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 100 00000020:00080000:3.0:1782222177.317676:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1782222177.320457:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222177.320547:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060737408 00000100:00100000:1.0:1782222177.320558:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060737408 00000100:00100000:1.0:1782222177.320604:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 101 00000100:00100000:1.0:1782222177.320613:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+29:10843:x1868795060737408:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:1.0:1782222177.320635:0:13817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222177.320653:0:13817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811939 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558531 expref: -99 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.320706:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811939 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558531 expref: 30 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.320721:0:13817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811939 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558531 expref: 30 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.320739:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f0849b72200) 00010000:00010000:1.0:1782222177.320742:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782222177.320745:0:13817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744c200, rc 0) 00000100:00100000:1.0:1782222177.320804:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+30:10843:x1868795060737408:12345-192.168.203.27@tcp:101:bash.0 Request processed in 192us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222177.320811:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 101 00000100:00100000:2.0:1782222177.324585:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222177.324662:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060737536 00000100:00100000:3.0:1782222177.324673:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060737536 00000100:00100000:3.0:1782222177.324755:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 41 00000100:00100000:3.0:1782222177.324765:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77bf2c2c-f408-43f9-ae59-449550631d05+6:10843:x1868795060737536:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:3.0:1782222177.324782:0:8887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222177.324802:0:8887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b37133f/0xe2b7cc26e6811940 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558538 expref: -99 pid: 8887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782222177.324857:0:8887:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a3a8d5c, atime: 0x6a3a8d5b, ctime: 0x6a3a8d5c, blocks: 0x8 00010000:00010000:3.0:1782222177.324878:0:8887:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=376s v=(0 0) 00010000:00010000:3.0:1782222177.324882:0:8887:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782222177.324891:0:8887:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b37133f/0xe2b7cc26e6811940 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558538 expref: 7 pid: 8887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.324927:0:8887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b37133f/0xe2b7cc26e6811940 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558538 expref: 7 pid: 8887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.324940:0:8887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746431a00, rc 0) 00000100:00100000:3.0:1782222177.325014:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77bf2c2c-f408-43f9-ae59-449550631d05+7:10843:x1868795060737536:12345-192.168.203.27@tcp:101:bash.0 Request processed in 250us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222177.325022:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 41 00000100:00080000:0.0:1782222177.325170:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782222177.328652:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222177.328746:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060737664 00000100:00100000:0.0:1782222177.328757:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060737664 00002000:00010000:0.0:1782222177.328801:0:8446:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1782222177.328805:0:8446:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f08485a3800 with x1868795060737664 ext(0->18446744073709551615) 00002000:00010000:0.0:1782222177.328816:0:8446:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f08485a3800. 00000100:00100000:0.0:1782222177.328854:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 1 00000100:00100000:0.0:1782222177.328863:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77bf2c2c-f408-43f9-ae59-449550631d05+7:2389:x1868795060737664:12345-192.168.203.27@tcp:10:bash.0 00002000:00010000:0.0:1782222177.329335:0:8446:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1782222177.329341:0:8446:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1782222172 -> 1782222176 00002000:00010000:0.0:1782222177.329343:0:8446:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1782222171 -> 1782222171 00002000:00010000:0.0:1782222177.329346:0:8446:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1782222172 -> 1782222176 00002000:00010000:0.0:1782222177.329348:0:8446:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1782222177.330442:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77bf2c2c-f408-43f9-ae59-449550631d05+8:2389:x1868795060737664:12345-192.168.203.27@tcp:10:bash.0 Request processed in 1572us (1792us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1782222177.330454:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 1 00002000:00010000:1.0:1782222177.330459:0:8446:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:1.0:1782222177.330474:0:8446:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f08485a3800 with x1868795060737664 ext(0->18446744073709551615) 00002000:00010000:1.0:1782222177.330483:0:8446:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f08485a3800. 00000100:00100000:2.0:1782222177.409428:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222177.409516:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060737792 00000100:00100000:3.0:1782222177.409526:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060737792 00000100:00100000:3.0:1782222177.409592:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 102 00000100:00100000:3.0:1782222177.409602:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+30:11340:x1868795060737792:12345-192.168.203.27@tcp:34:lfs.0 00010000:00010000:3.0:1782222177.409675:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811947 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.409693:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811947 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.410175:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811947 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.410209:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e681194e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.410217:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e681194e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.410223:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e681194e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.410336:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811955 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.410345:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811955 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.410351:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811955 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782222177.410396:0:8465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811955 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.410408:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811947 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.410414:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811947 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.410421:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811947 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.410427:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746430200 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222177.410431:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811947 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.410445:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811947 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.410457:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f0849b72000) 00010000:00010000:3.0:1782222177.410460:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222177.410465:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811947 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.410471:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811947 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.410485:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e681194e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.410491:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e681194e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.410498:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e681194e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.410503:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746430c00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222177.410505:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e681194e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.410511:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e681194e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.410517:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f087f8f1700) 00010000:00010000:3.0:1782222177.410520:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222177.410522:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e681194e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.410536:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e681194e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.410551:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811955 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.410557:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811955 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.410563:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811955 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.410568:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746430e00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222177.410571:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811955 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.410576:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811955 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.410584:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f0849b72200) 00010000:00010000:3.0:1782222177.410586:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222177.410588:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811955 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.410593:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811955 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222177.410678:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+30:11340:x1868795060737792:12345-192.168.203.27@tcp:34:lfs.0 Request processed in 1076us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222177.410685:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 102 00000100:00100000:2.0:1782222177.442310:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222177.442452:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060738048 00000100:00100000:1.0:1782222177.442462:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060738048 00000100:00100000:1.0:1782222177.442526:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 103 00000100:00100000:1.0:1782222177.442537:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+30:11343:x1868795060738048:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:1.0:1782222177.442556:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222177.442576:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681195c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755853f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.442648:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811963 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.442663:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811963 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.442674:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811963 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.442688:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e681196a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.442837:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e681196a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.442847:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e681196a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.442967:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811971 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.442994:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811971 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.443001:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811971 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782222177.443012:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1782222177.443167:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811963 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.443175:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811963 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.443182:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811963 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.443187:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744d400 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222177.443192:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811963 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.443200:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811963 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.443213:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f0849b72000) 00010000:00010000:1.0:1782222177.443216:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222177.443220:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811963 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.443227:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811963 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.443272:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e681196a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.443285:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e681196a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.443291:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e681196a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.443295:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744da00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222177.443298:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e681196a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.443304:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e681196a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.443312:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f0843b9bb00) 00010000:00010000:1.0:1782222177.443314:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222177.443317:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e681196a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.443322:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e681196a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.443366:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681195c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755853f expref: 33 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.443379:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811971 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755853f expref: 32 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.443386:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f0849b72200) 00010000:00010000:1.0:1782222177.443388:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1782222177.443396:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744dc00, rc 0) 00000100:00100000:1.0:1782222177.443504:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+32:11343:x1868795060738048:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 968us (1203us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1782222177.443513:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 103 00000100:00100000:1.0:1782222177.446883:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222177.447323:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060738176 00000100:00100000:0.0:1782222177.447333:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060738176 00000100:00100000:0.0:1782222177.447444:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 104 00000100:00100000:0.0:1782222177.447455:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08516d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+32:11343:x1868795060738176:12345-192.168.203.27@tcp:54:lfs.0 00010000:00010000:0.0:1782222177.447544:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e681197f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.447559:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811916 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558523 expref: 32 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.447569:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e681197f lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.447612:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811916 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558523 expref: 32 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.447643:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811916 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558523 expref: 32 pid: 13817 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222177.447657:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08412a9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6527:1868795081797504:192.168.203.27@tcp:104: 00000100:00100000:0.0:1782222177.447761:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087fb750c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782222177.452451:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222177.452909:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08412a9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6527:1868795081797504:192.168.203.27@tcp:104: 00010000:00010000:0.0:1782222177.452947:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e681197f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222177.453029:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060738432 00000100:00100000:3.0:1782222177.453037:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060738432 00000100:00100000:3.0:1782222177.453181:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 22 00000100:00100000:3.0:1782222177.453191:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+33:6158:x1868795060738432:12345-192.168.203.27@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1782222177.453482:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+34:6158:x1868795060738432:12345-192.168.203.27@tcp:35:ldlm_bl.0 Request processed in 291us (1040us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1782222177.453489:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 22 00000100:00100000:2.0:1782222177.458756:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222177.458844:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060738560 00000100:00100000:0.0:1782222177.458853:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060738560 00010000:00010000:0.0:1782222177.458893:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811916 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558523 expref: 34 pid: 13817 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222177.458971:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 66 00000100:00100000:0.0:1782222177.458982:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77bf2c2c-f408-43f9-ae59-449550631d05+34:2389:x1868795060738560:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782222177.458997:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222177.459005:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811916 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558523 expref: 34 pid: 13817 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.459019:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811916 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558523 expref: 34 pid: 13817 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.459039:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811916 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558523 expref: 34 pid: 13817 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.459083:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f0849b72200) 00010000:00010000:0.0:1782222177.459089:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e681197f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.459099:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e681197f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.459107:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e681197f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.459179:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782222177.459400:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77bf2c2c-f408-43f9-ae59-449550631d05+33:2389:x1868795060738560:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 419us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222177.459409:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 66 00010000:00010000:1.0:1782222177.460468:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e681197f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.460481:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e681197f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.460523:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e681197f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.460530:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e681197f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.460537:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e681197f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.460542:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb9e00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222177.460546:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e681197f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.460553:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e681197f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.460568:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f0849b72200) 00010000:00010000:1.0:1782222177.460571:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782222177.460575:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e681197f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.460600:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e681197f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222177.460670:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08516d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+32:11343:x1868795060738176:12345-192.168.203.27@tcp:54:lfs.0 Request processed in 13214us (13794us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222177.460679:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 104 00000100:00100000:1.0:1782222177.463339:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222177.463427:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060738816 00000100:00100000:0.0:1782222177.463437:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060738816 00000100:00100000:0.0:1782222177.463529:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 23 00000100:00100000:0.0:1782222177.463539:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08516d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+32:11343:x1868795060738816:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:0.0:1782222177.463759:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08516d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+33:11343:x1868795060738816:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 221us (429us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1782222177.463767:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 23 00000100:00100000:2.0:1782222177.544990:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222177.545158:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060739072 00000100:00100000:3.0:1782222177.545169:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060739072 00000100:00100000:3.0:1782222177.545229:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 105 00000100:00100000:3.0:1782222177.545274:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+33:11354:x1868795060739072:12345-192.168.203.27@tcp:101:cat.0 00010000:00010000:3.0:1782222177.545298:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222177.545317:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811986 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558546 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.545383:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e681198d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.545398:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e681198d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.545410:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e681198d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.545457:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811994 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.545465:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811994 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.545491:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811994 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.545598:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e681199b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.545607:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e681199b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.545613:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e681199b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782222177.545621:0:8465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:3.0:1782222177.545688:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e681198d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.545707:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e681198d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.545714:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e681198d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.545720:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746430c00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222177.545724:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e681198d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.545731:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e681198d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.545741:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f0849b72000) 00010000:00010000:3.0:1782222177.545744:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222177.545753:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e681198d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.545759:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e681198d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.545774:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811994 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.545780:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811994 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.545785:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811994 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.545789:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746430200 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222177.545792:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811994 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.545797:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811994 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.545804:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f087f8f1700) 00010000:00010000:3.0:1782222177.545806:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222177.545809:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811994 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.545815:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811994 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.545851:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811986 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558546 expref: 36 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.545878:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e681199b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558546 expref: 35 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.545885:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f0849b72200) 00010000:00010000:3.0:1782222177.545887:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782222177.545889:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746431200, rc 0) 00000100:00100000:3.0:1782222177.546345:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+35:11354:x1868795060739072:12345-192.168.203.27@tcp:101:cat.0 Request processed in 1073us (1361us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1782222177.546353:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 105 00000100:00100000:2.0:1782222177.553032:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222177.553219:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060739328 00000100:00100000:3.0:1782222177.553230:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060739328 00000100:00100000:3.0:1782222177.553311:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 24 00000100:00100000:3.0:1782222177.553321:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+35:11354:x1868795060739328:12345-192.168.203.27@tcp:35:cat.0 00000100:00100000:3.0:1782222177.553603:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+36:11354:x1868795060739328:12345-192.168.203.27@tcp:35:cat.0 Request processed in 282us (580us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1782222177.553611:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 24 00000100:00100000:1.0:1782222177.592861:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222177.594794:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060739584 00000100:00100000:3.0:1782222177.594813:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060739584 00000100:00100000:3.0:1782222177.594888:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 106 00000100:00100000:3.0:1782222177.594899:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08516d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+36:11355:x1868795060739584:12345-192.168.203.27@tcp:36:rm.0 00010000:00010000:3.0:1782222177.594966:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1782222177.594993:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811939 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558531 expref: 36 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.595016:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e681199b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558546 expref: 35 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.595043:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811971 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755853f expref: 34 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.595054:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e681192b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755852a expref: 33 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.595063:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f0849b72200) 00010000:00010000:3.0:1782222177.595067:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782222177.595085:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e68119a9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.595096:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e68119a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.595105:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e68119a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.595125:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e68119b0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.595132:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e68119b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.595138:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e68119b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.595284:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e68119b7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.595293:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e68119b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.595312:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e68119b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782222177.595740:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1782222177.595751:0:6526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 376624515242ns, next at 377624512652ns, rc = 0 00010000:00010000:3.0:1782222177.595805:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e68119be lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.595814:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e68119be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.595821:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e68119be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.595828:0:6526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e68119be lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.595834:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e68119be lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.595840:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e68119be lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.595866:0:6526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782222177.595884:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e68119b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.595890:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e68119b7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.595896:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e68119b7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.595909:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746430c00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222177.595914:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e68119b7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.595932:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e68119b7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.595940:0:7468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782222177.595943:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f0849b72200) 00010000:00010000:3.0:1782222177.595948:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782222177.595949:0:7468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e68119be lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.595953:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e68119b7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.595958:0:7468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746431600 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:0.0:1782222177.595964:0:7468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e68119be lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.595979:0:7468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e68119be lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.595990:0:7468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f0849b72200) 00010000:00010000:0.0:1782222177.595992:0:7468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782222177.595996:0:7468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e68119be lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.596002:0:7468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e68119be lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.596015:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222177.596016:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222177.596018:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222177.596536:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e68119b7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.596559:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e68119a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.596565:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e68119a9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.596571:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e68119a9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.596576:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746430e00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222177.596579:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e68119a9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.596585:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e68119a9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.596606:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f0849b72000) 00010000:00010000:3.0:1782222177.596609:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222177.596613:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e68119a9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.596619:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e68119a9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782222177.596630:0:6526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a11fdebd reply state 00000000819c7667 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e68119b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.596640:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e68119b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.596647:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f087f8f1700) 00010000:00010000:3.0:1782222177.596649:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782222177.596652:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782222177.597460:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08516d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+34:11355:x1868795060739584:12345-192.168.203.27@tcp:36:rm.0 Request processed in 2555us (4599us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1782222177.597471:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 106 00000100:00100000:2.0:1782222177.628520:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222177.628628:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060739840 00000100:00100000:1.0:1782222177.628637:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060739840 00000100:00100000:1.0:1782222177.628694:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 107 00000100:00100000:1.0:1782222177.628704:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074751c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+34:11361:x1868795060739840:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:1.0:1782222177.628727:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222177.628746:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e68119c5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755854d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.629022:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e68119cc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.629038:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e68119cc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.629049:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e68119cc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.629059:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68119d3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.629067:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68119d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.629153:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68119d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782222177.629499:0:6527:0:(osp_object.c:1673:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1782222177.629626:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68119da lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.629637:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68119da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.629646:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68119da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.629676:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e68119cc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.629682:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e68119cc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.629689:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e68119cc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.629695:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744c800 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222177.629700:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e68119cc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.629707:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e68119cc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.629719:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f0849b72000) 00010000:00010000:1.0:1782222177.629722:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222177.629733:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e68119cc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.629740:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e68119cc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782222177.629754:0:6527:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a738354f reply state 00000000fd2d6076 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68119d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.629765:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68119d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.629772:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f087f8f1700) 00010000:00010000:1.0:1782222177.629775:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782222177.629777:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782222177.629806:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e68119c5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755854d expref: 37 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.630460:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68119da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755854d expref: 36 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.630471:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0843b9bb00) 00010000:00010000:1.0:1782222177.630474:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782222177.630477:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744d400, rc 0) 00000100:00100000:1.0:1782222177.630668:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074751c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+37:11361:x1868795060739840:12345-192.168.203.27@tcp:101:bash.0 Request processed in 1964us (2156us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1782222177.630676:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 107 00000100:00100000:1.0:1782222177.635699:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222177.635790:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060739968 00000100:00100000:0.0:1782222177.635800:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060739968 00000100:00100000:0.0:1782222177.635878:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 42 00000100:00100000:0.0:1782222177.635888:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+7:2389:x1868795060739968:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:0.0:1782222177.635907:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222177.635937:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c308adb0/0xe2b7cc26e68119e8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558554 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782222177.635962:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782222177.635980:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=376s v=(0 0) 00010000:00010000:0.0:1782222177.635984:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782222177.635994:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c308adb0/0xe2b7cc26e68119e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558554 expref: 8 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.636033:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c308adb0/0xe2b7cc26e68119e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558554 expref: 8 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.636047:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fcb9400, rc 0) 00000100:00100000:0.0:1782222177.636121:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+8:2389:x1868795060739968:12345-192.168.203.27@tcp:101:bash.0 Request processed in 234us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222177.636128:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 42 00000100:00080000:3.0:1782222177.636654:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782222177.639889:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222177.640008:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060740096 00000100:00100000:1.0:1782222177.640019:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060740096 00000100:00100000:1.0:1782222177.640099:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 43 00000100:00100000:1.0:1782222177.640108:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77bf2c2c-f408-43f9-ae59-449550631d05+8:11361:x1868795060740096:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:1.0:1782222177.640126:0:8887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222177.640143:0:8887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eed1730e/0xe2b7cc26e68119ef lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755855b expref: -99 pid: 8887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.640176:0:8887:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c308adb0/0xe2b7cc26e68119e8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558554 expref: 9 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.640186:0:8887:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222177.640190:0:8887:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222177.640195:0:8887:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eed1730e/0xe2b7cc26e68119ef lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755855b expref: 9 pid: 8887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.640230:0:8887:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c308adb0/0xe2b7cc26e68119e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558554 expref: 9 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.640272:0:8887:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c308adb0/0xe2b7cc26e68119e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558554 expref: 9 pid: 8442 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222177.640288:0:8887:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747679c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8887:1868795081797632:192.168.203.27@tcp:104: 00000100:00100000:1.0:1782222177.640373:0:8887:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08492a1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782222177.645503:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222177.645598:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060740224 00000100:00100000:0.0:1782222177.645608:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060740224 00010000:00010000:0.0:1782222177.645650:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c308adb0/0xe2b7cc26e68119e8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558554 expref: 10 pid: 8442 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222177.645696:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 67 00000100:00100000:0.0:1782222177.645705:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747501880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77bf2c2c-f408-43f9-ae59-449550631d05+10:2390:x1868795060740224:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782222177.645721:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222177.645742:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c308adb0/0xe2b7cc26e68119e8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558554 expref: 10 pid: 8442 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.645757:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c308adb0/0xe2b7cc26e68119e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558554 expref: 10 pid: 8442 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.645782:0:6512:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782222177.645787:0:6512:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782222177.645794:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eed1730e/0xe2b7cc26e68119ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755855b expref: 10 pid: 8887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.645818:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eed1730e/0xe2b7cc26e68119ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755855b expref: 10 pid: 8887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.645862:0:6512:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000eed1730e/0xe2b7cc26e68119ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755855b expref: 10 pid: 8887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222177.645875:0:6512:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08412a9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6512:1868795081797760:192.168.203.27@tcp:105: 00000100:00100000:0.0:1782222177.645961:0:6512:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087fb75a80 going to sleep for 11 seconds 00010000:00010000:1.0:1782222177.646178:0:8887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c308adb0/0xe2b7cc26e68119e8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558554 expref: 10 pid: 8442 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222177.646193:0:8887:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747679c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8887:1868795081797632:192.168.203.27@tcp:104: 00010000:00010000:1.0:1782222177.646224:0:8887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eed1730e/0xe2b7cc26e68119ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755855b expref: 9 pid: 8887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.646279:0:8887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744ce00, rc 0) 00000100:00100000:1.0:1782222177.646321:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77bf2c2c-f408-43f9-ae59-449550631d05+9:11361:x1868795060740096:12345-192.168.203.27@tcp:101:bash.0 Request processed in 6213us (6440us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222177.646329:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 43 00000100:00100000:0.0:1782222177.649043:0:6512:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08412a9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6512:1868795081797760:192.168.203.27@tcp:105: 00010000:00010000:0.0:1782222177.649068:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782222177.649126:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747501880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77bf2c2c-f408-43f9-ae59-449550631d05+8:2390:x1868795060740224:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 3422us (3631us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222177.649137:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 67 00000100:00100000:2.0:1782222177.649800:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222177.649881:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060740480 00000100:00100000:3.0:1782222177.649888:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060740480 00000100:00100000:3.0:1782222177.649951:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 25 00000100:00100000:3.0:1782222177.649961:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+37:11361:x1868795060740480:12345-192.168.203.27@tcp:35:bash.0 00000100:00100000:3.0:1782222177.650430:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+38:11361:x1868795060740480:12345-192.168.203.27@tcp:35:bash.0 Request processed in 469us (630us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1782222177.650439:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 25 00000100:00100000:1.0:1782222177.770616:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08412a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081797888:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782222177.770696:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222177.770888:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081797888 00000100:00100000:0.0:1782222177.770895:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081797888 00000100:00080000:2.0:1782222177.770973:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782222177.770979:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1782222177.770989:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747679c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081797888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782222177.771017:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782222177.771058:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747679c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081797888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222177.771065:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1782222177.771494:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08412a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081798016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782222177.771581:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222177.771705:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08412a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081797888:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782222177.772175:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081798016 00000100:00100000:2.0:1782222177.772181:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081798016 00000100:00100000:2.0:1782222177.772259:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1782222177.772266:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3656:x1868795081798016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782222177.772281:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782222177.772320:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3656:x1868795081798016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222177.772326:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1782222177.772355:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08412a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081798016:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782222177.772476:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782222177.781758:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222177.781975:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060740608 00000100:00100000:2.0:1782222177.781985:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060740608 00000100:00100000:2.0:1782222177.782049:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 108 00000100:00100000:2.0:1782222177.782061:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+38:11378:x1868795060740608:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1782222177.782088:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222177.782108:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82a00/0xe2b7cc26e68119f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558562 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.782172:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e68119fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.782188:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e68119fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.782212:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e68119fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782222177.782281:0:8465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1782222177.782286:0:8465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782222177.782305:0:8465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e68119fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.782350:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82a00/0xe2b7cc26e68119f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558562 expref: 40 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.782369:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e68119fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558562 expref: 39 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.782377:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f0849b72000) 00010000:00010000:2.0:1782222177.782380:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782222177.782384:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb82600, rc 0) 00000100:00100000:2.0:1782222177.782452:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+39:11378:x1868795060740608:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 393us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222177.782459:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 108 00000001:00080000:0.0:1782222177.783798:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:0.0:1782222177.783813:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:2.0:1782222177.788489:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222177.789033:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060740864 00000100:00100000:1.0:1782222177.789043:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060740864 00000100:00100000:1.0:1782222177.789104:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 109 00000100:00100000:1.0:1782222177.789115:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+39:11378:x1868795060740864:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:1.0:1782222177.789136:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222177.789156:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811a04 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558569 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.789302:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811a0b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.789316:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811a0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.789326:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811a0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782222177.789355:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1782222177.789460:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811a04 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558569 expref: 42 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.789478:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811a0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558569 expref: 41 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.789486:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0843b9bb00) 00010000:00010000:1.0:1782222177.789489:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782222177.789493:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744c200, rc 0) 00000100:00100000:1.0:1782222177.789557:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+41:11378:x1868795060740864:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 444us (1077us total) trans 4294967380 rc 0/0 00000100:00100000:1.0:1782222177.789565:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 109 00000100:00100000:1.0:1782222177.793954:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222177.794000:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222177.794141:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060741248 00000100:00100000:0.0:1782222177.794163:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060741248 00000100:00100000:3.0:1782222177.794171:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060741120 00000100:00100000:3.0:1782222177.794178:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060741120 00000100:00100000:3.0:1782222177.794263:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 7 00000100:00100000:0.0:1782222177.794267:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 110 00000100:00100000:3.0:1782222177.794276:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074767a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77bf2c2c-f408-43f9-ae59-449550631d05+42:2389:x1868795060741120:12345-192.168.203.27@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1782222177.794279:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+42:11378:x1868795060741248:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1782222177.794296:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222177.794302:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222177.794321:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811a19 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558570 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.794324:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811a0b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558569 expref: 42 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.794351:0:9532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0843b9bb00) 00010000:00010000:3.0:1782222177.794355:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782222177.794413:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074767a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77bf2c2c-f408-43f9-ae59-449550631d05+42:2389:x1868795060741120:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 140us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222177.794421:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 7 00010000:00010000:0.0:1782222177.794435:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8600/0xe2b7cc26e6811a20 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.794450:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8600/0xe2b7cc26e6811a20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.794460:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8600/0xe2b7cc26e6811a20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782222177.794474:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1782222177.794570:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811a19 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558570 expref: 43 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.794584:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8600/0xe2b7cc26e6811a20 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558570 expref: 42 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.794592:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0843b9bb00) 00010000:00010000:0.0:1782222177.794595:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1782222177.794598:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fcb8600, rc 0) 00000100:00100000:0.0:1782222177.794635:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+42:11378:x1868795060741248:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 360us (635us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1782222177.794642:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 110 00000100:00100000:1.0:1782222177.806638:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222177.806737:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060741376 00000100:00100000:0.0:1782222177.806747:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060741376 00000100:00100000:0.0:1782222177.806805:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 44 00000100:00100000:0.0:1782222177.806814:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+6:2387:x1868795060741376:12345-192.168.203.27@tcp:1:lfs.0 00010000:00010000:0.0:1782222177.806859:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc425e23/0xe2b7cc26e6811a2e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.806880:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eed1730e/0xe2b7cc26e68119ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755855b expref: 6 pid: 8887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.806889:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782222177.806893:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782222177.806898:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc425e23/0xe2b7cc26e6811a2e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.806943:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eed1730e/0xe2b7cc26e68119ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755855b expref: 6 pid: 8887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.806956:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eed1730e/0xe2b7cc26e68119ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755855b expref: 6 pid: 8887 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222177.806971:0:8442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08412a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8442:1868795081798144:192.168.203.27@tcp:104: 00000100:00100000:0.0:1782222177.807051:0:8442:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087fb75900 going to sleep for 11 seconds 00000100:00100000:3.0:1782222177.809934:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222177.810028:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060741504 00000100:00100000:1.0:1782222177.810037:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060741504 00002000:00100000:1.0:1782222177.810093:0:8448:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8f087f914a80 x1868795060741504/t0(0) o4->77bf2c2c-f408-43f9-ae59-449550631d05@192.168.203.27@tcp:143/0 lens 504/0 e 0 to 0 dl 1782222188 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782222177.810105:0:8448:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f087f914a80 with x1868795060741504 ext(0->8) 00010000:00010000:1.0:1782222177.810114:0:8448:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000eed1730e/0xe2b7cc26e68119ef lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755855b expref: 7 pid: 8887 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.810131:0:8448:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000eed1730e/0xe2b7cc26e68119ef lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755855b expref: 7 pid: 8887 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782222177.810167:0:8448:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8f087f914a80 00000100:00100000:1.0:1782222177.810199:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 1 00000100:00100000:1.0:1782222177.810208:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f914a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77bf2c2c-f408-43f9-ae59-449550631d05+7:2390:x1868795060741504:12345-192.168.203.27@tcp:4:lfs.0 00000100:00100000:0.0:1782222177.810971:0:8442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08412a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8442:1868795081798144:192.168.203.27@tcp:104: 00010000:00010000:0.0:1782222177.810996:0:8442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bc425e23/0xe2b7cc26e6811a2e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222177.811432:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f914a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77bf2c2c-f408-43f9-ae59-449550631d05+9:2390:x1868795060741504:12345-192.168.203.27@tcp:4:lfs.0 Request processed in 1221us (1510us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1782222177.811441:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 1 00002000:00100000:1.0:1782222177.811450:0:8448:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8f087f914a80 x1868795060741504/t4294967303(0) o4->77bf2c2c-f408-43f9-ae59-449550631d05@192.168.203.27@tcp:143/0 lens 504/448 e 0 to 0 dl 1782222188 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782222177.811459:0:8448:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f087f914a80 with x1868795060741504 ext(0->8) 00010000:00010000:1.0:1782222177.811467:0:8448:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000eed1730e/0xe2b7cc26e68119ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755855b expref: 9 pid: 8887 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.811480:0:8448:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000eed1730e/0xe2b7cc26e68119ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755855b expref: 9 pid: 8887 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782222177.811488:0:8448:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8f087f914a80 00000100:00100000:3.0:1782222177.815127:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222177.815269:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060741632 00000100:00100000:0.0:1782222177.815279:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060741632 00010000:00010000:0.0:1782222177.815315:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eed1730e/0xe2b7cc26e68119ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755855b expref: 9 pid: 8887 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222177.815357:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 68 00000100:00100000:0.0:1782222177.815366:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08429aa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+9:2389:x1868795060741632:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782222177.815382:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1782222177.815399:0:6513:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1782222177.815401:0:6513:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1782222176 00002000:00010000:0.0:1782222177.815403:0:6513:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1782222176 00002000:00010000:0.0:1782222177.815405:0:6513:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1782222176 00002000:00010000:0.0:1782222177.815407:0:6513:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1782222177.815413:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eed1730e/0xe2b7cc26e68119ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755855b expref: 9 pid: 8887 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.815426:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eed1730e/0xe2b7cc26e68119ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755855b expref: 9 pid: 8887 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.815447:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eed1730e/0xe2b7cc26e68119ef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755855b expref: 9 pid: 8887 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.815465:0:6513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782222177.815469:0:6513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782222177.815475:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bc425e23/0xe2b7cc26e6811a2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.815498:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc425e23/0xe2b7cc26e6811a2e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.815523:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782222177.815584:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08429aa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+8:2389:x1868795060741632:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 218us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222177.815592:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 68 00010000:00010000:1.0:1782222177.815777:0:8442:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bc425e23/0xe2b7cc26e6811a2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.815787:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc425e23/0xe2b7cc26e6811a2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.815807:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc425e23/0xe2b7cc26e6811a2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.815821:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc425e23/0xe2b7cc26e6811a2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.815830:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc425e23/0xe2b7cc26e6811a2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.815836:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb9a00 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:1.0:1782222177.815841:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc425e23/0xe2b7cc26e6811a2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.815850:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc425e23/0xe2b7cc26e6811a2e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.815860:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc425e23/0xe2b7cc26e6811a2e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.815867:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc425e23/0xe2b7cc26e6811a2e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222177.815911:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+7:2387:x1868795060741376:12345-192.168.203.27@tcp:1:lfs.0 Request processed in 9098us (9284us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222177.815930:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 44 00000100:00100000:2.0:1782222177.822981:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222177.823076:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060741888 00000100:00100000:3.0:1782222177.823086:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060741888 00000100:00100000:3.0:1782222177.823152:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 26 00000100:00100000:3.0:1782222177.823162:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087d4b8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+42:11378:x1868795060741888:12345-192.168.203.27@tcp:35:lfs.0 00000004:00010000:3.0:1782222177.823221:0:6529:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8600/0xe2b7cc26e6811a20 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558570 expref: 42 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782222177.823448:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:3.0:1782222177.823480:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1782222177.823820:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:3.0:1782222177.823857:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e6811a35 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.823877:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68119da lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755854d expref: 46 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.823886:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e6811a35 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.823934:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68119da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755854d expref: 46 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.823953:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68119da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755854d expref: 46 pid: 6527 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222177.823968:0:6529:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087f916300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6529:1868795081798272:192.168.203.27@tcp:104: 00000100:00100000:3.0:1782222177.824051:0:6529:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074765fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1782222177.827746:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222177.827950:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060742016 00000100:00100000:1.0:1782222177.827960:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060742016 00010000:00010000:1.0:1782222177.827997:0:9532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68119da lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755854d expref: 47 pid: 6527 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222177.828072:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 69 00000100:00100000:1.0:1782222177.828082:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747502d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77bf2c2c-f408-43f9-ae59-449550631d05+47:2390:x1868795060742016:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782222177.828098:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222177.828104:0:9532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68119da lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755854d expref: 47 pid: 6527 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.828117:0:9532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68119da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755854d expref: 47 pid: 6527 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.828145:0:9532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0843b9bb00) 00010000:00010000:1.0:1782222177.828150:0:9532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e6811a35 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.828159:0:9532:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e6811a35 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.828166:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e6811a35 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.828186:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782222177.828264:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747502d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77bf2c2c-f408-43f9-ae59-449550631d05+47:2390:x1868795060742016:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 183us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222177.828273:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 69 00010000:00010000:3.0:1782222177.831326:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68119da lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755854d expref: 46 pid: 6527 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222177.831353:0:6529:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087f916300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6529:1868795081798272:192.168.203.27@tcp:104: 00010000:00010000:3.0:1782222177.831457:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e6811a35 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.831967:0:6529:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e6811a35 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.831977:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e6811a35 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782222177.832095:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:2.0:1782222177.832678:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1782222177.832787:0:6529:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747501880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6529:1868795081798400:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1782222177.832851:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222177.832884:0:6529:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746158a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782222177.832991:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081798400 00000100:00100000:0.0:1782222177.833000:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081798400 00000100:00100000:0.0:1782222177.833057:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1782222177.833067:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6529:x1868795081798400:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1782222177.833155:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6529:x1868795081798400:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 86us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222177.833163:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1782222177.833564:0:6529:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:2.0:1782222177.833581:0:6529:0:(osp_trans.c:1042:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:2.0:1782222177.833602:0:6529:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f08412ab100, transno 4294967302 00000100:00100000:2.0:1782222177.833657:0:6529:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747501880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6529:1868795081798400:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1782222177.833779:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:2.0:1782222177.833825:0:6529:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747297800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6529:1868795081798528:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1782222177.833854:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222177.833882:0:6529:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746158840 going to sleep for 11 seconds 00000100:00100000:3.0:1782222177.834000:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081798528 00000100:00100000:3.0:1782222177.834005:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081798528 00000100:00100000:3.0:1782222177.834043:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1782222177.834050:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6529:x1868795081798528:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1782222177.834165:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6529:x1868795081798528:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 115us (309us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1782222177.834180:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1782222177.834412:0:6529:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747297800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6529:1868795081798528:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1782222177.834452:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1782222177.834485:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e6811a35 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.834501:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e6811a35 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.834508:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e6811a35 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.834514:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746430c00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222177.834518:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e6811a35 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.834526:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e6811a35 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.834541:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0843b9bb00) 00010000:00010000:1.0:1782222177.834544:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1782222177.834549:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e6811a35 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.834555:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e6811a35 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782222177.834647:0:6529:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1782222177.834707:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1782222177.834718:0:6529:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 376863482545ns, next at 377863480584ns, rc = 0 00000001:00080000:1.0:1782222177.834724:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1782222177.834873:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0843b9bb00) 00010000:00010000:1.0:1782222177.834876:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1782222177.834883:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8600/0xe2b7cc26e6811a20 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558570 expref: 50 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222177.834999:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087d4b8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+49:11378:x1868795060741888:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 11838us (12027us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1782222177.835007:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 26 00000020:00080000:1.0:1782222177.835011:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00010000:00010000:0.0:1782222177.838700:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222177.839892:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222177.839999:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060742144 00000100:00100000:0.0:1782222177.840009:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060742144 00000100:00100000:0.0:1782222177.840206:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 111 00000100:00100000:0.0:1782222177.840227:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+49:11378:x1868795060742144:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:0.0:1782222177.840381:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222177.840403:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811a3c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558577 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.840459:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811a3c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558577 expref: 50 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.840495:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811a3c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558577 expref: 50 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.840515:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0851377f00) 00010000:00010000:0.0:1782222177.840519:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782222177.840522:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fcb9800, rc 0) 00000100:00100000:0.0:1782222177.840692:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+50:11378:x1868795060742144:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 466us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222177.840700:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 111 00000100:00100000:2.0:1782222177.846422:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222177.846543:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060742400 00000100:00100000:0.0:1782222177.846553:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060742400 00000100:00100000:0.0:1782222177.846610:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 27 00000100:00100000:0.0:1782222177.846620:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+50:11378:x1868795060742400:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:0.0:1782222177.846851:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+51:11378:x1868795060742400:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 232us (437us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1782222177.846859:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 27 00000100:00100000:2.0:1782222177.913338:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222177.913423:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060742528 00000100:00100000:1.0:1782222177.913432:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060742528 00000100:00100000:1.0:1782222177.913551:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 112 00000100:00100000:1.0:1782222177.913562:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+51:11388:x1868795060742528:12345-192.168.203.27@tcp:34:lfs.0 00010000:00010000:1.0:1782222177.913639:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811a43 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.913656:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811a43 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.913666:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811a43 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.913677:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811a4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.913685:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811a4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.913691:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811a4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.913772:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811a51 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.913796:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811a51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.913803:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811a51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782222177.913846:0:13817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811a51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.913858:0:13817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811a43 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.913865:0:13817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811a43 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.913872:0:13817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811a43 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.913878:0:13817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744dc00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222177.913882:0:13817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811a43 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.913889:0:13817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811a43 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.913899:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f0849b72000) 00010000:00010000:1.0:1782222177.913902:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222177.913907:0:13817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811a43 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.913913:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811a43 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.913942:0:13817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811a4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.913949:0:13817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811a4a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.913954:0:13817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811a4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.913959:0:13817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744da00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222177.913962:0:13817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811a4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.913968:0:13817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811a4a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.913976:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f087f8f1700) 00010000:00010000:1.0:1782222177.913979:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222177.913982:0:13817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811a4a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.913986:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811a4a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.913995:0:13817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811a51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.914001:0:13817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811a51 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.914007:0:13817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811a51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.914019:0:13817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744ca00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222177.914022:0:13817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811a51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.914029:0:13817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811a51 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.914036:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0851377f00) 00010000:00010000:1.0:1782222177.914038:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222177.914041:0:13817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811a51 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222177.914048:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811a51 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222177.914129:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+51:11388:x1868795060742528:12345-192.168.203.27@tcp:34:lfs.0 Request processed in 567us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222177.914136:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 112 00000100:00100000:2.0:1782222177.951524:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222177.951624:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060742784 00000100:00100000:3.0:1782222177.951633:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060742784 00000100:00100000:3.0:1782222177.951707:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 113 00000100:00100000:3.0:1782222177.951717:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+51:11391:x1868795060742784:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1782222177.951738:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222177.951762:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811a58 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755857e expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.951845:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811a5f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.951859:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811a5f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.951871:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811a5f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.951881:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811a66 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.951887:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811a66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.951892:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811a66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.952012:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430600/0xe2b7cc26e6811a6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.952035:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430600/0xe2b7cc26e6811a6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222177.952042:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430600/0xe2b7cc26e6811a6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782222177.952052:0:8465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1782222177.952766:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811a5f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.952778:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811a5f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.952784:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811a5f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.952790:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746430400 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222177.952795:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811a5f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.952801:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811a5f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.952815:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f0849b72000) 00010000:00010000:2.0:1782222177.952818:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782222177.952822:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811a5f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.952837:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811a5f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.952853:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811a66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.952859:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811a66 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.952866:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811a66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.952870:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746431200 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222177.952873:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811a66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.952879:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811a66 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.952891:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f087f8f1700) 00010000:00010000:2.0:1782222177.952893:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782222177.952895:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811a66 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.952900:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811a66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.952952:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811a58 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755857e expref: 54 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.952966:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430600/0xe2b7cc26e6811a6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755857e expref: 53 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222177.952980:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0851377f00) 00010000:00010000:2.0:1782222177.952982:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782222177.952984:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746430600, rc 0) 00000100:00100000:2.0:1782222177.953054:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+53:11391:x1868795060742784:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 1338us (1538us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1782222177.953062:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 113 00000100:00100000:2.0:1782222177.955797:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222177.955890:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060742912 00000100:00100000:0.0:1782222177.955899:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060742912 00000100:00100000:0.0:1782222177.955969:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 114 00000100:00100000:0.0:1782222177.955979:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+53:11391:x1868795060742912:12345-192.168.203.27@tcp:54:lfs.0 00010000:00010000:0.0:1782222177.956044:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8a00/0xe2b7cc26e6811a7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.956060:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8a00/0xe2b7cc26e6811a7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.956098:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8a00/0xe2b7cc26e6811a7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.956135:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8a00/0xe2b7cc26e6811a7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.956151:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8a00/0xe2b7cc26e6811a7b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.956158:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8a00/0xe2b7cc26e6811a7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.956165:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb8a00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222177.956169:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8a00/0xe2b7cc26e6811a7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.956176:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8a00/0xe2b7cc26e6811a7b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.956187:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0851377f00) 00010000:00010000:0.0:1782222177.956190:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782222177.956194:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8a00/0xe2b7cc26e6811a7b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222177.956201:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8a00/0xe2b7cc26e6811a7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222177.956301:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+53:11391:x1868795060742912:12345-192.168.203.27@tcp:54:lfs.0 Request processed in 323us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222177.956308:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 114 00000100:00100000:1.0:1782222177.958902:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222177.958976:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060743168 00000100:00100000:0.0:1782222177.958997:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060743168 00000100:00100000:0.0:1782222177.959051:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 28 00000100:00100000:0.0:1782222177.959061:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074767a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+53:11391:x1868795060743168:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:0.0:1782222177.959455:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074767a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+54:11391:x1868795060743168:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 394us (559us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1782222177.959464:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 28 00000100:00100000:2.0:1782222178.065031:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222178.065132:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060743424 00000100:00100000:1.0:1782222178.065152:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060743424 00000100:00100000:1.0:1782222178.065215:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 115 00000100:00100000:1.0:1782222178.065226:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+54:11401:x1868795060743424:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:1.0:1782222178.065286:0:13817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222178.065290:0:13817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1782222178.065330:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e68119fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558562 expref: 54 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.065369:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f0849b72000) 00010000:00010000:1.0:1782222178.065375:0:13817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782222178.065388:0:13817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811a82 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558585 expref: -99 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.065491:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811a89 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.065504:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811a89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.065514:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811a89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782222178.065526:0:13817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1782222178.065620:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811a82 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558585 expref: 56 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.065634:0:13817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811a89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558585 expref: 55 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.065642:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0851377f00) 00010000:00010000:1.0:1782222178.065645:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782222178.065647:0:13817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744dc00, rc 0) 00000100:00100000:1.0:1782222178.065766:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+55:11401:x1868795060743424:12345-192.168.203.27@tcp:101:bash.0 Request processed in 542us (744us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1782222178.065773:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 115 00000100:00100000:2.0:1782222178.071294:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222178.071508:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060743552 00000100:00100000:0.0:1782222178.071518:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060743552 00000100:00100000:0.0:1782222178.071581:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 116 00000100:00100000:0.0:1782222178.071592:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08516d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+55:11401:x1868795060743552:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:0.0:1782222178.071613:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222178.071634:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8a00/0xe2b7cc26e6811a97 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755858c expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.071671:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8e00/0xe2b7cc26e6811a9e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.071684:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8e00/0xe2b7cc26e6811a9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.071706:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8e00/0xe2b7cc26e6811a9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.071821:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8a00/0xe2b7cc26e6811a97 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755858c expref: 57 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.071840:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8e00/0xe2b7cc26e6811a9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755858c expref: 56 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.071861:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0851377f00) 00010000:00010000:0.0:1782222178.071864:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782222178.071868:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fcb8e00, rc 0) 00000100:00100000:0.0:1782222178.071940:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08516d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+56:11401:x1868795060743552:12345-192.168.203.27@tcp:101:bash.0 Request processed in 349us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222178.071947:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 116 00000100:00100000:3.0:1782222178.073817:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222178.073927:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060743680 00000100:00100000:0.0:1782222178.073935:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060743680 00000100:00100000:0.0:1782222178.073996:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 8 00000100:00100000:0.0:1782222178.074007:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f916300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+56:2390:x1868795060743680:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782222178.074021:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222178.074043:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811a89 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558585 expref: 56 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.074068:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0851377f00) 00010000:00010000:0.0:1782222178.074073:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782222178.074211:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f916300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+55:2390:x1868795060743680:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 204us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222178.074220:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 8 00000100:00100000:2.0:1782222178.085484:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222178.090418:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060743936 00000100:00100000:1.0:1782222178.090434:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060743936 00000100:00100000:1.0:1782222178.091503:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 117 00000100:00100000:1.0:1782222178.091521:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08516d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+55:11401:x1868795060743936:12345-192.168.203.27@tcp:36:bash.0 00010000:00010000:1.0:1782222178.091595:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222178.091621:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430600/0xe2b7cc26e6811a6d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755857e expref: 55 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.091642:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0851377f00) 00010000:00010000:1.0:1782222178.091646:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782222178.091809:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811aa5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.091823:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811aa5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.091833:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811aa5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782222178.091876:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:1.0:1782222178.091897:0:6527:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000088cdbcc8 reply state 0000000041643e8b transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811aa5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.091908:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811aa5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.091928:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0851377f00) 00010000:00010000:1.0:1782222178.091931:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782222178.091933:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782222178.092033:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08516d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+57:11401:x1868795060743936:12345-192.168.203.27@tcp:36:bash.0 Request processed in 518us (6558us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1782222178.092051:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 117 00000020:00080000:1.0:1782222178.092056:0:6527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1782222178.097412:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222178.097459:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060744064 00000100:00100000:1.0:1782222178.097469:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060744064 00000100:00100000:1.0:1782222178.097529:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 118 00000100:00100000:1.0:1782222178.097540:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+57:11401:x1868795060744064:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:1.0:1782222178.097562:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222178.097582:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811aac lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558593 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.097682:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e6811ab3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.097696:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e6811ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.097708:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e6811ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782222178.097738:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1782222178.097742:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782222178.097771:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e6811ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.097799:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811aac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558593 expref: 59 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.097819:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e6811ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558593 expref: 58 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.097848:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0851377f00) 00010000:00010000:1.0:1782222178.097851:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782222178.097854:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744c400, rc 0) 00000100:00100000:1.0:1782222178.097928:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+58:11401:x1868795060744064:12345-192.168.203.27@tcp:101:bash.0 Request processed in 388us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222178.097935:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 118 00000100:00100000:3.0:1782222178.101997:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222178.105392:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060744320 00000100:00100000:0.0:1782222178.105408:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060744320 00000100:00100000:0.0:1782222178.105477:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 29 00000100:00100000:0.0:1782222178.105488:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+58:11401:x1868795060744320:12345-192.168.203.27@tcp:35:bash.0 00000100:00100000:0.0:1782222178.106429:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+59:11401:x1868795060744320:12345-192.168.203.27@tcp:35:bash.0 Request processed in 938us (4439us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1782222178.106457:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 29 00000100:00100000:3.0:1782222178.219048:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222178.219110:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222178.219199:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060744832 00000100:00100000:1.0:1782222178.219208:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060744832 00000100:00100000:1.0:1782222178.219294:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 148 00000100:00100000:3.0:1782222178.219304:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222178.219305:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77bf2c2c-f408-43f9-ae59-449550631d05+7:2388:x1868795060744832:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222178.219328:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222178.219343:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222178.219372:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77bf2c2c-f408-43f9-ae59-449550631d05+7:2388:x1868795060744832:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 69us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222178.219380:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 148 00000100:00100000:1.0:1782222178.219397:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060744704 00000100:00100000:1.0:1782222178.219400:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060744704 00000100:00100000:1.0:1782222178.219421:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 149 00000100:00100000:1.0:1782222178.219426:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77bf2c2c-f408-43f9-ae59-449550631d05+8:2388:x1868795060744704:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222178.219472:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060744448 00000100:00100000:0.0:1782222178.219478:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060744448 00000100:00100000:2.0:1782222178.219510:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060744576 00000100:00100000:2.0:1782222178.219518:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060744576 00000100:00100000:2.0:1782222178.219564:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060745088 00000100:00100000:2.0:1782222178.219568:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060745088 00000100:00100000:2.0:1782222178.219603:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 313 00000100:00100000:2.0:1782222178.219615:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+5:2388:x1868795060744576:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222178.219816:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 388 00000100:00100000:0.0:1782222178.219829:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2388:x1868795060744448:12345-192.168.203.27@tcp:400:kworker.0 00000100:00080000:3.0:1782222178.220905:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782222178.220974:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222178.223012:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77bf2c2c-f408-43f9-ae59-449550631d05+8:2388:x1868795060744704:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 3572us (3654us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222178.223026:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 149 00000100:00100000:1.0:1782222178.223166:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060744960 00000100:00100000:3.0:1782222178.223173:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 314 00000100:00100000:1.0:1782222178.223175:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060744960 00000100:00100000:3.0:1782222178.223187:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2388:x1868795060745088:12345-192.168.203.27@tcp:400:kworker.0 00000100:00080000:1.0:1782222178.223201:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782222178.223228:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 315 00000100:00100000:1.0:1782222178.223249:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2388:x1868795060744960:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222178.225755:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2388:x1868795060745088:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 2561us (6439us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222178.225779:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 314 00000100:00100000:1.0:1782222178.227689:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2388:x1868795060744960:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 4443us (6705us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222178.227703:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 315 00000100:00100000:2.0:1782222178.231754:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+5:2388:x1868795060744576:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 12130us (12704us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222178.231770:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 313 00000100:00100000:3.0:1782222178.233698:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222178.233775:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060745216 00000100:00100000:2.0:1782222178.233785:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060745216 00000100:00100000:2.0:1782222178.233855:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 119 00000100:00100000:2.0:1782222178.233868:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+59:11407:x1868795060745216:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1782222178.233894:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222178.233937:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811aba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755859a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.234007:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82a00/0xe2b7cc26e6811ac1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.234022:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82a00/0xe2b7cc26e6811ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.234034:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82a00/0xe2b7cc26e6811ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782222178.236213:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1782222178.236223:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782222178.236269:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82a00/0xe2b7cc26e6811ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.236314:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811aba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755859a expref: 61 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.236338:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82a00/0xe2b7cc26e6811ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755859a expref: 60 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.236347:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f0849b72000) 00010000:00010000:2.0:1782222178.236350:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782222178.236354:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb82a00, rc 0) 00000100:00100000:2.0:1782222178.236443:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+60:11407:x1868795060745216:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 2576us (2752us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222178.236453:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 119 00000100:00100000:0.0:1782222178.237629:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2388:x1868795060744448:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 17796us (18292us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222178.237646:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 388 00000100:00100000:3.0:1782222178.241376:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222178.241826:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060745344 00000100:00100000:1.0:1782222178.241838:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060745344 00000100:00100000:1.0:1782222178.241961:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 120 00000100:00100000:1.0:1782222178.241973:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+60:11407:x1868795060745344:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:1.0:1782222178.242003:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222178.242024:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811ac8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75585a1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.244047:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811acf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.244069:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811acf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.244081:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811acf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.244093:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811ad6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.244100:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.244106:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.244181:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811add lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.244205:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811add lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.244213:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811add lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782222178.244270:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1782222178.244275:0:6528:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782222178.244295:0:6528:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811add lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.244306:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811add lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.244313:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811acf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.244319:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811acf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.244325:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811acf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.244338:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744c000 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222178.244342:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811acf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.244352:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811acf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.244363:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f0849b72000) 00010000:00010000:1.0:1782222178.244366:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222178.245064:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811acf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.245072:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811acf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.245087:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.245094:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811ad6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.245100:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811ad6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.245105:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744dc00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222178.245109:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811ad6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.245115:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811ad6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.245125:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f087f8f1700) 00010000:00010000:1.0:1782222178.245128:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222178.245130:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811ad6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.245136:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811ad6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.245176:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811ac8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585a1 expref: 62 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.245205:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811add lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585a1 expref: 61 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.245212:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0851377f00) 00010000:00010000:1.0:1782222178.245214:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782222178.245216:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744ca00, rc 0) 00000100:00100000:1.0:1782222178.245320:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+61:11407:x1868795060745344:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 3349us (3952us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222178.245329:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 120 00000100:00100000:3.0:1782222178.253334:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222178.253394:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222178.253512:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060745728 00000100:00100000:1.0:1782222178.253522:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060745728 00000100:00100000:1.0:1782222178.253585:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 9 00000100:00100000:1.0:1782222178.253596:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881727800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77bf2c2c-f408-43f9-ae59-449550631d05+61:2387:x1868795060745728:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782222178.253621:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222178.253645:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811add lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585a1 expref: 61 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.253665:0:9532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0851377f00) 00010000:00010000:1.0:1782222178.253669:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782222178.253726:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881727800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77bf2c2c-f408-43f9-ae59-449550631d05+60:2387:x1868795060745728:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 131us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222178.253735:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 9 00000100:00100000:2.0:1782222178.254066:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060745600 00000100:00100000:2.0:1782222178.254085:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060745600 00000100:00100000:2.0:1782222178.254130:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 121 00000100:00100000:2.0:1782222178.254137:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+60:11407:x1868795060745600:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1782222178.254153:0:13817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222178.254168:0:13817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811ae4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75585a8 expref: -99 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.254311:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811aeb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.254325:0:13817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e6811ab3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558593 expref: 61 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.254334:0:13817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811aeb lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.254367:0:13817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e6811ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558593 expref: 61 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.254380:0:13817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e6811ab3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558593 expref: 61 pid: 6526 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222178.254393:0:13817:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474fdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13817:1868795081798656:192.168.203.27@tcp:104: 00000100:00100000:2.0:1782222178.254452:0:13817:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f085122b540 going to sleep for 11 seconds 00000100:00100000:3.0:1782222178.261423:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222178.261493:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060745856 00000100:00100000:1.0:1782222178.261513:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060745856 00010000:00010000:1.0:1782222178.261553:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e6811ab3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558593 expref: 62 pid: 6526 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222178.261597:0:13817:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474fdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13817:1868795081798656:192.168.203.27@tcp:104: 00000100:00100000:1.0:1782222178.261605:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 70 00010000:00010000:2.0:1782222178.261623:0:13817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811aeb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222178.261628:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881724380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77bf2c2c-f408-43f9-ae59-449550631d05+62:2390:x1868795060745856:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782222178.261650:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222178.261658:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e6811ab3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558593 expref: 62 pid: 6526 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.261670:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e6811ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558593 expref: 62 pid: 6526 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.261691:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e6811ab3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558593 expref: 62 pid: 6526 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.261707:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0851377f00) 00010000:00010000:1.0:1782222178.261712:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811aeb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.261722:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811aeb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.261729:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811aeb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.261959:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782222178.262018:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881724380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77bf2c2c-f408-43f9-ae59-449550631d05+61:2390:x1868795060745856:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 393us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222178.262026:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 70 00010000:00010000:2.0:1782222178.262097:0:13817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811aeb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.262112:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811aeb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782222178.262131:0:13817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1782222178.262281:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811ae4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585a8 expref: 62 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.262296:0:13817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811aeb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585a8 expref: 61 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.262304:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0851377f00) 00010000:00010000:2.0:1782222178.262306:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782222178.262309:0:13817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb83000, rc 0) 00000100:00100000:2.0:1782222178.262351:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+61:11407:x1868795060745600:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 8213us (9027us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1782222178.262358:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 121 00000100:00100000:0.0:1782222178.268046:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222178.268303:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060746112 00000100:00100000:1.0:1782222178.268326:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060746112 00000100:00100000:1.0:1782222178.268397:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 10 00000100:00100000:1.0:1782222178.268407:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77bf2c2c-f408-43f9-ae59-449550631d05+61:11407:x1868795060746112:12345-192.168.203.27@tcp:103:lfs.0 00010000:00010000:1.0:1782222178.268433:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222178.268458:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811a3c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558577 expref: 61 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.268475:0:9532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0851377f00) 00010000:00010000:1.0:1782222178.268479:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782222178.268546:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77bf2c2c-f408-43f9-ae59-449550631d05+60:11407:x1868795060746112:12345-192.168.203.27@tcp:103:lfs.0 Request processed in 140us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222178.268554:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 10 00000100:00100000:3.0:1782222178.270832:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222178.270963:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060746240 00000100:00100000:2.0:1782222178.270973:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060746240 00000100:00100000:2.0:1782222178.271037:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 122 00000100:00100000:2.0:1782222178.271047:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+60:11407:x1868795060746240:12345-192.168.203.27@tcp:58:lfs.0 00010000:00010000:2.0:1782222178.271169:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811af9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.271185:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811af9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.271195:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811af9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782222178.271342:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1782222178.271419:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+60:11407:x1868795060746240:12345-192.168.203.27@tcp:58:lfs.0 Request processed in 372us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222178.271427:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 122 00000100:00100000:3.0:1782222178.274000:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222178.274364:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060746368 00000100:00100000:1.0:1782222178.274375:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060746368 00000100:00100000:1.0:1782222178.274442:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 123 00000100:00100000:1.0:1782222178.274451:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+60:11407:x1868795060746368:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:1.0:1782222178.274470:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222178.274490:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e6811b00 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75585af expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.274553:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811af9 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.274563:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e6811b00 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585af expref: 61 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.274580:0:6528:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811af9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.274877:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e6811b00 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585af expref: 61 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.274892:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0851377f00) 00010000:00010000:1.0:1782222178.274895:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782222178.274899:0:6528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e6811b00 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585af expref: 61 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.274907:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744c400, rc 0) 00000100:00100000:1.0:1782222178.274979:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+61:11407:x1868795060746368:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 529us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222178.274987:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 123 00000040:00080000:3.0:1782222178.346444:0:13806:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782222178.346453:0:13806:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782222178.346498:0:13806:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1782222178.346510:0:13806:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782222178.346643:0:13806:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881726680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1868795081798784:192.168.203.27@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782222178.346739:0:13806:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074765fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1782222178.350334:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222178.350472:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060746496 00000100:00100000:0.0:1782222178.350484:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060746496 00000100:00100000:0.0:1782222178.350545:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 124 00000100:00100000:0.0:1782222178.350555:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+62:11408:x1868795060746496:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782222178.350590:0:13817:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782222178.350716:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+62:11408:x1868795060746496:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 Request processed in 161us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222178.350724:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 124 00000100:00100000:2.0:1782222178.351148:0:13806:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881726680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1868795081798784:192.168.203.27@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782222178.358964:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222178.359268:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060746624 00000100:00100000:1.0:1782222178.359279:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060746624 00000100:00100000:1.0:1782222178.359337:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 125 00000100:00100000:1.0:1782222178.359347:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+61:11408:x1868795060746624:12345-192.168.203.27@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1782222178.359420:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811b07 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.359439:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811b07 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.359451:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811b07 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.359464:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811b0e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.359489:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811b0e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.359496:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811b0e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.359521:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811b15 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.359531:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811b15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.359537:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811b15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782222178.359588:0:8465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1782222178.359592:0:8465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782222178.359605:0:8465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811b15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.359616:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811b07 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.359623:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811b07 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.359631:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811b07 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.359637:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744d600 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222178.359642:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811b07 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.359656:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811b07 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.359669:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f087f8f2900) 00010000:00010000:1.0:1782222178.359672:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222178.359676:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811b07 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.359683:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811b07 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.359696:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811b0e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.359702:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811b0e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.359708:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811b0e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.359713:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744dc00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222178.359716:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811b0e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.359722:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811b0e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.359729:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff8f0843b9bb00) 00010000:00010000:1.0:1782222178.359732:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222178.359734:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811b0e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.359752:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811b0e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.359768:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811b15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.359774:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811b15 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.359779:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811b15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.359784:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744c000 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222178.359787:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811b15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.359793:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811b15 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.359802:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0851377f00) 00010000:00010000:1.0:1782222178.359804:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222178.359808:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811b15 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.359813:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811b15 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222178.359894:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+61:11408:x1868795060746624:12345-192.168.203.27@tcp:34:lhsmtool_posix.0 Request processed in 546us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222178.359901:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 125 00000100:00100000:1.0:1782222178.362941:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222178.363036:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060746880 00000100:00100000:3.0:1782222178.363046:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060746880 00000100:00100000:3.0:1782222178.363338:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 126 00000100:00100000:3.0:1782222178.363351:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+61:11408:x1868795060746880:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782222178.363372:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222178.363389:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431400/0xe2b7cc26e6811b1c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75585b6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.363488:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430a00/0xe2b7cc26e6811b23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.363503:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430a00/0xe2b7cc26e6811b23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.363514:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430a00/0xe2b7cc26e6811b23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782222178.363526:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1782222178.363598:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430a00/0xe2b7cc26e6811b23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.363606:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430a00/0xe2b7cc26e6811b23 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.363626:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430a00/0xe2b7cc26e6811b23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.363631:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746430a00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222178.363635:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430a00/0xe2b7cc26e6811b23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.363643:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430a00/0xe2b7cc26e6811b23 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.363654:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0851377f00) 00010000:00010000:3.0:1782222178.363658:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782222178.363662:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430a00/0xe2b7cc26e6811b23 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.363668:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430a00/0xe2b7cc26e6811b23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.363709:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431400/0xe2b7cc26e6811b1c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585b6 expref: 63 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.363720:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f087f8f2900) 00010000:00010000:3.0:1782222178.363723:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782222178.363728:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431400/0xe2b7cc26e6811b1c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585b6 expref: 63 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.363737:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746431400, rc 0) 00000100:00100000:3.0:1782222178.363803:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+62:11408:x1868795060746880:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 455us (871us total) trans 4294967399 rc 301/301 00000100:00100000:3.0:1782222178.363819:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 126 00000100:00100000:0.0:1782222178.366595:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222178.366664:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060747008 00000100:00100000:3.0:1782222178.366673:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060747008 00000100:00100000:3.0:1782222178.366840:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 127 00000100:00100000:3.0:1782222178.366851:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+62:11408:x1868795060747008:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1782222178.366888:0:6527:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1782222178.367013:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+62:11408:x1868795060747008:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 Request processed in 163us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222178.367021:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 127 00000100:00100000:1.0:1782222178.374603:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222178.374682:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060747264 00000100:00100000:3.0:1782222178.374692:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060747264 00000100:00100000:3.0:1782222178.374762:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 128 00000100:00100000:3.0:1782222178.374772:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+62:11408:x1868795060747264:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782222178.374791:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222178.374794:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1782222178.374819:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82a00/0xe2b7cc26e6811ac1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755859a expref: 62 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.374837:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f0849b72000) 00010000:00010000:3.0:1782222178.374842:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782222178.374855:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431400/0xe2b7cc26e6811b31 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75585bd expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782222178.375305:0:6526:0:(osp_object.c:1673:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:3.0:1782222178.375452:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430a00/0xe2b7cc26e6811b38 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.375474:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430a00/0xe2b7cc26e6811b38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.375484:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430a00/0xe2b7cc26e6811b38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.375539:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431400/0xe2b7cc26e6811b31 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585bd expref: 64 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.375553:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430a00/0xe2b7cc26e6811b38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585bd expref: 63 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.375561:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f087f8f1200) 00010000:00010000:3.0:1782222178.375564:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782222178.375566:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746430a00, rc 0) 00000100:00100000:3.0:1782222178.375636:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+63:11408:x1868795060747264:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 864us (1041us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1782222178.375643:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 128 00000100:00100000:0.0:1782222178.379604:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222178.379687:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060747520 00000100:00100000:3.0:1782222178.379707:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060747520 00000100:00100000:3.0:1782222178.379771:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 129 00000100:00100000:3.0:1782222178.379781:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+63:11408:x1868795060747520:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782222178.379858:0:6528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222178.379884:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430a00/0xe2b7cc26e6811b38 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585bd expref: 63 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.379903:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f087f8f1200) 00010000:00010000:3.0:1782222178.379931:0:6528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782222178.379953:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e6811b46 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.379967:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e6811b46 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.379976:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e6811b46 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.380019:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431800/0xe2b7cc26e6811b4d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xab0a7ac6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.380027:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431800/0xe2b7cc26e6811b4d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xab0a7ac6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.380034:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431800/0xe2b7cc26e6811b4d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xab0a7ac6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.380088:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e6811b46 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.380095:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e6811b46 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.380101:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e6811b46 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.380106:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746431e00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222178.380110:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e6811b46 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.380118:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e6811b46 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.380132:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f0849b72000) 00010000:00010000:3.0:1782222178.380134:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222178.380138:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e6811b46 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.380155:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e6811b46 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.380165:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431800/0xe2b7cc26e6811b4d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xab0a7ac6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.380171:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431800/0xe2b7cc26e6811b4d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xab0a7ac6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.380176:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431800/0xe2b7cc26e6811b4d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xab0a7ac6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.380182:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746431800 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222178.380184:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431800/0xe2b7cc26e6811b4d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xab0a7ac6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.380189:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431800/0xe2b7cc26e6811b4d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xab0a7ac6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.380197:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xab0a7ac6 (ffff8f087f8f1600) 00010000:00010000:3.0:1782222178.380199:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222178.380202:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431800/0xe2b7cc26e6811b4d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xab0a7ac6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.380207:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431800/0xe2b7cc26e6811b4d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xab0a7ac6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222178.380343:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+62:11408:x1868795060747520:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 Request processed in 563us (747us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782222178.380351:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 129 00000100:00100000:1.0:1782222178.382757:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222178.382831:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060747648 00000100:00100000:3.0:1782222178.382841:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060747648 00000100:00100000:3.0:1782222178.382902:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 130 00000100:00100000:3.0:1782222178.382920:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+62:11408:x1868795060747648:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782222178.382941:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222178.382962:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431400/0xe2b7cc26e6811b54 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75585c4 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.382998:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430600/0xe2b7cc26e6811b5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.383009:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430600/0xe2b7cc26e6811b5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.383020:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430600/0xe2b7cc26e6811b5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.383151:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431400/0xe2b7cc26e6811b54 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585c4 expref: 64 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.383170:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430600/0xe2b7cc26e6811b5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585c4 expref: 63 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.383179:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f087f8f1b00) 00010000:00010000:3.0:1782222178.383188:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782222178.383192:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746430600, rc 0) 00000100:00100000:3.0:1782222178.383400:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+63:11408:x1868795060747648:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 489us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222178.383407:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 130 00000100:00100000:0.0:1782222178.385878:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222178.385964:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060747904 00000100:00100000:2.0:1782222178.385973:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060747904 00000100:00100000:2.0:1782222178.386030:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 131 00000100:00100000:2.0:1782222178.386040:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+63:11408:x1868795060747904:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782222178.386124:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811b62 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.386151:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811b62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.386163:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811b62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782222178.386364:0:13817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:2.0:1782222178.386421:0:13817:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000513c645d reply state 0000000039f840eb transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811b62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.386434:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811b62 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.386441:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f087f8f1b00) 00010000:00010000:2.0:1782222178.386443:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1782222178.386446:0:13817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782222178.386570:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+65:11408:x1868795060747904:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 Request processed in 530us (700us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1782222178.386578:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 131 00000100:00100000:0.0:1782222178.389503:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222178.389591:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060748032 00000100:00100000:1.0:1782222178.389601:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060748032 00000100:00100000:1.0:1782222178.389661:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 132 00000100:00100000:1.0:1782222178.389671:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849badf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+65:11408:x1868795060748032:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782222178.389693:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222178.389723:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811b69 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75585cb expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.389778:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811b69 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585cb expref: 66 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.389791:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811b69 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585cb expref: 66 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.389810:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f087f8f1b00) 00010000:00010000:1.0:1782222178.389813:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782222178.389817:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744d600, rc 0) 00000100:00100000:1.0:1782222178.389875:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849badf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+66:11408:x1868795060748032:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 205us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222178.389882:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 132 00000100:00100000:1.0:1782222178.392952:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222178.393120:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060748160 00000100:00100000:2.0:1782222178.393130:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060748160 00000100:00100000:2.0:1782222178.393342:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 45 00000100:00100000:2.0:1782222178.393353:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747563b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77bf2c2c-f408-43f9-ae59-449550631d05+8:2390:x1868795060748160:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1782222178.393606:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747563b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77bf2c2c-f408-43f9-ae59-449550631d05+9:2390:x1868795060748160:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 Request processed in 254us (662us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1782222178.393614:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 45 00000100:00100000:3.0:1782222178.395682:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222178.395813:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060748416 00000100:00100000:1.0:1782222178.395822:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060748416 00000100:00100000:1.0:1782222178.395876:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 30 00000100:00100000:1.0:1782222178.395886:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+66:11408:x1868795060748416:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1782222178.396149:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+67:11408:x1868795060748416:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 Request processed in 264us (474us total) trans 4294967402 rc 0/0 00000100:00100000:1.0:1782222178.396157:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 30 00000100:00100000:0.0:1782222178.398557:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222178.398652:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060748672 00000100:00100000:1.0:1782222178.398661:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060748672 00000100:00100000:1.0:1782222178.398730:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 133 00000100:00100000:1.0:1782222178.398740:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+67:11408:x1868795060748672:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1782222178.398847:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+67:11408:x1868795060748672:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 Request processed in 109us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222178.398854:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 133 00000100:00100000:3.0:1782222178.401336:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222178.401977:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060748800 00000100:00100000:1.0:1782222178.401987:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060748800 00000100:00100000:1.0:1782222178.402050:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 134 00000100:00100000:1.0:1782222178.402060:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+67:11408:x1868795060748800:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782222178.402079:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222178.402098:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811b70 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75585d2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.402167:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811b77 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.402194:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811b77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.402206:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811b77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782222178.402300:0:6528:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782222178.402319:0:6528:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811b77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.402345:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811b70 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585d2 expref: 69 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.402362:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811b77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585d2 expref: 68 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.402370:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f087f8f1b00) 00010000:00010000:1.0:1782222178.402373:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1782222178.402377:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744c200, rc 0) 00000100:00100000:1.0:1782222178.402432:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+68:11408:x1868795060748800:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 373us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222178.402440:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 134 00000100:00100000:3.0:1782222178.406466:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222178.406565:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060748928 00000100:00100000:1.0:1782222178.406576:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060748928 00000100:00100000:1.0:1782222178.406668:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 46 00000100:00100000:1.0:1782222178.406679:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77bf2c2c-f408-43f9-ae59-449550631d05+9:2387:x1868795060748928:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782222178.406698:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222178.406720:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083b18c0d/0xe2b7cc26e6811b7e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75585d9 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782222178.406747:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3a8d61, blocks: 0x0 00010000:00010000:1.0:1782222178.406767:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=377s v=(0 0) 00010000:00010000:1.0:1782222178.406785:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222178.406794:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083b18c0d/0xe2b7cc26e6811b7e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585d9 expref: 10 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.406815:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000083b18c0d/0xe2b7cc26e6811b7e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585d9 expref: 10 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.406829:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744c800, rc 0) 00000100:00100000:1.0:1782222178.406941:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77bf2c2c-f408-43f9-ae59-449550631d05+10:2387:x1868795060748928:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 264us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222178.406948:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 46 00000100:00100000:3.0:1782222178.409748:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222178.409844:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060749184 00000100:00100000:0.0:1782222178.409853:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060749184 00000100:00100000:0.0:1782222178.409963:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 135 00000100:00100000:0.0:1782222178.409973:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+68:11408:x1868795060749184:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1782222178.410092:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+68:11408:x1868795060749184:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 Request processed in 120us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222178.410100:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 135 00000100:00100000:3.0:1782222178.412372:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222178.412651:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060749312 00000100:00100000:2.0:1782222178.412663:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060749312 00000100:00100000:2.0:1782222178.412728:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 47 00000100:00100000:2.0:1782222178.412738:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77bf2c2c-f408-43f9-ae59-449550631d05+10:11408:x1868795060749312:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782222178.412758:0:8443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222178.412777:0:8443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055a306da/0xe2b7cc26e6811b85 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75585e0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.412811:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000083b18c0d/0xe2b7cc26e6811b7e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585d9 expref: 11 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.412820:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782222178.412824:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782222178.412829:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055a306da/0xe2b7cc26e6811b85 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585e0 expref: 11 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.412880:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000083b18c0d/0xe2b7cc26e6811b7e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585d9 expref: 11 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.412903:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000083b18c0d/0xe2b7cc26e6811b7e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585d9 expref: 11 pid: 8440 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222178.412927:0:8443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8443:1868795081798912:192.168.203.27@tcp:104: 00000100:00100000:2.0:1782222178.413006:0:8443:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875d4a900 going to sleep for 11 seconds 00000100:00100000:3.0:1782222178.415921:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222178.416438:0:8443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8443:1868795081798912:192.168.203.27@tcp:104: 00010000:00010000:2.0:1782222178.416472:0:8443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000055a306da/0xe2b7cc26e6811b85 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585e0 expref: 11 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.416492:0:8443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb83800, rc 0) 00000100:00100000:2.0:1782222178.416550:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77bf2c2c-f408-43f9-ae59-449550631d05+11:11408:x1868795060749312:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 3814us (4189us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222178.416558:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 47 00000100:00100000:2.0:1782222178.417878:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060749440 00000100:00100000:2.0:1782222178.417890:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060749440 00010000:00010000:2.0:1782222178.417946:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000083b18c0d/0xe2b7cc26e6811b7e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585d9 expref: 11 pid: 8440 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222178.417982:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 71 00000100:00100000:2.0:1782222178.417990:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+11:2390:x1868795060749440:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782222178.418005:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782222178.418024:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000083b18c0d/0xe2b7cc26e6811b7e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585d9 expref: 11 pid: 8440 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.418057:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000083b18c0d/0xe2b7cc26e6811b7e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585d9 expref: 11 pid: 8440 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.418089:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083b18c0d/0xe2b7cc26e6811b7e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585d9 expref: 11 pid: 8440 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.418103:0:6513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782222178.418107:0:6513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782222178.418114:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000055a306da/0xe2b7cc26e6811b85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585e0 expref: 10 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.418124:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055a306da/0xe2b7cc26e6811b85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585e0 expref: 10 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.418213:0:6513:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000055a306da/0xe2b7cc26e6811b85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585e0 expref: 10 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222178.418227:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474fdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6513:1868795081799040:192.168.203.27@tcp:105: 00000100:00100000:2.0:1782222178.418417:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875d4a900 going to sleep for 11 seconds 00000100:00100000:3.0:1782222178.422388:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222178.422500:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060749568 00000100:00100000:1.0:1782222178.422511:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060749568 00002000:00100000:1.0:1782222178.422560:0:8446:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8f0747cfdf80 x1868795060749568/t0(0) o4->77bf2c2c-f408-43f9-ae59-449550631d05@192.168.203.27@tcp:144/0 lens 504/0 e 0 to 0 dl 1782222189 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782222178.422572:0:8446:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f0747cfdf80 with x1868795060749568 ext(0->12) 00002000:00010000:1.0:1782222178.422578:0:8446:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f0747cfdf80 00000100:00100000:1.0:1782222178.422610:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 2 00000100:00100000:1.0:1782222178.422621:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77bf2c2c-f408-43f9-ae59-449550631d05+11:2389:x1868795060749568:12345-192.168.203.27@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1782222178.423423:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474fdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6513:1868795081799040:192.168.203.27@tcp:105: 00010000:00010000:2.0:1782222178.423447:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782222178.423513:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+13:2390:x1868795060749440:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 5522us (7608us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222178.423523:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 71 00000100:00100000:1.0:1782222178.424439:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77bf2c2c-f408-43f9-ae59-449550631d05+12:2389:x1868795060749568:12345-192.168.203.27@tcp:4:lhsmtool_posix.0 Request processed in 1816us (2058us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1782222178.424449:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 2 00002000:00100000:1.0:1782222178.424459:0:8446:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8f0747cfdf80 x1868795060749568/t4294967309(0) o4->77bf2c2c-f408-43f9-ae59-449550631d05@192.168.203.27@tcp:144/0 lens 504/448 e 0 to 0 dl 1782222189 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782222178.424469:0:8446:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f0747cfdf80 with x1868795060749568 ext(0->12) 00002000:00010000:1.0:1782222178.424485:0:8446:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f0747cfdf80 00000100:00100000:3.0:1782222178.427724:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222178.428040:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060749696 00000100:00100000:0.0:1782222178.428052:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060749696 00000100:00100000:0.0:1782222178.428328:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 136 00000100:00100000:0.0:1782222178.428338:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+68:11408:x1868795060749696:12345-192.168.203.27@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1782222178.433348:0:6505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:1.0:1782222178.433413:0:6505:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1782222178.433455:0:6505:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f0746158a80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1782222178.433464:0:6505:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8f087fc14800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f0746158300 00000020:00080000:1.0:1782222178.433467:0:6505:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8f087fc14900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f08526f8200 00000004:00080000:1.0:1782222178.433505:0:6505:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1782222178.433560:0:6505:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f0875edf6c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1782222178.433565:0:6505:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8f0747380e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f0875edf480 00000020:00080000:1.0:1782222178.433570:0:6505:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8f0747380600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f07463c2a00 00000100:00100000:1.0:1782222178.433851:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+22:11408:x1868795060749696:12345-192.168.203.27@tcp:44:lhsmtool_posix.0 Request processed in 5503us (6129us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222178.433864:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 136 00000020:00080000:2.0:1782222178.435133:0:6558:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1782222178.435279:0:6558:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:3.0:1782222178.435601:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e681188a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.435619:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e681188a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.435628:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e681188a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.435635:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746431c00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222178.435641:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e681188a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.435651:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e681188a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.435747:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:3.0:1782222178.435769:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222178.435775:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e681188a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.435782:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e681188a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.435820:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811932 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.435827:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811932 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.435833:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811932 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.435838:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746430000 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222178.435841:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811932 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.435848:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811932 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.435858:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f0849b72200) 00010000:00010000:3.0:1782222178.435861:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222178.435864:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811932 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222178.435867:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1782222178.435872:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811932 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.435891:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e68119b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222178.435902:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08412aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081799168:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1782222178.435924:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e68119b0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.435932:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e68119b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.435937:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746430200 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222178.435940:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e68119b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.435947:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e68119b0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.435957:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f087f8f1700) 00010000:00010000:3.0:1782222178.435960:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222178.435962:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e68119b0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.435968:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e68119b0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.435981:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68119d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.435988:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68119d3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.435994:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68119d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.436000:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744de00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222178.436010:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68119d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.436017:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68119d3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222178.436026:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782222178.436032:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f087f8f1700) 00010000:00010000:3.0:1782222178.436037:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222178.436040:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68119d3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.436046:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68119d3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.436065:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811aa5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.436072:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811aa5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.436079:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811aa5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.436084:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744da00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222178.436087:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811aa5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.436093:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811aa5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.436101:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0851377f00) 00010000:00010000:3.0:1782222178.436104:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222178.436114:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811aa5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.436120:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811aa5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.436133:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811b62 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.436139:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811b62 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.436145:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811b62 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.436150:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb82800 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222178.436152:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811b62 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.436157:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811b62 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.436164:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f087f8f1b00) 00010000:00010000:3.0:1782222178.436166:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782222178.436168:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811b62 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.436173:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811b62 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222178.436311:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081799168 00000100:00100000:3.0:1782222178.436320:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081799168 00000100:00100000:2.0:1782222178.436389:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782222178.436403:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081799296:0@lo:6:osp-syn-0-0.0 00000100:00080000:1.0:1782222178.436530:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782222178.436561:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782222178.436580:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3654:x1868795081799168:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1782222178.436616:0:8442:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:3.0:1782222178.436654:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a3a8d60, atime: 0x6a3a8d60, ctime: 0x6a3a8d60, blocks: 0x8 00010000:00010000:3.0:1782222178.436662:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003017b9d8/0xe2b7cc26e6811b8c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.436680:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=377s v=(0 0) 00010000:00010000:3.0:1782222178.436685:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782222178.436694:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003017b9d8/0xe2b7cc26e6811b8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.436711:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003017b9d8/0xe2b7cc26e6811b8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.436720:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003017b9d8/0xe2b7cc26e6811b8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.436728:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003017b9d8/0xe2b7cc26e6811b8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.436799:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782222178.436996:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782222178.437004:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003017b9d8/0xe2b7cc26e6811b8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.437012:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746431800 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:1.0:1782222178.437017:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003017b9d8/0xe2b7cc26e6811b8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.437026:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003017b9d8/0xe2b7cc26e6811b8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.437043:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003017b9d8/0xe2b7cc26e6811b8c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.437059:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003017b9d8/0xe2b7cc26e6811b8c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.437078:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222178.437080:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222178.437082:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222178.441154:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3654:x1868795081799168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4552us (5106us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1782222178.441175:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000004:00080000:0.0:1782222178.441328:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f08412aed80/2, rc 0, transno 4294967305 00000100:00100000:0.0:1782222178.441341:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08412aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081799168:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782222178.441834:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222178.442665:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222178.445255:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060749824 00000100:00100000:3.0:1782222178.445278:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060749824 00000100:00100000:3.0:1782222178.445373:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081799296 00000100:00100000:3.0:1782222178.445394:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081799296 00000100:00100000:3.0:1782222178.445438:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 49 00000100:00100000:3.0:1782222178.445450:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747560a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77bf2c2c-f408-43f9-ae59-449550631d05+12:2389:x1868795060749824:12345-192.168.203.27@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1782222178.445552:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1782222178.445560:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3653:x1868795081799296:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1782222178.445576:0:8440:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:3.0:1782222178.445604:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005928432f/0xe2b7cc26e6811b93 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.445634:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001b37133f/0xe2b7cc26e6811940 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558538 expref: 12 pid: 8887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.445645:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1782222178.445655:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782222178.445660:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005928432f/0xe2b7cc26e6811b93 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.445719:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001b37133f/0xe2b7cc26e6811940 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558538 expref: 12 pid: 8887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.445763:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001b37133f/0xe2b7cc26e6811940 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558538 expref: 12 pid: 8887 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222178.445788:0:8440:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cfc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8440:1868795081799424:192.168.203.27@tcp:104: 00000100:00100000:3.0:1782222178.445937:0:8440:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074765fc00 going to sleep for 11 seconds 00000001:00080000:1.0:1782222178.449007:0:8436:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1782222178.449044:0:8436:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:3.0:1782222178.450804:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747560a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77bf2c2c-f408-43f9-ae59-449550631d05+7:2389:x1868795060749824:12345-192.168.203.27@tcp:16:lhsmtool_posix.0 Request processed in 5340us (8957us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222178.450839:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 49 00000100:00100000:0.0:1782222178.451613:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222178.452157:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060749952 00000100:00100000:2.0:1782222178.452171:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060749952 00010000:00010000:2.0:1782222178.452226:0:9532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001b37133f/0xe2b7cc26e6811940 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558538 expref: 7 pid: 8887 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222178.452355:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 72 00000100:00100000:2.0:1782222178.452369:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08429aa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77bf2c2c-f408-43f9-ae59-449550631d05+7:2390:x1868795060749952:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782222178.452387:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782222178.452394:0:9532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001b37133f/0xe2b7cc26e6811940 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558538 expref: 7 pid: 8887 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.452409:0:9532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001b37133f/0xe2b7cc26e6811940 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558538 expref: 7 pid: 8887 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.452449:0:9532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782222178.452456:0:9532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782222178.452466:0:9532:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005928432f/0xe2b7cc26e6811b93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.452477:0:9532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005928432f/0xe2b7cc26e6811b93 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.452536:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782222178.452622:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08429aa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77bf2c2c-f408-43f9-ae59-449550631d05+7:2390:x1868795060749952:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 252us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222178.452634:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 72 00010000:00010000:3.0:1782222178.453094:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b37133f/0xe2b7cc26e6811940 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558538 expref: 6 pid: 8887 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222178.453116:0:8440:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cfc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8440:1868795081799424:192.168.203.27@tcp:104: 00010000:00010000:3.0:1782222178.453140:0:8440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005928432f/0xe2b7cc26e6811b93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.453153:0:8440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005928432f/0xe2b7cc26e6811b93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.453160:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005928432f/0xe2b7cc26e6811b93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.453171:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005928432f/0xe2b7cc26e6811b93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.453179:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005928432f/0xe2b7cc26e6811b93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.453200:0:8440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782222178.453472:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3653:x1868795081799296:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7911us (10811us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1782222178.453482:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1782222178.453530:0:3653:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1782222178.453549:0:3653:0:(osp_trans.c:1042:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1782222178.453572:0:3653:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff8f0747cfca80 x1868795081799296/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1782222194 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1782222178.453583:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f0747cfca80/2, rc 0, transno 4294967310 00000100:00100000:3.0:1782222178.453595:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081799296:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782222178.454288:0:7468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782222178.454300:0:7468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005928432f/0xe2b7cc26e6811b93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.454313:0:7468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746431400 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:0.0:1782222178.454319:0:7468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005928432f/0xe2b7cc26e6811b93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.454332:0:7468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005928432f/0xe2b7cc26e6811b93 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.454373:0:7468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005928432f/0xe2b7cc26e6811b93 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.454381:0:7468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005928432f/0xe2b7cc26e6811b93 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.454405:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222178.454407:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222178.454409:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222178.468173:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222178.468472:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060750208 00000100:00100000:1.0:1782222178.468485:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060750208 00000100:00100000:1.0:1782222178.468594:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 137 00000100:00100000:1.0:1782222178.468612:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+16:11408:x1868795060750208:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782222178.468725:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222178.468789:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811b77 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585d2 expref: 16 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.468818:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f087f8f1b00) 00010000:00010000:1.0:1782222178.468826:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782222178.468878:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811b9a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.468900:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811b9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.468926:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811b9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782222178.469547:0:8465:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000082ebffe reply state 000000003362b607 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811b9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.469569:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811b9a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.469578:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f087f8f1b00) 00010000:00010000:1.0:1782222178.469582:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782222178.469587:0:8465:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782222178.469963:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+17:11408:x1868795060750208:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 Request processed in 1351us (1801us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1782222178.469978:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 137 00000100:00100000:3.0:1782222178.477369:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222178.477487:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060750336 00000100:00100000:0.0:1782222178.477502:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060750336 00000100:00100000:0.0:1782222178.477602:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 51 00000100:00100000:0.0:1782222178.477618:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77bf2c2c-f408-43f9-ae59-449550631d05+6:2390:x1868795060750336:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1782222178.478043:0:8443:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1782222178.478047:0:8443:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1782222177 00002000:00010000:0.0:1782222178.478049:0:8443:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1782222176 00002000:00010000:0.0:1782222178.478051:0:8443:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1782222177 -> 1782222177 00002000:00010000:0.0:1782222178.478054:0:8443:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1782222178.478283:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77bf2c2c-f408-43f9-ae59-449550631d05+7:2390:x1868795060750336:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 Request processed in 623us (880us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1782222178.478292:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 51 00000100:00100000:2.0:1782222178.483194:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222178.483458:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060750592 00000100:00100000:0.0:1782222178.483472:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060750592 00000100:00100000:0.0:1782222178.483551:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 138 00000100:00100000:0.0:1782222178.483562:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+17:11408:x1868795060750592:12345-192.168.203.27@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1782222178.483694:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9400/0xe2b7cc26e6811ba1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.483720:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430600/0xe2b7cc26e6811b5b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585c4 expref: 17 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.484164:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9400/0xe2b7cc26e6811ba1 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.484220:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430600/0xe2b7cc26e6811b5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585c4 expref: 17 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.484280:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430600/0xe2b7cc26e6811b5b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585c4 expref: 17 pid: 6527 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222178.484299:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6527:1868795081799552:192.168.203.27@tcp:104: 00000100:00100000:0.0:1782222178.484424:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087fb75180 going to sleep for 11 seconds 00000100:00100000:2.0:1782222178.493156:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6527:1868795081799552:192.168.203.27@tcp:104: 00010000:00010000:2.0:1782222178.493206:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9400/0xe2b7cc26e6811ba1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222178.497505:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222178.497683:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060750720 00000100:00100000:1.0:1782222178.497697:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060750720 00010000:00010000:1.0:1782222178.497768:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430600/0xe2b7cc26e6811b5b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585c4 expref: 18 pid: 6527 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222178.497837:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 73 00000100:00100000:1.0:1782222178.497854:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747502d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77bf2c2c-f408-43f9-ae59-449550631d05+18:2390:x1868795060750720:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782222178.497879:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222178.497892:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430600/0xe2b7cc26e6811b5b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585c4 expref: 18 pid: 6527 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.497927:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430600/0xe2b7cc26e6811b5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585c4 expref: 18 pid: 6527 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.497965:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430600/0xe2b7cc26e6811b5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585c4 expref: 18 pid: 6527 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.498008:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f087f8f1b00) 00010000:00010000:1.0:1782222178.498015:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9400/0xe2b7cc26e6811ba1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.498026:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9400/0xe2b7cc26e6811ba1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.498036:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9400/0xe2b7cc26e6811ba1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.498096:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782222178.498200:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747502d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77bf2c2c-f408-43f9-ae59-449550631d05+17:2390:x1868795060750720:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 347us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222178.498211:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 73 00010000:00010000:0.0:1782222178.499052:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9400/0xe2b7cc26e6811ba1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.499231:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9400/0xe2b7cc26e6811ba1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.499325:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9400/0xe2b7cc26e6811ba1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.499336:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9400/0xe2b7cc26e6811ba1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.499345:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9400/0xe2b7cc26e6811ba1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.499371:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb9400 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222178.499377:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9400/0xe2b7cc26e6811ba1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.499385:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9400/0xe2b7cc26e6811ba1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.499401:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f087f8f1b00) 00010000:00010000:0.0:1782222178.499404:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1782222178.499409:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9400/0xe2b7cc26e6811ba1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.499416:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9400/0xe2b7cc26e6811ba1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222178.499522:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+16:11408:x1868795060750592:12345-192.168.203.27@tcp:55:lhsmtool_posix.0 Request processed in 15954us (16339us total) trans 0 rc -22/-22 00000100:00100000:0.0:1782222178.499535:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 138 00000100:00100000:2.0:1782222178.517566:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222178.517715:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060750848 00000100:00100000:3.0:1782222178.517729:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060750848 00000100:00100000:3.0:1782222178.518026:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 52 00000100:00100000:3.0:1782222178.518040:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77bf2c2c-f408-43f9-ae59-449550631d05+7:2389:x1868795060750848:12345-192.168.203.27@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1782222178.518135:0:8887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001b37133f/0xe2b7cc26e6811ba8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.518167:0:8887:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000055a306da/0xe2b7cc26e6811b85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585e0 expref: 7 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.518182:0:8887:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782222178.518189:0:8887:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782222178.518199:0:8887:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b37133f/0xe2b7cc26e6811ba8 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.518309:0:8887:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000055a306da/0xe2b7cc26e6811b85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585e0 expref: 7 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.518333:0:8887:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000055a306da/0xe2b7cc26e6811b85 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585e0 expref: 7 pid: 8443 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222178.518380:0:8887:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cfc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8887:1868795081799680:192.168.203.27@tcp:104: 00000100:00100000:3.0:1782222178.518505:0:8887:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074765f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782222178.523180:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222178.523885:0:8887:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cfc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8887:1868795081799680:192.168.203.27@tcp:104: 00010000:00010000:3.0:1782222178.523946:0:8887:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001b37133f/0xe2b7cc26e6811ba8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222178.527339:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060750976 00000100:00100000:2.0:1782222178.527361:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060750976 00010000:00010000:2.0:1782222178.527435:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000055a306da/0xe2b7cc26e6811b85 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585e0 expref: 8 pid: 8443 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222178.527602:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 74 00000100:00100000:2.0:1782222178.527615:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747560700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77bf2c2c-f408-43f9-ae59-449550631d05+8:2390:x1868795060750976:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782222178.527636:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782222178.527664:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000055a306da/0xe2b7cc26e6811b85 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585e0 expref: 8 pid: 8443 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.527694:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000055a306da/0xe2b7cc26e6811b85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585e0 expref: 8 pid: 8443 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.527748:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055a306da/0xe2b7cc26e6811b85 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585e0 expref: 8 pid: 8443 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.527779:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782222178.527784:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782222178.527791:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001b37133f/0xe2b7cc26e6811ba8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.527802:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b37133f/0xe2b7cc26e6811ba8 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.527847:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782222178.527939:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747560700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77bf2c2c-f408-43f9-ae59-449550631d05+7:2390:x1868795060750976:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 325us (4774us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222178.527949:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 74 00010000:00010000:3.0:1782222178.528038:0:8887:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001b37133f/0xe2b7cc26e6811ba8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.528051:0:8887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b37133f/0xe2b7cc26e6811ba8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.528079:0:8887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001b37133f/0xe2b7cc26e6811ba8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.528089:0:8887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b37133f/0xe2b7cc26e6811ba8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.528098:0:8887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b37133f/0xe2b7cc26e6811ba8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.528107:0:8887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746431a00 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:3.0:1782222178.528112:0:8887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b37133f/0xe2b7cc26e6811ba8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.528136:0:8887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b37133f/0xe2b7cc26e6811ba8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.528151:0:8887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b37133f/0xe2b7cc26e6811ba8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.528160:0:8887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b37133f/0xe2b7cc26e6811ba8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222178.528216:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77bf2c2c-f408-43f9-ae59-449550631d05+6:2389:x1868795060750848:12345-192.168.203.27@tcp:1:lhsmtool_posix.0 Request processed in 10180us (10669us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222178.528226:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 52 00000100:00100000:1.0:1782222178.532626:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222178.533037:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060751232 00000100:00100000:0.0:1782222178.533051:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060751232 00000100:00100000:0.0:1782222178.533185:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 139 00000100:00100000:0.0:1782222178.533199:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+16:11408:x1868795060751232:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1782222178.533351:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e6811baf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.533373:0:13817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8e00/0xe2b7cc26e6811a9e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755858c expref: 16 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.533407:0:13817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e6811baf lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.533455:0:13817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8e00/0xe2b7cc26e6811a9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755858c expref: 16 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.533474:0:13817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8e00/0xe2b7cc26e6811a9e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755858c expref: 16 pid: 8465 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222178.533492:0:13817:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13817:1868795081799808:192.168.203.27@tcp:104: 00000100:00100000:0.0:1782222178.533615:0:13817:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087fb750c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782222178.537630:0:13817:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13817:1868795081799808:192.168.203.27@tcp:104: 00010000:00010000:1.0:1782222178.537681:0:13817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e6811baf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222178.541654:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222178.541874:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060751360 00000100:00100000:3.0:1782222178.541887:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060751360 00010000:00010000:3.0:1782222178.541953:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8e00/0xe2b7cc26e6811a9e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755858c expref: 17 pid: 8465 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222178.542004:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 75 00000100:00100000:3.0:1782222178.542016:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747561c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77bf2c2c-f408-43f9-ae59-449550631d05+17:2389:x1868795060751360:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782222178.542035:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222178.542044:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8e00/0xe2b7cc26e6811a9e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755858c expref: 17 pid: 8465 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.542070:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8e00/0xe2b7cc26e6811a9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755858c expref: 17 pid: 8465 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.542127:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8e00/0xe2b7cc26e6811a9e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755858c expref: 17 pid: 8465 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.542150:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0851377f00) 00010000:00010000:3.0:1782222178.542157:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e6811b00 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585af expref: 16 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.542170:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e6811baf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.542179:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e6811baf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.542187:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e6811baf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.542220:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782222178.542352:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747561c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77bf2c2c-f408-43f9-ae59-449550631d05+16:2389:x1868795060751360:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 337us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222178.542361:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 75 00010000:00010000:1.0:1782222178.543607:0:13817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e6811baf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.543633:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e6811baf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.549803:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811bb6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.549856:0:13817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811b69 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585cb expref: 16 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.549867:0:13817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811bb6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.549930:0:13817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811b69 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585cb expref: 16 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.549951:0:13817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811b69 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585cb expref: 16 pid: 8465 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222178.549970:0:13817:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747562a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13817:1868795081799936:192.168.203.27@tcp:104: 00000100:00100000:1.0:1782222178.550098:0:13817:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08492a1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782222178.558411:0:13817:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747562a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13817:1868795081799936:192.168.203.27@tcp:104: 00010000:00010000:0.0:1782222178.558453:0:13817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811bb6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222178.558746:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222178.558881:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060751488 00000100:00100000:2.0:1782222178.558890:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060751488 00010000:00010000:2.0:1782222178.559053:0:9532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811b69 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585cb expref: 17 pid: 8465 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222178.559139:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 76 00000100:00100000:2.0:1782222178.559160:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747561180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77bf2c2c-f408-43f9-ae59-449550631d05+17:2390:x1868795060751488:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782222178.559181:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782222178.559190:0:9532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811b69 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585cb expref: 17 pid: 8465 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.559225:0:9532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811b69 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585cb expref: 17 pid: 8465 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.559279:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811b69 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585cb expref: 17 pid: 8465 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.559300:0:9532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f087f8f1b00) 00010000:00010000:2.0:1782222178.559306:0:9532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811bb6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.559317:0:9532:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811bb6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.559326:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811bb6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.559360:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782222178.559405:0:13817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811bb6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.559412:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811bb6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222178.559442:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747561180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77bf2c2c-f408-43f9-ae59-449550631d05+16:2390:x1868795060751488:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 283us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222178.559450:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 76 00000001:00080000:1.0:1782222178.559565:0:13817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:1.0:1782222178.559739:0:13817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:1.0:1782222178.559782:0:13817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:1.0:1782222178.559886:0:13817:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747563800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13817:1868795081800064:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1782222178.559981:0:13817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222178.560018:0:13817:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08492a1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782222178.560061:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081800064 00000100:00100000:3.0:1782222178.560068:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081800064 00000100:00100000:3.0:1782222178.560118:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1782222178.560128:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:13817:x1868795081800064:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1782222178.560264:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:13817:x1868795081800064:12345-0@lo:1000:mdt00_004.0 Request processed in 137us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222178.560271:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1782222178.560377:0:13817:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747563800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13817:1868795081800064:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1782222178.560535:0:13817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1782222178.560591:0:13817:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747563800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13817:1868795081800192:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1782222178.560624:0:13817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222178.560656:0:13817:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746158480 going to sleep for 11 seconds 00000100:00100000:3.0:1782222178.560955:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081800192 00000100:00100000:3.0:1782222178.560971:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081800192 00000100:00100000:3.0:1782222178.561009:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1782222178.561018:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:13817:x1868795081800192:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1782222178.561163:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:13817:x1868795081800192:12345-0@lo:1000:mdt00_004.0 Request processed in 145us (537us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1782222178.561171:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1782222178.561925:0:13817:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747563800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13817:1868795081800192:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1782222178.562013:0:13817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811bb6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.562025:0:13817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811bb6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.562033:0:13817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811bb6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.562039:0:13817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744d400 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222178.562045:0:13817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811bb6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.562053:0:13817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811bb6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.562073:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f087f8f1b00) 00010000:00010000:1.0:1782222178.562077:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782222178.562081:0:13817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811bb6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.562087:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811bb6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.562120:0:13817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811af9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.562145:0:13817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811af9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.562151:0:13817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811af9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.562156:0:13817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83c00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222178.562159:0:13817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811af9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.562165:0:13817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811af9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.562173:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0851377f00) 00010000:00010000:1.0:1782222178.562176:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782222178.562193:0:13817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e6811b00 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585af expref: 19 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.562205:0:13817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e6811b00 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585af expref: 19 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.562214:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e6811b00 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585af expref: 19 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222178.562275:0:13817:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e6811b00 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585af expref: 19 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222178.562291:0:13817:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747563480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13817:1868795081800320:192.168.203.27@tcp:105: 00000100:00100000:1.0:1782222178.562403:0:13817:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746158480 going to sleep for 11 seconds 00000100:00100000:2.0:1782222178.567501:0:13817:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747563480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13817:1868795081800320:192.168.203.27@tcp:105: 00010000:00010000:2.0:1782222178.567542:0:13817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811af9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.567554:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811af9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.567605:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811bbd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.567656:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811bbd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.567670:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811bbd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.567683:0:13817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811bbd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.567689:0:13817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811bbd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.567695:0:13817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811bbd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.567701:0:13817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb82800 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222178.567705:0:13817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811bbd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.567713:0:13817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811bbd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.567736:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0851377f00) 00010000:00010000:2.0:1782222178.567739:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782222178.567743:0:13817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811bbd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.567748:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811bbd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.567758:0:13817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e6811baf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.567771:0:13817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e6811baf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.567777:0:13817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e6811baf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.567782:0:13817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb9e00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222178.567785:0:13817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e6811baf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.567791:0:13817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e6811baf lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.567800:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0851377f00) 00010000:00010000:2.0:1782222178.567802:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782222178.567805:0:13817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e6811baf lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.567810:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e6811baf lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222178.568038:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+19:11408:x1868795060751232:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 Request processed in 34840us (35426us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1782222178.568051:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 139 00000020:00080000:2.0:1782222178.568059:0:13817:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1782222178.572103:0:13806:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782222178.572118:0:13806:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782222178.573377:0:13806:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1782222178.573404:0:13806:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782222178.574659:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222178.574770:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222178.576022:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060751616 00000100:00100000:2.0:1782222178.576039:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060751616 00000100:00100000:2.0:1782222178.576108:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060751872 00000100:00100000:2.0:1782222178.576113:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060751872 00000100:00100000:2.0:1782222178.576136:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 31 00000100:00100000:2.0:1782222178.576193:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+20:11407:x1868795060751616:12345-192.168.203.27@tcp:49:lfs.0 00000100:00100000:2.0:1782222178.576387:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+20:11407:x1868795060751616:12345-192.168.203.27@tcp:49:lfs.0 Request processed in 207us (1740us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222178.576395:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 31 00000100:00100000:2.0:1782222178.576414:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 32 00000100:00100000:2.0:1782222178.576420:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087d4b9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+19:11408:x1868795060751872:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1782222178.577144:0:6530:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1782222178.577506:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:2.0:1782222178.577570:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811bc4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.577602:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811bc4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.577615:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811bc4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.577626:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811bc4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.577633:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811bc4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.578496:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811bc4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.578533:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782222178.578690:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087d4b9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+21:11408:x1868795060751872:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 Request processed in 2263us (3913us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1782222178.578737:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 32 00000020:00080000:2.0:1782222178.578745:0:6530:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782222178.579521:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782222178.579533:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811bc4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.579544:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83200 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:3.0:1782222178.579548:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811bc4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.579559:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811bc4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.579578:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f087f8f1b00) 00010000:00010000:3.0:1782222178.579581:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782222178.579587:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811bc4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.579603:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811bc4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222178.579631:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222178.579633:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222178.579634:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222178.593146:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222178.593355:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060752128 00000100:00100000:1.0:1782222178.593369:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060752128 00000100:00100000:1.0:1782222178.593449:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 140 00000100:00100000:1.0:1782222178.593462:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+21:11407:x1868795060752128:12345-192.168.203.27@tcp:58:lfs.0 00000040:00080000:1.0:1782222178.593715:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1782222178.593834:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+21:11407:x1868795060752128:12345-192.168.203.27@tcp:58:lfs.0 Request processed in 373us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222178.593843:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 140 00000100:00100000:1.0:1782222178.640438:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222178.640866:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060752256 00000100:00100000:0.0:1782222178.640890:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060752256 00000100:00100000:0.0:1782222178.640982:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 141 00000100:00100000:0.0:1782222178.640994:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747562680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+21:11410:x1868795060752256:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:0.0:1782222178.641027:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222178.641056:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e6811bcb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75585e7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.641150:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e6811bd2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.641171:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e6811bd2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.641204:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e6811bd2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.641225:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6811bd9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.641382:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6811bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.641392:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6811bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.641484:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e6811be0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.641497:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811aeb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585a8 expref: 22 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.641507:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e6811be0 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.641548:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811aeb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585a8 expref: 22 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.641563:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811aeb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585a8 expref: 22 pid: 13817 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222178.641579:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07465e1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6527:1868795081800448:192.168.203.27@tcp:104: 00000100:00100000:0.0:1782222178.641691:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087fb750c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782222178.654414:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07465e1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6527:1868795081800448:192.168.203.27@tcp:104: 00010000:00010000:2.0:1782222178.654464:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e6811be0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222178.659280:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222178.659597:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060752512 00000100:00100000:2.0:1782222178.659611:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060752512 00000100:00100000:2.0:1782222178.660472:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 33 00000100:00100000:2.0:1782222178.660491:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+23:6159:x1868795060752512:12345-192.168.203.27@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1782222178.661077:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+24:6159:x1868795060752512:12345-192.168.203.27@tcp:35:ldlm_bl.0 Request processed in 589us (1841us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1782222178.661087:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 33 00000100:00100000:0.0:1782222178.665669:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222178.665998:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060752640 00000100:00100000:2.0:1782222178.666011:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060752640 00010000:00010000:2.0:1782222178.666075:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811aeb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585a8 expref: 24 pid: 13817 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222178.666129:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 77 00000100:00100000:2.0:1782222178.666141:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07465e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+24:2389:x1868795060752640:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782222178.666343:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782222178.666352:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811aeb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585a8 expref: 24 pid: 13817 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.666369:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811aeb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585a8 expref: 24 pid: 13817 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.666423:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811aeb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585a8 expref: 24 pid: 13817 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.666441:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0851377f00) 00010000:00010000:2.0:1782222178.666447:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e6811be0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.666666:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e6811be0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.666675:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e6811be0 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222178.666879:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782222178.667021:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07465e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+23:2389:x1868795060752640:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 880us (1365us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222178.667032:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 77 00010000:00010000:0.0:1782222178.667084:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e6811be0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.667095:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e6811be0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782222178.667173:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1782222178.667178:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782222178.667204:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e6811be0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.667219:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e6811be0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.667263:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e6811bd2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.667272:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e6811bd2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.667279:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e6811bd2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.667286:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb9600 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222178.667291:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e6811bd2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.667299:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e6811bd2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.667310:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f0849b72000) 00010000:00010000:0.0:1782222178.667313:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782222178.667328:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e6811bd2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.667336:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e6811bd2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.667351:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6811bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.667358:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6811bd9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.667364:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6811bd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.667369:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb8400 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222178.667372:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6811bd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.667378:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6811bd9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.667386:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f0851377100) 00010000:00010000:0.0:1782222178.667388:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782222178.667391:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6811bd9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.667397:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6811bd9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.667442:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e6811bcb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585e7 expref: 23 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.669312:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e6811be0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585e7 expref: 22 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222178.669323:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0851377f00) 00010000:00010000:0.0:1782222178.669326:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782222178.669330:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fcb9e00, rc 0) 00000100:00100000:0.0:1782222178.669429:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747562680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+22:11410:x1868795060752256:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 28436us (29004us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222178.669439:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 141 00000100:00100000:3.0:1782222178.795048:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081800960:0@lo:400:kworker.0 00000100:00100000:0.0:1782222178.795051:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081800832:0@lo:400:kworker.0 00000100:00100000:2.0:1782222178.795176:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1868795081800704:0@lo:400:kworker.0 00000100:00100000:1.0:1782222178.795193:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081800576:0@lo:400:kworker.0 00000100:00100000:0.0:1782222178.797488:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222178.797561:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1868795081801344:0@lo:400:kworker.0 00000100:00100000:0.0:1782222178.797610:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222178.797630:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081801856:0@lo:400:kworker.0 00000100:00100000:0.0:1782222178.797655:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222178.798973:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081800832 00000100:00100000:0.0:1782222178.798991:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081800832 00000100:00100000:0.0:1782222178.799082:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1782222178.799095:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08526a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081800832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222178.799215:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08526a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081800832:12345-0@lo:400:kworker.0 Request processed in 123us (1736us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222178.799224:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1782222178.799442:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081800832:0@lo:400:kworker.0 00000100:00100000:0.0:1782222178.799504:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081801856 00000100:00100000:0.0:1782222178.799528:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081801856 00000100:00100000:0.0:1782222178.799578:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1782222178.799586:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08526a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081801856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222178.799633:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08526a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081801856:12345-0@lo:400:kworker.0 Request processed in 48us (1976us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222178.799639:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1782222178.799671:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081801856:0@lo:400:kworker.0 00000100:00080000:0.0:1782222178.799694:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782222178.799815:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081801344 00000100:00100000:0.0:1782222178.799820:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081801344 00000100:00080000:0.0:1782222178.799835:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782222178.799860:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1782222178.799865:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08526a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1868795081801344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222178.799902:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08526a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1868795081801344:12345-0@lo:400:kworker.0 Request processed in 38us (2291us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222178.799922:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00010000:00080000:0.0:1782222178.799952:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747cfe680 x1868795081801344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222178.799966:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1868795081801344:0@lo:400:kworker.0 00000100:00100000:3.0:1782222178.800423:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222178.800523:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081801472:0@lo:400:kworker.0 00000100:00100000:3.0:1782222178.800579:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222178.802901:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081800960 00000100:00100000:0.0:1782222178.802932:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081800960 00000100:00100000:0.0:1782222178.803033:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1782222178.803045:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081800960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222178.803194:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081800960:12345-0@lo:400:kworker.0 Request processed in 151us (2777us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222178.803202:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1782222178.803316:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081801472 00000100:00100000:0.0:1782222178.803321:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081801472 00000100:00100000:0.0:1782222178.803363:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1782222178.803371:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081801472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222178.803393:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081800960:0@lo:400:kworker.0 00000100:00100000:0.0:1782222178.803427:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081801472:12345-0@lo:400:kworker.0 Request processed in 53us (2843us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222178.803429:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081801472:0@lo:400:kworker.0 00000100:00100000:0.0:1782222178.803445:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1782222178.804368:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222178.804435:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1868795081801216:0@lo:400:kworker.0 00000100:00100000:2.0:1782222178.804479:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222178.804499:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1868795081801728:0@lo:400:kworker.0 00000100:00100000:2.0:1782222178.804522:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222178.804665:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081800704 00000100:00100000:0.0:1782222178.804672:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081800704 00000100:00100000:0.0:1782222178.804726:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081801216 00000100:00100000:0.0:1782222178.804730:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081801216 00000100:00100000:0.0:1782222178.804768:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081801728 00000100:00100000:0.0:1782222178.804772:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081801728 00000100:00100000:0.0:1782222178.804789:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1782222178.804797:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1868795081800704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222178.804855:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1868795081800704:12345-0@lo:400:kworker.0 Request processed in 58us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222178.804863:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1782222178.804877:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1782222178.804896:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074767a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1868795081801216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222178.804935:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074767a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1868795081801216:12345-0@lo:400:kworker.0 Request processed in 53us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222178.804941:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1782222178.804953:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1782222178.804958:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1868795081801728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222178.805499:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1868795081800704:0@lo:400:kworker.0 00000100:00100000:2.0:1782222178.805515:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1868795081801216:0@lo:400:kworker.0 00000100:00080000:2.0:1782222178.805599:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782222178.805604:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782222178.806019:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1868795081801728:12345-0@lo:400:kworker.0 Request processed in 1058us (1493us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222178.806039:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1782222178.807324:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222178.807380:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1868795081801088:0@lo:400:kworker.0 00000100:00100000:1.0:1782222178.808052:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222178.808182:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081800576 00000100:00100000:0.0:1782222178.808189:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081800576 00000100:00100000:0.0:1782222178.808263:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1782222178.808272:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3655:x1868795081800576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222178.808330:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3655:x1868795081800576:12345-0@lo:400:kworker.0 Request processed in 60us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222178.808338:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1782222178.808591:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1868795081801600:0@lo:400:kworker.0 00000100:00100000:1.0:1782222178.808617:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222178.808655:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081800576:0@lo:400:kworker.0 00000100:00100000:1.0:1782222178.808681:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081801088 00000100:00100000:1.0:1782222178.808685:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081801088 00000100:00100000:1.0:1782222178.808711:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081801600 00000100:00100000:1.0:1782222178.808715:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081801600 00000100:00080000:1.0:1782222178.808736:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782222178.808759:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1782222178.808766:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747562300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1868795081801088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222178.808805:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747562300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1868795081801088:12345-0@lo:400:kworker.0 Request processed in 39us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222178.808825:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1782222178.809328:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1782222178.809342:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1868795081801600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222178.809382:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1868795081801600:12345-0@lo:400:kworker.0 Request processed in 44us (764us total) trans 0 rc 0/0 00010000:00080000:2.0:1782222178.814711:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747cfed80 x1868795081801728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222178.815161:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1868795081801728:0@lo:400:kworker.0 00000100:00100000:0.0:1782222178.820588:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1868795081801088:0@lo:400:kworker.0 00000100:00100000:0.0:1782222178.820608:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1868795081801600:0@lo:400:kworker.0 00000100:00100000:1.0:1782222178.820683:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00010000:00010000:1.0:1782222178.858729:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782222179.626427:0:13806:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782222179.626436:0:13806:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782222179.626463:0:13806:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1782222179.626469:0:13806:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782222179.627393:0:13806:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cff100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1868795081801984:192.168.203.27@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782222179.627486:0:13806:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074765fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1782222179.631959:0:13806:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cff100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1868795081801984:192.168.203.27@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1782222179.633863:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222179.633899:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060752768 00000100:00100000:1.0:1782222179.633918:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060752768 00000100:00100000:1.0:1782222179.633980:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 142 00000100:00100000:1.0:1782222179.633989:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747560e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+22:11421:x1868795060752768:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1782222179.634026:0:8465:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1782222179.634152:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747560e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+22:11421:x1868795060752768:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 Request processed in 163us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222179.634160:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 142 00000100:00080000:1.0:1782222179.634185:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782222179.638154:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222179.639722:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060753024 00000100:00100000:1.0:1782222179.639735:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060753024 00000100:00100000:1.0:1782222179.639796:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 143 00000100:00100000:1.0:1782222179.639807:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08526a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+22:11421:x1868795060753024:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782222179.639828:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222179.639847:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811be7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75585ee expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222179.640225:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811bee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222179.640262:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811bee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222179.640276:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811bee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782222179.640289:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1782222179.640398:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811be7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585ee expref: 25 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222179.640416:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811bee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585ee expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222179.640425:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0851377f00) 00010000:00010000:1.0:1782222179.640428:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782222179.640432:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744d400, rc 0) 00000100:00100000:1.0:1782222179.640493:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08526a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+24:11421:x1868795060753024:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 688us (2348us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1782222179.640501:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 143 00000040:00080000:3.0:1782222179.645642:0:14322:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782222179.645653:0:14322:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782222179.645685:0:14322:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1782222179.645691:0:14322:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782222179.658421:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222179.658577:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222179.658697:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060753152 00000100:00100000:1.0:1782222179.658706:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060753152 00000100:00100000:1.0:1782222179.658765:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 11 00000100:00100000:1.0:1782222179.658775:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08526a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77bf2c2c-f408-43f9-ae59-449550631d05+24:2389:x1868795060753152:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782222179.658792:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222179.658815:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811bee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585ee expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222179.658845:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0851377f00) 00010000:00010000:1.0:1782222179.658850:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782222179.659338:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060753408 00000100:00100000:0.0:1782222179.659344:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060753408 00000100:00100000:0.0:1782222179.659380:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 144 00000100:00100000:0.0:1782222179.659388:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08526a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+24:11421:x1868795060753408:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1782222179.659456:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8e00/0xe2b7cc26e6811bfc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222179.659470:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8e00/0xe2b7cc26e6811bfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222179.659545:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8e00/0xe2b7cc26e6811bfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222179.659697:0:13817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8e00/0xe2b7cc26e6811bfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222179.659710:0:13817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8e00/0xe2b7cc26e6811bfc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222179.659716:0:13817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8e00/0xe2b7cc26e6811bfc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222179.659722:0:13817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb8e00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222179.659727:0:13817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8e00/0xe2b7cc26e6811bfc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222179.659734:0:13817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8e00/0xe2b7cc26e6811bfc lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222179.659744:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0851377f00) 00010000:00010000:0.0:1782222179.659746:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782222179.659749:0:13817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8e00/0xe2b7cc26e6811bfc lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222179.659756:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8e00/0xe2b7cc26e6811bfc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222179.659855:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08526a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+25:11421:x1868795060753408:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 Request processed in 466us (1277us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1782222179.659864:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 144 00000100:00100000:1.0:1782222179.660001:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08526a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77bf2c2c-f408-43f9-ae59-449550631d05+24:2389:x1868795060753152:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 1227us (1588us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222179.660010:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 11 00000040:00080000:0.0:1782222179.661428:0:13806:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782222179.661438:0:13806:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782222179.665190:0:13806:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1782222179.665210:0:13806:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782222179.668056:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222179.675092:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060753664 00000100:00100000:3.0:1782222179.675106:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060753664 00000100:00100000:0.0:1782222179.675515:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 34 00000100:00100000:0.0:1782222179.675529:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+24:11421:x1868795060753664:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1782222179.675781:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+25:11421:x1868795060753664:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 Request processed in 255us (7733us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1782222179.675790:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 34 00010000:00010000:0.0:1782222179.890425:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222180.907578:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222181.355458:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782222181.355484:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081802112:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782222181.355558:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222181.355694:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081802112 00000100:00100000:3.0:1782222181.355714:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081802112 00000100:00100000:3.0:1782222181.355776:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1782222181.355785:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081802112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782222181.355832:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222181.355880:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081802112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222181.355898:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1782222181.356109:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081802240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782222181.356142:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222181.356207:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081802240 00000100:00100000:1.0:1782222181.356212:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081802240 00000100:00100000:1.0:1782222181.356268:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1782222181.356277:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3655:x1868795081802240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782222181.356288:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782222181.356327:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3655:x1868795081802240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222181.356334:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1782222181.356580:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081802240:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1782222181.356731:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782222181.356768:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081802112:0@lo:13:osp-pre-1-1.0 00000040:00080000:0.0:1782222181.599056:0:14373:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782222181.599074:0:14373:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782222181.599116:0:14373:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1782222181.599128:0:14373:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1782222181.742103:0:13806:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782222181.742119:0:13806:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782222181.742149:0:13806:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1782222181.742160:0:13806:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782222181.781452:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222181.781732:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060753920 00000100:00100000:0.0:1782222181.781746:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060753920 00000100:00100000:0.0:1782222181.781852:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 145 00000100:00100000:0.0:1782222181.781865:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+25:11442:x1868795060753920:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:0.0:1782222181.781909:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222181.781940:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8a00/0xe2b7cc26e6811c03 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75585f5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222181.782112:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6811c0a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222181.782132:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6811c0a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222181.782150:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6811c0a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782222181.782164:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1782222181.782378:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8a00/0xe2b7cc26e6811c03 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585f5 expref: 28 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222181.782423:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6811c0a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585f5 expref: 27 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222181.782434:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0851377f00) 00010000:00010000:0.0:1782222181.782437:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1782222181.782442:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fcb8200, rc 0) 00000100:00100000:0.0:1782222181.782539:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+27:11442:x1868795060753920:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 676us (1101us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1782222181.782549:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 145 00000100:00080000:2.0:1782222181.782764:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782222181.785945:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222181.792783:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060754048 00000100:00100000:2.0:1782222181.792805:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060754048 00000100:00100000:2.0:1782222181.792920:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 146 00000100:00100000:2.0:1782222181.792933:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+27:11442:x1868795060754048:12345-192.168.203.27@tcp:54:lfs.0 00010000:00010000:2.0:1782222181.793030:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811c18 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222181.793055:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811c18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222181.793069:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811c18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222181.793116:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811c18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222181.793125:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811c18 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222181.793151:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811c18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222181.793158:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83000 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222181.793164:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811c18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222181.793173:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811c18 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222181.793188:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0851377f00) 00010000:00010000:2.0:1782222181.793191:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782222181.793197:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811c18 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222181.793204:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811c18 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222181.793421:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+27:11442:x1868795060754048:12345-192.168.203.27@tcp:54:lfs.0 Request processed in 489us (7488us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222181.793430:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 146 00000100:00100000:3.0:1782222181.900532:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222181.901141:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060754176 00000100:00100000:0.0:1782222181.901159:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060754176 00000100:00100000:0.0:1782222181.901522:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 53 00000100:00100000:0.0:1782222181.901536:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+6:2390:x1868795060754176:12345-192.168.203.27@tcp:101:cat.0 00010000:00010000:0.0:1782222181.901562:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222181.901590:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c361e703/0xe2b7cc26e6811c1f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75585fc expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1782222181.901596:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1782222181.901635:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a3a8d61, atime: 0x6a3a8d60, ctime: 0x6a3a8d61, blocks: 0x8 00010000:00010000:2.0:1782222181.905535:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=380s v=(0 0) 00010000:00010000:2.0:1782222181.905551:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782222181.905571:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c361e703/0xe2b7cc26e6811c1f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585fc expref: 7 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222181.905613:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c361e703/0xe2b7cc26e6811c1f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585fc expref: 7 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222181.905674:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fcb8a00, rc 0) 00000100:00100000:2.0:1782222181.905795:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+7:2390:x1868795060754176:12345-192.168.203.27@tcp:101:cat.0 Request processed in 4260us (5271us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222181.905806:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 53 00000100:00100000:2.0:1782222181.918488:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222181.918659:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060754304 00000100:00100000:1.0:1782222181.918673:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060754304 00002000:00100000:1.0:1782222181.918741:0:8448:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff8f0881727800 x1868795060754304/t0(0) o3->77bf2c2c-f408-43f9-ae59-449550631d05@192.168.203.27@tcp:147/0 lens 488/0 e 0 to 0 dl 1782222192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782222181.918755:0:8448:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f0881727800 with x1868795060754304 ext(0->4095) 00002000:00010000:1.0:1782222181.918762:0:8448:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f0881727800 00000100:00100000:1.0:1782222181.918802:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 3 00000100:00100000:1.0:1782222181.918813:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77bf2c2c-f408-43f9-ae59-449550631d05+7:2389:x1868795060754304:12345-192.168.203.27@tcp:3:cat.0 00000100:00100000:1.0:1782222181.919049:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77bf2c2c-f408-43f9-ae59-449550631d05+7:2389:x1868795060754304:12345-192.168.203.27@tcp:3:cat.0 Request processed in 236us (587us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1782222181.919074:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 3 00002000:00100000:1.0:1782222181.919083:0:8448:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff8f0881727800 x1868795060754304/t0(0) o3->77bf2c2c-f408-43f9-ae59-449550631d05@192.168.203.27@tcp:147/0 lens 488/4536 e 0 to 0 dl 1782222192 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782222181.919091:0:8448:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f0881727800 with x1868795060754304 ext(0->4095) 00002000:00010000:1.0:1782222181.919095:0:8448:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f0881727800 00010000:00010000:1.0:1782222181.931783:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782222181.995081:0:13809:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1782222182.378860:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782222182.378902:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081802368:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782222182.379003:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222182.379271:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081802368 00000100:00100000:1.0:1782222182.379282:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081802368 00000100:00100000:1.0:1782222182.379359:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1782222182.379370:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08526a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081802368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782222182.379418:0:7480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1782222182.379479:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08526a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081802368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222182.379487:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1782222182.379681:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782222182.379695:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081802496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782222182.379732:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222182.379968:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081802496 00000100:00100000:0.0:1782222182.379973:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081802496 00000100:00100000:0.0:1782222182.380012:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1782222182.380020:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081802496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782222182.380068:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1782222182.380116:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081802496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222182.380122:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1782222182.380189:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081802368:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782222182.380902:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081802496:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782222182.890463:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782222182.890485:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747c6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081802624:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782222182.890551:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222182.890613:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081802624 00000100:00100000:1.0:1782222182.890621:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081802624 00000100:00100000:1.0:1782222182.890669:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1782222182.890678:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081802624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782222182.890718:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1782222182.890762:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081802624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222182.890784:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1782222182.890831:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747c6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081802624:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1782222182.890906:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1782222182.890958:0:8886:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 381919721612ns, next at 382919718883ns, rc = 0 00000100:00100000:3.0:1782222182.890978:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782222182.890988:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081802752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782222182.891021:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222182.891052:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081802752 00000100:00100000:3.0:1782222182.891056:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081802752 00000100:00100000:3.0:1782222182.891141:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1782222182.891148:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3656:x1868795081802752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782222182.891160:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1782222182.891197:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3656:x1868795081802752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222182.891213:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1782222182.891277:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081802752:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782222182.892941:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782222182.958388:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222183.342550:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222183.342585:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222183.342609:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222183.342630:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222183.342827:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222183.343461:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222183.343496:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222183.347603:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060754944 00000100:00100000:0.0:1782222183.347619:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060754944 00000100:00100000:0.0:1782222183.347706:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060754816 00000100:00100000:0.0:1782222183.347710:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060754816 00000100:00100000:0.0:1782222183.347740:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 152 00000100:00100000:0.0:1782222183.347749:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77bf2c2c-f408-43f9-ae59-449550631d05+7:2387:x1868795060754944:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222183.347831:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77bf2c2c-f408-43f9-ae59-449550631d05+7:2387:x1868795060754944:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 83us (5220us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222183.347839:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 152 00000100:00100000:0.0:1782222183.347855:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 153 00000100:00100000:0.0:1782222183.347861:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77bf2c2c-f408-43f9-ae59-449550631d05+7:2387:x1868795060754816:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222183.347899:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77bf2c2c-f408-43f9-ae59-449550631d05+7:2387:x1868795060754816:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 38us (4440us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222183.347905:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 153 00000100:00100000:2.0:1782222183.350411:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060754688 00000100:00100000:2.0:1782222183.350426:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060754688 00000100:00080000:2.0:1782222183.350445:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782222183.350450:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782222183.350479:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060754432 00000100:00100000:3.0:1782222183.350484:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060754432 00000100:00080000:2.0:1782222183.350491:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782222183.350524:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060755200 00000100:00100000:2.0:1782222183.350527:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060755200 00000100:00100000:3.0:1782222183.350528:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 390 00000100:00100000:3.0:1782222183.350537:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2387:x1868795060754432:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222183.350544:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060754560 00000100:00100000:2.0:1782222183.350547:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060754560 00000100:00100000:2.0:1782222183.350559:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060755072 00000100:00100000:2.0:1782222183.350562:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060755072 00000100:00100000:2.0:1782222183.350575:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 322 00000100:00100000:2.0:1782222183.350581:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+5:2387:x1868795060754688:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222183.350600:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2387:x1868795060754432:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 64us (8060us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222183.350606:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+5:2387:x1868795060754688:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 26us (8021us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222183.350608:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 390 00000100:00100000:3.0:1782222183.350642:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 323 00000100:00100000:3.0:1782222183.350660:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2387:x1868795060755200:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222183.350686:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2387:x1868795060755200:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 37us (8055us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222183.350693:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 323 00000100:00100000:3.0:1782222183.350707:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 324 00000100:00100000:3.0:1782222183.350713:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+27:2387:x1868795060754560:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222183.350737:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+27:2387:x1868795060754560:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 24us (8087us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222183.350751:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 324 00000100:00100000:3.0:1782222183.350764:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 325 00000100:00100000:3.0:1782222183.350770:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2387:x1868795060755072:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222183.350795:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2387:x1868795060755072:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 26us (7299us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222183.350801:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 325 00000100:00100000:2.0:1782222183.350904:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 322 00000100:00080000:2.0:1782222183.350920:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782222183.350922:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782222183.919101:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081802880:0@lo:400:kworker.0 00000100:00100000:3.0:1782222183.919178:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747716300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081803264:0@lo:400:kworker.0 00000100:00100000:3.0:1782222183.919272:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222183.919335:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081803776:0@lo:400:kworker.0 00000100:00100000:2.0:1782222183.919428:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081803136:0@lo:400:kworker.0 00000100:00100000:3.0:1782222183.919852:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222183.919898:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081804288:0@lo:400:kworker.0 00000100:00100000:3.0:1782222183.919921:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222183.920006:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1782222183.920014:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1868795081803392:0@lo:400:kworker.0 00000100:00100000:3.0:1782222183.920042:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222183.920059:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081803904:0@lo:400:kworker.0 00000100:00100000:3.0:1782222183.920081:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222183.920098:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081804416:0@lo:400:kworker.0 00000100:00100000:3.0:1782222183.920121:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222183.920152:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081803008:0@lo:400:kworker.0 00000100:00100000:3.0:1782222183.920177:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222183.920194:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1868795081803520:0@lo:400:kworker.0 00000100:00100000:0.0:1782222183.920346:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222183.920567:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222183.920619:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1868795081804032:0@lo:400:kworker.0 00000100:00100000:3.0:1782222183.920644:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222183.920681:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081803264 00000100:00100000:0.0:1782222183.920694:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081803264 00000100:00100000:3.0:1782222183.920696:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081803776 00000100:00100000:3.0:1782222183.920706:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081803776 00000100:00100000:3.0:1782222183.920756:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081804288 00000100:00100000:3.0:1782222183.920760:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081804288 00000100:00100000:0.0:1782222183.920772:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1782222183.920795:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081803904 00000100:00100000:3.0:1782222183.920801:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081803904 00000100:00100000:0.0:1782222183.920805:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081803264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222183.920820:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081804416 00000100:00100000:3.0:1782222183.920825:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081804416 00000100:00100000:3.0:1782222183.920844:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1782222183.920855:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081803776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222183.920920:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081803264:12345-0@lo:400:kworker.0 Request processed in 122us (1647us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222183.920930:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1782222183.921156:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222183.921201:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074764b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1868795081803648:0@lo:400:kworker.0 00000100:00100000:2.0:1782222183.921226:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222183.921336:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1868795081804160:0@lo:400:kworker.0 00000100:00100000:2.0:1782222183.921360:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222183.921473:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081803776:12345-0@lo:400:kworker.0 Request processed in 620us (1620us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222183.921737:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081803136 00000100:00100000:1.0:1782222183.921743:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081803136 00000100:00100000:1.0:1782222183.921781:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1782222183.921789:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081803136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222183.921833:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081803136:12345-0@lo:400:kworker.0 Request processed in 45us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222183.921840:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1782222183.922059:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081802880 00000100:00100000:1.0:1782222183.922064:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081802880 00000100:00100000:1.0:1782222183.922090:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1782222183.922096:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3656:x1868795081802880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222183.922131:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3656:x1868795081802880:12345-0@lo:400:kworker.0 Request processed in 35us (1789us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222183.922138:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1782222183.922190:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081802880:0@lo:400:kworker.0 00000100:00080000:1.0:1782222183.922267:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782222183.922278:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081803392 00000100:00100000:1.0:1782222183.922282:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081803392 00000100:00100000:1.0:1782222183.922303:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081803008 00000100:00100000:1.0:1782222183.922306:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081803008 00000100:00100000:1.0:1782222183.922318:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081803520 00000100:00100000:1.0:1782222183.922320:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081803520 00000100:00100000:1.0:1782222183.922337:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081804032 00000100:00100000:1.0:1782222183.922340:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081804032 00000100:00100000:1.0:1782222183.922351:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081803648 00000100:00100000:1.0:1782222183.922360:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081803648 00000100:00100000:1.0:1782222183.922376:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081804160 00000100:00100000:1.0:1782222183.922379:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081804160 00000100:00100000:1.0:1782222183.922392:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1782222183.922398:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1868795081803392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222183.922430:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1868795081803392:12345-0@lo:400:kworker.0 Request processed in 32us (2387us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222183.922436:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1782222183.922447:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1782222183.922453:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847003480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081803008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222183.922492:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847003480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081803008:12345-0@lo:400:kworker.0 Request processed in 38us (2313us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222183.922498:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1782222183.922509:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1782222183.922514:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1868795081803520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222183.922539:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1868795081803520:12345-0@lo:400:kworker.0 Request processed in 25us (1974us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222183.922544:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1782222183.922554:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1782222183.922560:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847001c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1868795081804032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222183.922584:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847001c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1868795081804032:12345-0@lo:400:kworker.0 Request processed in 25us (1940us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222183.922590:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1782222183.922600:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1782222183.922605:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747562a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1868795081803648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222183.922628:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747562a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1868795081803648:12345-0@lo:400:kworker.0 Request processed in 24us (1402us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222183.922640:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1782222183.922651:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1782222183.922656:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1868795081804160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222183.922681:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1868795081804160:12345-0@lo:400:kworker.0 Request processed in 26us (1321us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222183.922686:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1782222183.930108:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1782222183.930155:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1782222183.930159:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081804288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222183.930188:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877199f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3655:x1868795081803904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222183.930291:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1782222183.930324:0:8443:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1782222183.930334:0:8443:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1782222183.930408:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1782222183.930420:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3655:x1868795081804416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222183.931313:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877199f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3655:x1868795081803904:12345-0@lo:400:kworker.0 Request processed in 1141us (11227us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222183.931323:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000004:00080000:2.0:1782222183.932139:0:6505:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000001:00080000:2.0:1782222183.932163:0:6505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:2.0:1782222183.932190:0:6505:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f08492a1f00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1782222183.932194:0:6505:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8f07474d6a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f08492a1c00 00000020:00080000:2.0:1782222183.932197:0:6505:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8f07474d6700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f08450cfe00 00000020:00080000:2.0:1782222183.932211:0:6505:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1782222183.932221:0:6558:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1782222183.932303:0:6558:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:2.0:1782222183.932346:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081803136:0@lo:400:kworker.0 00010000:00080000:2.0:1782222183.932362:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074764b100 x1868795081803648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222183.932382:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074764b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1868795081803648:0@lo:400:kworker.0 00010000:00080000:2.0:1782222183.932397:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074561e300 x1868795081804160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222183.932405:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1868795081804160:0@lo:400:kworker.0 00000100:00100000:2.0:1782222183.932629:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081803008:0@lo:400:kworker.0 00000100:00100000:2.0:1782222183.932641:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1868795081803520:0@lo:400:kworker.0 00000100:00100000:2.0:1782222183.932652:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1868795081804032:0@lo:400:kworker.0 00010000:00010000:2.0:1782222183.932701:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811b9a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222183.932712:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811b9a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222183.932719:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811b9a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222183.932725:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744ce00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222183.932729:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811b9a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222183.932736:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811b9a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222183.932752:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f087f8f1b00) 00010000:00010000:2.0:1782222183.932755:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782222183.932760:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811b9a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222183.932773:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811b9a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222183.932841:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08412aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081804544:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1782222183.932904:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222183.932946:0:8442:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1782222183.932954:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081804544 00000100:00100000:2.0:1782222183.932959:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081804544 00000100:00100000:2.0:1782222183.932985:0:8442:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1782222183.932993:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1782222183.933000:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3653:x1868795081804544:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1782222183.933182:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1782222183.933186:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1782222177 -> 1782222177 00002000:00010000:2.0:1782222183.933188:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 1782222176 -> 1782222176 00002000:00010000:2.0:1782222183.933191:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1782222177 -> 1782222177 00002000:00010000:2.0:1782222183.933193:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1782222183.933229:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3653:x1868795081804544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 228us (324us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1782222183.933273:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:2.0:1782222183.933302:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f08412aaa00/2, rc 0, transno 4294967313 00000100:00100000:2.0:1782222183.933307:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08412aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081804544:0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1782222183.933434:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782222183.933440:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1782222183.934265:0:8436:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:2.0:1782222183.934274:0:8436:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000100:00100000:3.0:1782222183.935571:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1868795081803392:0@lo:400:kworker.0 00000100:00100000:3.0:1782222183.935591:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081803904:0@lo:400:kworker.0 00000100:00100000:3.0:1782222183.935605:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747716300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081803264:0@lo:400:kworker.0 00000100:00100000:3.0:1782222183.935617:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081803776:0@lo:400:kworker.0 00000100:00100000:1.0:1782222183.935853:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3655:x1868795081804416:12345-0@lo:400:kworker.0 Request processed in 5433us (15727us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222183.935862:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1782222183.935979:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081804416:0@lo:400:kworker.0 00000100:00100000:0.0:1782222183.940091:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081804288:12345-0@lo:400:kworker.0 Request processed in 9946us (20153us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222183.940111:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1782222183.944150:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081804288:0@lo:400:kworker.0 00000001:00080000:0.0:1782222183.944650:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:0.0:1782222183.944674:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00010000:00010000:3.0:1782222183.978477:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222185.008272:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222186.026588:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222186.475560:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081804672:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782222186.475647:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222186.475946:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081804672 00000100:00100000:2.0:1782222186.475960:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081804672 00000100:00100000:2.0:1782222186.476075:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1782222186.476090:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847000000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081804672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782222186.476131:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782222186.476215:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847000000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081804672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 131us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222186.476224:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:3.0:1782222186.476398:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782222186.476466:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081804672:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782222186.486268:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782222186.486306:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087701bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081804800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782222186.486412:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222186.486718:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081804800 00000100:00100000:0.0:1782222186.486730:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081804800 00000100:00100000:0.0:1782222186.486790:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1782222186.486800:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081804800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782222186.486828:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782222186.487103:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081804800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 303us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222186.487110:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:2.0:1782222186.487550:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782222186.487606:0:3656:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1782222186.487616:0:3656:0:(osp_trans.c:1042:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:2.0:1782222186.487663:0:3656:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f08412aed80, transno 4294967305 00000100:00100000:2.0:1782222186.487699:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087701bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081804800:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782222187.051519:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222187.374118:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222187.374336:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060755328 00000100:00100000:1.0:1782222187.374359:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060755328 00000100:00100000:1.0:1782222187.374460:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 147 00000100:00100000:1.0:1782222187.374472:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+13:11087:x1868795060755328:12345-192.168.203.27@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1782222187.374606:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+13:11087:x1868795060755328:12345-192.168.203.27@tcp:60:lhsmtool_posix.0 Request processed in 136us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222187.374615:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 147 00000100:00080000:2.0:1782222187.374866:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782222187.380533:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222187.380698:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060755456 00000100:00100000:0.0:1782222187.380711:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060755456 00000100:00100000:0.0:1782222187.380809:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 148 00000100:00100000:0.0:1782222187.380822:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+5:11087:x1868795060755456:12345-192.168.203.27@tcp:60:lhsmtool_posix.0 00000100:00080000:2.0:1782222187.380958:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782222187.381752:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+5:11087:x1868795060755456:12345-192.168.203.27@tcp:60:lhsmtool_posix.0 Request processed in 928us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222187.381782:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 148 00000100:00100000:0.0:1782222187.387628:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222187.392157:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060755712 00000100:00100000:2.0:1782222187.392394:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060755712 00000100:00100000:2.0:1782222187.392983:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 35 00000100:00100000:2.0:1782222187.393063:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+13:11087:x1868795060755712:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1782222187.393793:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+14:11087:x1868795060755712:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 Request processed in 797us (6179us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1782222187.393804:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 35 00000100:00100000:0.0:1782222187.504124:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782222187.504165:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747c6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081804928:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782222187.504324:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222187.504730:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081804928 00000100:00100000:1.0:1782222187.504743:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081804928 00000100:00100000:1.0:1782222187.504816:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1782222187.504826:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087701bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081804928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782222187.504884:0:7480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1782222187.504966:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087701bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081804928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222187.504975:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1782222187.505300:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782222187.505318:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747c6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081805056:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782222187.505360:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222187.505395:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081805056 00000100:00100000:1.0:1782222187.505399:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081805056 00000100:00100000:1.0:1782222187.505425:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1782222187.505432:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081805056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782222187.505460:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1782222187.505497:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081805056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222187.505504:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1782222187.505551:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747c6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081805056:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782222187.505698:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747c6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081804928:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782222187.780502:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222187.780676:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060755840 00000100:00100000:2.0:1782222187.780689:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060755840 00000100:00100000:2.0:1782222187.780801:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 149 00000100:00100000:2.0:1782222187.780912:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847001180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb78d98d-0650-4da4-8eeb-708f911905dd+5:11900:x1868795060755840:12345-192.168.203.27@tcp:101:lsof.0 00010000:00010000:2.0:1782222187.780942:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222187.780969:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811c26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558603 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1782222187.781095:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782222187.782100:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811c2d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222187.782125:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811c2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222187.782137:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811c2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782222187.782210:0:8465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782222187.782214:0:8465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782222187.782642:0:8465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811c2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222187.782685:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811c26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558603 expref: 7 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222187.782709:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811c2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558603 expref: 6 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222187.782719:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0851377900) 00010000:00010000:2.0:1782222187.782722:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782222187.782726:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb82800, rc 0) 00000100:00100000:2.0:1782222187.783564:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847001180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb78d98d-0650-4da4-8eeb-708f911905dd+6:11900:x1868795060755840:12345-192.168.203.27@tcp:101:lsof.0 Request processed in 2729us (3070us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222187.783598:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 149 00000100:00100000:0.0:1782222188.012318:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782222188.012348:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747c6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081805184:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782222188.012447:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222188.012589:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081805184 00000100:00100000:1.0:1782222188.012599:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081805184 00000100:00100000:1.0:1782222188.012676:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1782222188.012689:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081805184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782222188.012731:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1782222188.012786:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081805184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222188.012794:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:0.0:1782222188.013143:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782222188.013192:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747c6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081805184:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782222188.014579:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b785180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081805312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782222188.014677:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222188.015120:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081805312 00000100:00100000:3.0:1782222188.015130:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081805312 00000100:00100000:3.0:1782222188.015213:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1782222188.015224:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1868795081805312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782222188.015300:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1782222188.015377:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1868795081805312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222188.015385:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1782222188.015576:0:3655:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1782222188.015583:0:3655:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f0747cfca80, transno 4294967310 00000004:00080000:2.0:1782222188.015602:0:3655:0:(osp_trans.c:1042:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1782222188.015635:0:3655:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff8f08412aaa00 x1868795081804544/t4294967313(4294967313) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1782222199 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222188.015665:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b785180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081805312:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782222188.015911:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782222188.075315:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222188.456334:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222188.456391:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222188.456415:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060756096 00000100:00100000:0.0:1782222188.456425:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222188.456431:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060756096 00000100:00100000:0.0:1782222188.456466:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222188.456493:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222188.456509:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060756608 00000100:00100000:3.0:1782222188.456514:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060756608 00000100:00100000:0.0:1782222188.456524:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222188.456538:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060756224 00000100:00100000:3.0:1782222188.456542:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060756224 00000100:00100000:3.0:1782222188.456565:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 332 00000100:00100000:3.0:1782222188.456578:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+14:2387:x1868795060756096:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222188.456588:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222188.456609:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060756736 00000100:00100000:0.0:1782222188.456614:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060756736 00000100:00100000:0.0:1782222188.456654:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 333 00000100:00100000:0.0:1782222188.456662:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb78d98d-0650-4da4-8eeb-708f911905dd+6:2387:x1868795060756608:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222188.456723:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060756352 00000100:00100000:2.0:1782222188.456730:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060756352 00000100:00100000:0.0:1782222188.456730:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb78d98d-0650-4da4-8eeb-708f911905dd+6:2387:x1868795060756608:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 66us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222188.456756:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 333 00000100:00100000:0.0:1782222188.456781:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 334 00000100:00100000:2.0:1782222188.456784:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060756480 00000100:00100000:2.0:1782222188.456788:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060756480 00000100:00100000:0.0:1782222188.456792:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b786a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+5:2387:x1868795060756224:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222188.456829:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b786a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+5:2387:x1868795060756224:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 40us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222188.456833:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 158 00000100:00100000:0.0:1782222188.456851:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 334 00000100:00100000:2.0:1782222188.456857:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b784700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+6:2387:x1868795060756352:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222188.456870:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 335 00000100:00100000:0.0:1782222188.456880:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0875aae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2387:x1868795060756736:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222188.456897:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b784700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+6:2387:x1868795060756352:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 43us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222188.456906:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 158 00000100:00100000:0.0:1782222188.456916:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0875aae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2387:x1868795060756736:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 36us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222188.456926:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 159 00000100:00100000:0.0:1782222188.456927:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 335 00000100:00100000:2.0:1782222188.456938:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b785180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+5:2387:x1868795060756480:12345-192.168.203.27@tcp:400:kworker.0 00000100:00080000:0.0:1782222188.456956:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782222188.456963:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782222188.456967:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782222188.456971:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b785180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+5:2387:x1868795060756480:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 35us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222188.456980:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 159 00000100:00100000:2.0:1782222188.457027:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060755968 00000100:00100000:2.0:1782222188.457040:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060755968 00000100:00100000:2.0:1782222188.457069:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 392 00000100:00100000:2.0:1782222188.457077:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2387:x1868795060755968:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222188.457106:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2387:x1868795060755968:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 30us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222188.457114:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 392 00000100:00100000:3.0:1782222188.458122:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+14:2387:x1868795060756096:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 1537us (1794us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222188.458198:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 332 00000100:00100000:0.0:1782222189.035698:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782222189.036534:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081805568:0@lo:400:kworker.0 00000100:00100000:2.0:1782222189.036603:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782222189.036625:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747500700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081805824:0@lo:400:kworker.0 00000100:00100000:0.0:1782222189.043980:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0847002a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081805440:0@lo:400:kworker.0 00000100:00100000:3.0:1782222189.044372:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081805696:0@lo:400:kworker.0 00000100:00100000:2.0:1782222189.044510:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222189.044611:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08516d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1868795081805952:0@lo:400:kworker.0 00000100:00100000:2.0:1782222189.044645:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222189.044687:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747679500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081806464:0@lo:400:kworker.0 00000100:00100000:2.0:1782222189.044718:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222189.044754:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074728dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081806976:0@lo:400:kworker.0 00000100:00100000:2.0:1782222189.044778:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222189.044808:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081806464 00000100:00100000:2.0:1782222189.044818:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081806464 00000100:00100000:2.0:1782222189.044884:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081806976 00000100:00100000:2.0:1782222189.044887:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081806976 00000100:00100000:2.0:1782222189.044935:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1782222189.044946:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3656:x1868795081806464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222189.045020:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3656:x1868795081806464:12345-0@lo:400:kworker.0 Request processed in 75us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222189.045029:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1782222189.045052:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1782222189.045058:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081806976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222189.045107:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081806976:12345-0@lo:400:kworker.0 Request processed in 50us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222189.045114:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1782222189.045162:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074728dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081806976:0@lo:400:kworker.0 00000100:00100000:2.0:1782222189.045190:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747679500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081806464:0@lo:400:kworker.0 00000100:00100000:2.0:1782222189.045203:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782222189.045210:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747679180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081806336:0@lo:400:kworker.0 00000100:00100000:2.0:1782222189.045256:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222189.045276:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074728ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081806848:0@lo:400:kworker.0 00000100:00100000:2.0:1782222189.045296:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222189.045311:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081806336 00000100:00100000:2.0:1782222189.045314:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081806336 00000100:00100000:2.0:1782222189.045330:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081806848 00000100:00100000:2.0:1782222189.045332:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081806848 00000100:00100000:2.0:1782222189.045343:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1782222189.045348:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747679500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081806336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222189.045375:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747679500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081806336:12345-0@lo:400:kworker.0 Request processed in 26us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222189.045381:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1782222189.045389:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1782222189.045394:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074764b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081806848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222189.045415:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074764b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081806848:12345-0@lo:400:kworker.0 Request processed in 21us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222189.045420:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1782222189.045440:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074728ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081806848:0@lo:400:kworker.0 00000100:00100000:2.0:1782222189.045467:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747679180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081806336:0@lo:400:kworker.0 00000100:00100000:2.0:1782222189.045524:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081805952 00000100:00100000:2.0:1782222189.045528:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081805952 00000100:00100000:2.0:1782222189.045556:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1782222189.045562:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1868795081805952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222189.045599:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1868795081805952:12345-0@lo:400:kworker.0 Request processed in 37us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222189.045605:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1782222189.045629:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08516d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1868795081805952:0@lo:400:kworker.0 00000100:00080000:2.0:1782222189.045654:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782222189.045787:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222189.045824:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081805824 00000100:00100000:1.0:1782222189.045847:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081805824 00000100:00100000:1.0:1782222189.045883:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1782222189.045891:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747563800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081805824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222189.045936:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747563800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081805824:12345-0@lo:400:kworker.0 Request processed in 46us (1427us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222189.045943:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1782222189.045965:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081805568 00000100:00100000:1.0:1782222189.045969:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081805568 00000100:00100000:1.0:1782222189.045995:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1782222189.046001:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081805568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222189.046034:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081805568:12345-0@lo:400:kworker.0 Request processed in 33us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222189.046041:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1782222189.046076:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081805568:0@lo:400:kworker.0 00000100:00100000:1.0:1782222189.046096:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08516d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1868795081806080:0@lo:400:kworker.0 00000100:00100000:1.0:1782222189.046124:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222189.046356:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747500700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081805824:0@lo:400:kworker.0 00000100:00100000:0.0:1782222189.047083:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222189.047164:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081806080 00000100:00100000:0.0:1782222189.047171:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081806080 00000100:00100000:0.0:1782222189.047228:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1782222189.047256:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1868795081806080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222189.047311:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1868795081806080:12345-0@lo:400:kworker.0 Request processed in 75us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222189.047319:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1782222189.047976:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08516d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1868795081806080:0@lo:400:kworker.0 00000100:00100000:1.0:1782222189.047993:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074767b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1868795081806592:0@lo:400:kworker.0 00000100:00100000:1.0:1782222189.048040:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222189.048079:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081806592 00000100:00100000:1.0:1782222189.048083:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081806592 00000100:00100000:1.0:1782222189.048124:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1782222189.048131:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1868795081806592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222189.049495:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1868795081806592:12345-0@lo:400:kworker.0 Request processed in 1356us (1446us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222189.049529:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1782222189.050537:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074767b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1868795081806592:0@lo:400:kworker.0 00000100:00080000:1.0:1782222189.051303:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782222189.059847:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081805440 00000100:00100000:2.0:1782222189.059868:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081805440 00000100:00100000:2.0:1782222189.059965:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1782222189.059977:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3655:x1868795081805440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222189.060402:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3655:x1868795081805440:12345-0@lo:400:kworker.0 Request processed in 425us (13319us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222189.060411:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1782222189.061490:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0847002a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081805440:0@lo:400:kworker.0 00000100:00100000:2.0:1782222189.062591:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222189.062654:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074767aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1868795081806208:0@lo:400:kworker.0 00000100:00100000:2.0:1782222189.062693:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222189.062729:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747679c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1868795081806720:0@lo:400:kworker.0 00000100:00100000:2.0:1782222189.062769:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222189.062859:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081806208 00000100:00100000:2.0:1782222189.062869:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081806208 00000100:00100000:2.0:1782222189.062959:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081806720 00000100:00100000:2.0:1782222189.062963:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081806720 00000100:00100000:1.0:1782222189.063096:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1782222189.063111:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08516d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1868795081806208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222189.063200:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08516d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1868795081806208:12345-0@lo:400:kworker.0 Request processed in 93us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222189.063210:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1782222189.063231:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1782222189.063274:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08516d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1868795081806720:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1782222189.063308:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074767aa00 x1868795081806208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222189.063313:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08516d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1868795081806720:12345-0@lo:400:kworker.0 Request processed in 38us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222189.063328:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1782222189.063335:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074767aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1868795081806208:0@lo:400:kworker.0 00010000:00080000:2.0:1782222189.063351:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747679c00 x1868795081806720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1782222189.063352:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782222189.063364:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747679c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1868795081806720:0@lo:400:kworker.0 00000100:00100000:0.0:1782222189.063666:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081805696 00000100:00100000:0.0:1782222189.063672:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081805696 00000100:00100000:0.0:1782222189.063713:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1782222189.063721:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081805696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222189.063794:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081805696:12345-0@lo:400:kworker.0 Request processed in 74us (1210us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222189.063800:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1782222189.064021:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081805696:0@lo:400:kworker.0 00010000:00010000:3.0:1782222189.098449:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782222190.061334:0:6505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:0.0:1782222190.061358:0:6505:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1782222190.061662:0:6558:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1782222190.061695:0:6558:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:2.0:1782222190.077924:0:8436:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00010000:00010000:3.0:1782222190.124469:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222191.157247:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782222191.212146:0:13809:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1782222191.328076:0:14572:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 09:43:08 (1782222188) 00000100:00100000:1.0:1782222191.594556:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081807104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782222191.594667:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222191.594918:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081807104 00000100:00100000:3.0:1782222191.594930:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081807104 00000100:00100000:3.0:1782222191.595005:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1782222191.595016:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081807104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782222191.595055:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222191.597718:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081807104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2692us (3038us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222191.597738:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1782222191.598859:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747679c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081807232:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782222191.598963:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222191.602937:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081807232 00000100:00100000:3.0:1782222191.602959:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081807232 00000100:00100000:3.0:1782222191.603047:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1782222191.603061:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074767aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081807232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782222191.603100:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222191.603213:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074767aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081807232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 155us (4250us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222191.603221:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1782222191.603311:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747679c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081807232:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782222191.605756:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081807104:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1782222191.605808:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:1.0:1782222191.978988:0:13806:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782222191.979002:0:13806:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782222191.979142:0:13806:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1782222191.979151:0:13806:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1782222192.170720:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222192.618513:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081807488:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782222192.618585:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222192.618677:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782222192.618682:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081807488 00000100:00100000:2.0:1782222192.618688:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747c6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081807360:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782222192.618697:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081807488 00000100:00100000:2.0:1782222192.618717:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222192.618787:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081807360 00000100:00100000:1.0:1782222192.618793:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081807360 00000100:00100000:2.0:1782222192.620349:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1782222192.620370:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074767b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081807488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782222192.620408:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1782222192.620482:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074767b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081807488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (1895us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222192.620490:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1782222192.620515:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1782222192.620522:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747679180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081807360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782222192.620554:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1782222192.620828:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747679180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081807360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (1868us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222192.620838:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1782222192.621165:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747c6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081807360:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782222192.621201:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081807488:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782222192.741938:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222192.742054:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060756992 00000100:00100000:2.0:1782222192.742064:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060756992 00000100:00100000:2.0:1782222192.742159:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 150 00000100:00100000:2.0:1782222192.742171:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0875aaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+13:12167:x1868795060756992:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782222192.742193:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222192.742212:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811c34 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755860a expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222192.742321:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811c3b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222192.742334:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811c3b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222192.742359:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811c3b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222192.742430:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811c42 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222192.742438:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811c42 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222192.742444:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811c42 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222192.742576:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82a00/0xe2b7cc26e6811c49 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222192.742585:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82a00/0xe2b7cc26e6811c49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222192.742592:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82a00/0xe2b7cc26e6811c49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782222192.742602:0:8465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1782222192.742679:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811c3b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222192.742687:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811c3b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222192.742693:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811c3b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222192.742699:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83c00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222192.742703:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811c3b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222192.742710:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811c3b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222192.742722:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f0747402900) 00010000:00010000:2.0:1782222192.742725:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782222192.742729:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811c3b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222192.742745:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811c3b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222192.742760:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811c42 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222192.742766:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811c42 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222192.742772:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811c42 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222192.742777:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb82600 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222192.742780:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811c42 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222192.742786:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811c42 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222192.742796:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8f0849b70a00) 00010000:00010000:2.0:1782222192.742798:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782222192.742800:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811c42 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222192.742815:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811c42 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222192.743172:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811c34 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755860a expref: 16 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222192.743188:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82a00/0xe2b7cc26e6811c49 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755860a expref: 15 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222192.743202:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f087f8f2900) 00010000:00010000:2.0:1782222192.743204:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782222192.743206:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb82a00, rc 0) 00000100:00100000:2.0:1782222192.743307:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0875aaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+15:12167:x1868795060756992:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 1138us (1378us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1782222192.743315:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 150 00000100:00080000:1.0:1782222192.743501:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782222192.750949:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222192.752778:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222192.753664:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060757248 00000100:00100000:2.0:1782222192.753675:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060757248 00000100:00100000:2.0:1782222192.753844:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 12 00000100:00100000:2.0:1782222192.753856:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08429a9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+15:2387:x1868795060757248:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782222192.753872:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782222192.753898:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82a00/0xe2b7cc26e6811c49 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755860a expref: 15 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222192.753917:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f087f8f2900) 00010000:00010000:2.0:1782222192.753922:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782222192.754168:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060757120 00000100:00100000:1.0:1782222192.754173:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060757120 00000100:00100000:1.0:1782222192.754293:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 151 00000100:00100000:1.0:1782222192.754313:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074728c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+15:12167:x1868795060757120:12345-192.168.203.27@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1782222192.754340:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08429a9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+15:2387:x1868795060757248:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 485us (1621us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222192.754349:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 12 00000100:00100000:1.0:1782222192.754389:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074728c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+14:12167:x1868795060757120:12345-192.168.203.27@tcp:59:lhsmtool_posix.0 Request processed in 77us (3448us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222192.754397:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 151 00000100:00100000:2.0:1782222192.757324:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222192.757403:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060757376 00000100:00100000:3.0:1782222192.757413:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060757376 00000100:00100000:3.0:1782222192.757498:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 152 00000100:00100000:3.0:1782222192.757508:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:12167:x1868795060757376:12345-192.168.203.27@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1782222192.757633:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:12167:x1868795060757376:12345-192.168.203.27@tcp:59:lhsmtool_posix.0 Request processed in 126us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222192.757641:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 152 00000100:00080000:1.0:1782222192.758382:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:1.0:1782222193.007367:0:13806:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782222193.007376:0:13806:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782222193.007930:0:13806:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1782222193.007942:0:13806:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782222193.132630:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747c6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081807616:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782222193.132702:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222193.133361:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782222193.133373:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081807744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782222193.133420:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222193.133608:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081807616 00000100:00100000:0.0:1782222193.133616:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081807616 00000100:00100000:0.0:1782222193.133668:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081807744 00000100:00100000:0.0:1782222193.133672:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081807744 00000100:00100000:0.0:1782222193.133688:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1782222193.133697:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081807616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782222193.133727:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1782222193.133776:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081807616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222193.133784:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1782222193.133798:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1782222193.133822:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081807744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782222193.133832:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1782222193.133863:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081807744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222193.133870:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1782222193.133900:0:3653:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1782222193.133906:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f08412aaa00, transno 4294967313 00000100:00100000:0.0:1782222193.133920:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081807744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782222193.133935:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747c6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081807616:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1782222193.134045:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782222193.210758:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782222193.261583:0:13809:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1782222193.574876:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222193.574920:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222193.574951:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222193.574995:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222193.575022:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222193.575063:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222193.575091:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222193.575121:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060757888 00000100:00100000:3.0:1782222193.575131:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060757888 00000100:00100000:3.0:1782222193.575199:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060758016 00000100:00100000:3.0:1782222193.575203:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060758016 00000100:00100000:3.0:1782222193.575227:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 164 00000100:00100000:3.0:1782222193.575267:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+6:2389:x1868795060757888:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222193.575341:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+6:2389:x1868795060757888:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 105us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222193.575348:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 164 00000100:00100000:3.0:1782222193.575364:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 165 00000100:00100000:3.0:1782222193.575371:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+5:2389:x1868795060758016:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222193.575395:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+5:2389:x1868795060758016:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 25us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222193.575402:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 165 00000100:00100000:3.0:1782222193.575433:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060757632 00000100:00100000:3.0:1782222193.575437:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060757632 00000100:00100000:3.0:1782222193.575462:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060757760 00000100:00100000:3.0:1782222193.575466:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060757760 00000100:00100000:3.0:1782222193.575477:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060758144 00000100:00100000:3.0:1782222193.575480:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060758144 00000100:00100000:3.0:1782222193.575493:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060758272 00000100:00100000:3.0:1782222193.575496:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060758272 00000100:00100000:3.0:1782222193.575510:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 342 00000100:00100000:3.0:1782222193.575516:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074728ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+14:2389:x1868795060757632:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222193.575545:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074728ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+14:2389:x1868795060757632:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 28us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222193.575551:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 342 00000100:00100000:3.0:1782222193.575563:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 343 00000100:00100000:3.0:1782222193.575569:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074728dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+5:2389:x1868795060757760:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222193.575592:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074728dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+5:2389:x1868795060757760:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 23us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222193.575598:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 343 00000100:00100000:3.0:1782222193.575609:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 344 00000100:00100000:3.0:1782222193.575615:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb78d98d-0650-4da4-8eeb-708f911905dd+6:2389:x1868795060758144:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222193.575638:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb78d98d-0650-4da4-8eeb-708f911905dd+6:2389:x1868795060758144:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 23us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222193.575644:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 344 00000100:00100000:3.0:1782222193.575655:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 345 00000100:00100000:3.0:1782222193.575661:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2389:x1868795060758272:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222193.575683:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2389:x1868795060758272:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 22us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222193.575694:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 345 00000100:00080000:3.0:1782222193.575715:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782222193.575720:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782222193.575722:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782222193.575724:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782222193.576271:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060757504 00000100:00100000:1.0:1782222193.576278:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060757504 00000100:00100000:1.0:1782222193.576312:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 394 00000100:00100000:1.0:1782222193.576321:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2389:x1868795060757504:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222193.576360:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2389:x1868795060757504:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 40us (1495us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222193.576377:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 394 00000100:00100000:1.0:1782222194.158891:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081808128:0@lo:400:kworker.0 00000100:00100000:1.0:1782222194.158973:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222194.159029:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747c6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1868795081808640:0@lo:400:kworker.0 00000100:00100000:1.0:1782222194.159055:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222194.159071:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747502d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1868795081809152:0@lo:400:kworker.0 00000100:00100000:1.0:1782222194.159090:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222194.159110:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1782222194.159116:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747c6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081808256:0@lo:400:kworker.0 00000100:00100000:1.0:1782222194.159138:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222194.159153:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747c6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081808768:0@lo:400:kworker.0 00000100:00100000:1.0:1782222194.159175:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222194.159192:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081809280:0@lo:400:kworker.0 00000100:00100000:1.0:1782222194.159211:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222194.159260:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081808128 00000100:00100000:1.0:1782222194.159267:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081808128 00000100:00100000:1.0:1782222194.159308:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081808256 00000100:00100000:1.0:1782222194.159312:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081808256 00000100:00100000:1.0:1782222194.159328:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1782222194.159335:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081808128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222194.159390:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081808128:12345-0@lo:400:kworker.0 Request processed in 53us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222194.159397:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1782222194.159415:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1782222194.159421:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074774b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081808256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222194.159459:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074774b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081808256:12345-0@lo:400:kworker.0 Request processed in 38us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222194.159465:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1782222194.159484:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081808768 00000100:00100000:1.0:1782222194.159487:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081808768 00000100:00100000:1.0:1782222194.159506:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081809280 00000100:00100000:1.0:1782222194.159509:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081809280 00000100:00100000:1.0:1782222194.159529:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1782222194.159535:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081808768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222194.159565:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081808768:12345-0@lo:400:kworker.0 Request processed in 30us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222194.159571:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1782222194.159582:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1782222194.159588:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081809280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222194.159615:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081809280:12345-0@lo:400:kworker.0 Request processed in 28us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222194.159620:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1782222194.159657:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747c6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081808256:0@lo:400:kworker.0 00000100:00100000:1.0:1782222194.159668:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747c6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081808768:0@lo:400:kworker.0 00000100:00100000:1.0:1782222194.159676:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081809280:0@lo:400:kworker.0 00000100:00100000:1.0:1782222194.159684:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081808128:0@lo:400:kworker.0 00000100:00100000:3.0:1782222194.159890:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747c6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1868795081808000:0@lo:400:kworker.0 00000100:00100000:3.0:1782222194.159920:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222194.159955:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747c6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1868795081808512:0@lo:400:kworker.0 00000100:00100000:3.0:1782222194.159975:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222194.159998:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1868795081809024:0@lo:400:kworker.0 00000100:00100000:3.0:1782222194.160016:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222194.160033:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1782222194.160040:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081807872:0@lo:400:kworker.0 00000100:00100000:3.0:1782222194.160064:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222194.160088:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747c6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1868795081808384:0@lo:400:kworker.0 00000100:00100000:3.0:1782222194.160109:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222194.160120:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747c6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081808896:0@lo:400:kworker.0 00000100:00100000:3.0:1782222194.160141:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222194.160156:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081809408:0@lo:400:kworker.0 00000100:00100000:3.0:1782222194.160176:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222194.160204:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081808640 00000100:00100000:3.0:1782222194.160208:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081808640 00000100:00100000:3.0:1782222194.160259:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081809152 00000100:00100000:3.0:1782222194.160262:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081809152 00000100:00100000:3.0:1782222194.160278:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081808000 00000100:00100000:3.0:1782222194.160281:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081808000 00000100:00100000:3.0:1782222194.160305:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081808512 00000100:00100000:3.0:1782222194.160308:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081808512 00000100:00100000:3.0:1782222194.160320:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081809024 00000100:00100000:3.0:1782222194.160322:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081809024 00000100:00100000:3.0:1782222194.160331:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081808384 00000100:00100000:3.0:1782222194.160333:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081808384 00000100:00100000:3.0:1782222194.160345:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1782222194.160351:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1868795081808640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222194.160389:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1868795081808640:12345-0@lo:400:kworker.0 Request processed in 38us (1333us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222194.160395:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1782222194.160406:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1782222194.160412:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1868795081809152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222194.160436:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1868795081809152:12345-0@lo:400:kworker.0 Request processed in 25us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222194.160442:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1782222194.160451:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1782222194.160455:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1868795081808000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222194.160481:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1868795081808000:12345-0@lo:400:kworker.0 Request processed in 25us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222194.160487:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1782222194.160498:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1782222194.160502:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1868795081808512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222194.160526:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1868795081808512:12345-0@lo:400:kworker.0 Request processed in 23us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222194.160532:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1782222194.160542:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1782222194.160554:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1868795081809024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222194.160581:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1868795081809024:12345-0@lo:400:kworker.0 Request processed in 28us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222194.160587:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1782222194.160598:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1782222194.160602:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1868795081808384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222194.160625:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1868795081808384:12345-0@lo:400:kworker.0 Request processed in 23us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222194.160630:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1782222194.160651:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081808896 00000100:00100000:3.0:1782222194.160653:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081808896 00000100:00100000:3.0:1782222194.160668:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081809408 00000100:00100000:3.0:1782222194.160670:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081809408 00000100:00100000:3.0:1782222194.160682:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1782222194.160689:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081808896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222194.160716:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081808896:12345-0@lo:400:kworker.0 Request processed in 28us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222194.160722:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1782222194.160732:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1782222194.160738:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081809408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222194.160760:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081809408:12345-0@lo:400:kworker.0 Request processed in 23us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222194.160765:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:3.0:1782222194.160781:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782222194.160786:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782222194.160787:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782222194.160818:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081807872 00000100:00100000:3.0:1782222194.160828:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081807872 00000100:00100000:3.0:1782222194.160854:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1782222194.160859:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3656:x1868795081807872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222194.160891:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3656:x1868795081807872:12345-0@lo:400:kworker.0 Request processed in 31us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222194.160897:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1782222194.160938:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081807872:0@lo:400:kworker.0 00000100:00100000:3.0:1782222194.160950:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747c6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1868795081808384:0@lo:400:kworker.0 00000100:00100000:3.0:1782222194.160959:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747c6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081808896:0@lo:400:kworker.0 00000100:00100000:3.0:1782222194.160968:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081809408:0@lo:400:kworker.0 00000100:00100000:3.0:1782222194.160977:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747c6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1868795081808000:0@lo:400:kworker.0 00000100:00100000:3.0:1782222194.160985:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747c6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1868795081808512:0@lo:400:kworker.0 00000100:00100000:3.0:1782222194.161009:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1868795081809024:0@lo:400:kworker.0 00010000:00080000:3.0:1782222194.161054:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747c6f480 x1868795081808640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222194.161065:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747c6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1868795081808640:0@lo:400:kworker.0 00010000:00080000:3.0:1782222194.161078:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747502d80 x1868795081809152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222194.161086:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747502d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1868795081809152:0@lo:400:kworker.0 00010000:00010000:2.0:1782222194.219752:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222194.545649:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222194.545762:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060758400 00000100:00100000:1.0:1782222194.545772:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060758400 00000100:00100000:1.0:1782222194.545862:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 153 00000100:00100000:1.0:1782222194.545873:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+14:12209:x1868795060758400:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:1.0:1782222194.545904:0:13817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222194.545923:0:13817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811c57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558611 expref: -99 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222194.545994:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811c5e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222194.546009:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811c5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222194.546028:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811c5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222194.546042:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811c65 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222194.546049:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811c65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222194.546055:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811c65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222194.546096:0:13817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811c5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222194.546102:0:13817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811c5e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222194.546108:0:13817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811c5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222194.546114:0:13817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744c000 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222194.546123:0:13817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811c5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222194.546131:0:13817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811c5e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222194.546144:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0851377900) 00010000:00010000:1.0:1782222194.546146:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222194.546151:0:13817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811c5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222194.546157:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811c5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222194.546170:0:13817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811c65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222194.546176:0:13817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811c65 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222194.546182:0:13817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811c65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222194.546187:0:13817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744dc00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222194.546190:0:13817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811c65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222194.546195:0:13817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811c65 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222194.546201:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8f0843b9b200) 00010000:00010000:1.0:1782222194.546203:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222194.546211:0:13817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811c65 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222194.546216:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811c65 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222194.546272:0:13817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811c57 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558611 expref: 15 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222194.546282:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0851377900) 00010000:00010000:1.0:1782222194.546285:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222194.546289:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811c57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558611 expref: 15 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222194.546299:0:13817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744d400, rc 0) 00000100:00100000:1.0:1782222194.546355:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+14:12209:x1868795060758400:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 484us (716us total) trans 0 rc 301/301 00000100:00100000:1.0:1782222194.546363:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 153 00000100:00080000:3.0:1782222194.546956:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782222194.554757:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222194.555263:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060758656 00000100:00100000:1.0:1782222194.555273:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060758656 00000100:00100000:1.0:1782222194.555333:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 154 00000100:00100000:1.0:1782222194.555343:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+14:12209:x1868795060758656:12345-192.168.203.27@tcp:36:lfs.0 00010000:00010000:1.0:1782222194.555399:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222194.555424:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0840031400/0xe2b7cc26e68115ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558435 expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222194.555438:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0851377900) 00010000:00010000:1.0:1782222194.555443:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782222194.555506:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811c6c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222194.555520:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811c2d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558603 expref: 5 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222194.555529:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811c6c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222194.555564:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811c2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558603 expref: 5 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222194.555579:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811c2d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558603 expref: 5 pid: 8465 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222194.555594:0:8465:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747502d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8465:1868795081809536:192.168.203.27@tcp:104: 00000100:00100000:1.0:1782222194.555675:0:8465:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0844c0c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782222194.567075:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222194.567148:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060758784 00000100:00100000:0.0:1782222194.567157:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060758784 00010000:00010000:0.0:1782222194.567196:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811c2d lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558603 expref: 6 pid: 8465 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222194.567273:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 78 00000100:00100000:0.0:1782222194.567282:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747503b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+6:2390:x1868795060758784:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782222194.567296:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222194.567303:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811c2d lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558603 expref: 6 pid: 8465 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222194.567317:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811c2d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558603 expref: 6 pid: 8465 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222194.567336:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0851377900) 00010000:00010000:0.0:1782222194.567341:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811c6c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222194.567350:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811c6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222194.567373:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811c6c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222194.567394:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782222194.567440:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747503b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+6:2390:x1868795060758784:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 159us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222194.567448:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 78 00010000:00010000:3.0:1782222194.568136:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811c2d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558603 expref: 5 pid: 8465 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222194.568157:0:8465:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747502d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8465:1868795081809536:192.168.203.27@tcp:104: 00010000:00010000:3.0:1782222194.568178:0:8465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811c6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.568188:0:8465:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811c6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.568194:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811c6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.568216:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e6811c73 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.568227:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e6811c73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.568264:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e6811c73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.568847:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811c7a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.568860:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811c7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.568869:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811c7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782222194.568886:0:8465:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ec57e8cd reply state 0000000048dcbd30 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811c7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.568906:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811c7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.568914:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:3.0:1782222194.568916:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782222194.568920:0:8465:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1782222194.568925:0:8465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1782222194.568933:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811c6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.568940:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811c6c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.568947:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811c6c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.568953:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744d400 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222194.568956:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811c6c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.568963:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811c6c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.568972:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0851377900) 00010000:00010000:3.0:1782222194.568975:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222194.568979:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811c6c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.568985:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811c6c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782222194.569013:0:8465:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ec57e8cd reply state 0000000048dcbd30 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e6811c73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.569021:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e6811c73 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.569027:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8f087f8f1f00) 00010000:00010000:3.0:1782222194.569030:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782222194.569032:0:8465:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1782222194.569124:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+15:12209:x1868795060758656:12345-192.168.203.27@tcp:36:lfs.0 Request processed in 13779us (14372us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1782222194.569133:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 154 00000100:00100000:1.0:1782222194.659198:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222194.659274:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060758912 00000100:00100000:2.0:1782222194.659284:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060758912 00000100:00100000:2.0:1782222194.659335:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 155 00000100:00100000:2.0:1782222194.659344:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+15:12217:x1868795060758912:12345-192.168.203.27@tcp:101:lctl.0 00010000:00010000:2.0:1782222194.659377:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222194.659401:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811c81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558618 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222194.659466:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82a00/0xe2b7cc26e6811c88 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222194.659479:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82a00/0xe2b7cc26e6811c88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222194.659489:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82a00/0xe2b7cc26e6811c88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782222194.659536:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782222194.659540:0:6528:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782222194.659564:0:6528:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82a00/0xe2b7cc26e6811c88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222194.659590:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811c81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558618 expref: 17 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222194.659608:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82a00/0xe2b7cc26e6811c88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558618 expref: 16 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222194.659616:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0849b70a00) 00010000:00010000:2.0:1782222194.659618:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782222194.659622:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb82a00, rc 0) 00000100:00100000:2.0:1782222194.659682:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+16:12217:x1868795060758912:12345-192.168.203.27@tcp:101:lctl.0 Request processed in 338us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222194.659690:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 155 00000100:00100000:1.0:1782222194.740445:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222194.740514:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060759040 00000100:00100000:3.0:1782222194.740524:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060759040 00000100:00100000:3.0:1782222194.740588:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 156 00000100:00100000:3.0:1782222194.740597:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+16:12223:x1868795060759040:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:3.0:1782222194.740618:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222194.740638:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811c8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755861f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.740714:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811c96 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.740728:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811c96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.740738:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811c96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.740763:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811c9d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.740771:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811c9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.740777:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811c9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.740871:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430a00/0xe2b7cc26e6811ca4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.740879:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430a00/0xe2b7cc26e6811ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.740885:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430a00/0xe2b7cc26e6811ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782222194.740919:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1782222194.740923:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782222194.741068:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430a00/0xe2b7cc26e6811ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.741082:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811c96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.741088:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811c96 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.741095:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811c96 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.741110:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746430000 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222194.741114:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811c96 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.741121:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811c96 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.741133:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0849b70a00) 00010000:00010000:3.0:1782222194.741136:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222194.741139:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811c96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.741145:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811c96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.741157:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811c9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.741162:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811c9d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.741168:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811c9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.741173:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746431c00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222194.741176:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811c9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.741182:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811c9d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.741200:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8f087f8f1f00) 00010000:00010000:3.0:1782222194.741203:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222194.741206:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811c9d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.741211:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811c9d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.741279:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811c8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755861f expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.741294:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430a00/0xe2b7cc26e6811ca4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755861f expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.741301:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:3.0:1782222194.741304:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782222194.741306:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746430a00, rc 0) 00000100:00100000:3.0:1782222194.741370:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+17:12223:x1868795060759040:12345-192.168.203.27@tcp:101:bash.0 Request processed in 773us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222194.741377:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 156 00000100:00100000:3.0:1782222194.745636:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222194.745675:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060759296 00000100:00100000:3.0:1782222194.745687:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060759296 00000100:00100000:3.0:1782222194.745974:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 157 00000100:00100000:3.0:1782222194.745985:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+17:12223:x1868795060759296:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:3.0:1782222194.746005:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222194.746035:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811cab lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558626 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.746160:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811cb2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.746175:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811cb2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.746184:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811cb2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.746262:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811cb9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.746271:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811cb9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.746279:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811cb9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782222194.746592:0:8465:0:(osp_object.c:1673:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:3.0:1782222194.746745:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e6811cc0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.746754:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e6811cc0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.746763:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e6811cc0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.746808:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811cb2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.746826:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811cb2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.746834:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811cb2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.746840:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746431200 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222194.746845:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811cb2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.746852:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811cb2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.746865:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:3.0:1782222194.746868:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222194.746873:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811cb2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.746879:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811cb2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782222194.746890:0:8465:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001b21abeb reply state 000000000394d1be transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811cb9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.746900:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811cb9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.746906:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f087f8f1000) 00010000:00010000:3.0:1782222194.746909:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782222194.746911:0:8465:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782222194.746946:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811cab lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558626 expref: 20 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.746968:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e6811cc0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558626 expref: 19 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222194.746975:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f087f8f1400) 00010000:00010000:3.0:1782222194.746977:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782222194.746979:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746430c00, rc 0) 00000100:00100000:3.0:1782222194.747047:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+20:12223:x1868795060759296:12345-192.168.203.27@tcp:101:bash.0 Request processed in 1063us (1420us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1782222194.747056:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 157 00000100:00100000:1.0:1782222194.750768:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222194.751282:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060759424 00000100:00100000:2.0:1782222194.751292:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060759424 00000100:00100000:2.0:1782222194.751357:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 55 00000100:00100000:2.0:1782222194.751367:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060759424:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:2.0:1782222194.751641:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222194.751661:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4f5f40c/0xe2b7cc26e6811cce lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755862d expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782222194.751684:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782222194.751702:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1782222194.751706:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782222194.751716:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4f5f40c/0xe2b7cc26e6811cce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755862d expref: 6 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222194.751733:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4f5f40c/0xe2b7cc26e6811cce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755862d expref: 6 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222194.751745:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb83200, rc 0) 00000100:00100000:2.0:1782222194.751810:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+6:2390:x1868795060759424:12345-192.168.203.27@tcp:101:bash.0 Request processed in 444us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222194.751817:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 55 00000100:00100000:1.0:1782222194.766205:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222194.766291:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060759552 00000100:00100000:2.0:1782222194.766302:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060759552 00000100:00100000:2.0:1782222194.766366:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 56 00000100:00100000:2.0:1782222194.766377:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77bf2c2c-f408-43f9-ae59-449550631d05+6:12223:x1868795060759552:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:2.0:1782222194.766415:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222194.766448:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6515f7c/0xe2b7cc26e6811cd5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558634 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222194.766480:0:14437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4f5f40c/0xe2b7cc26e6811cce lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755862d expref: 7 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222194.766489:0:14437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782222194.766493:0:14437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782222194.766498:0:14437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6515f7c/0xe2b7cc26e6811cd5 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558634 expref: 7 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222194.766533:0:14437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b4f5f40c/0xe2b7cc26e6811cce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755862d expref: 7 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222194.766547:0:14437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b4f5f40c/0xe2b7cc26e6811cce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755862d expref: 7 pid: 8442 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222194.766560:0:14437:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747560700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14437:1868795081809664:192.168.203.27@tcp:104: 00000100:00100000:2.0:1782222194.766645:0:14437:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b63ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1782222194.771589:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222194.771625:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060759680 00000100:00100000:1.0:1782222194.771635:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060759680 00010000:00010000:1.0:1782222194.771677:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b4f5f40c/0xe2b7cc26e6811cce lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755862d expref: 8 pid: 8442 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222194.771693:0:14437:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747560700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14437:1868795081809664:192.168.203.27@tcp:104: 00010000:00010000:0.0:1782222194.771723:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d6515f7c/0xe2b7cc26e6811cd5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558634 expref: 8 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222194.771730:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 79 00010000:00010000:0.0:1782222194.771744:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb83000, rc 0) 00000100:00100000:1.0:1782222194.771757:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+8:2389:x1868795060759680:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782222194.771773:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222194.771803:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b4f5f40c/0xe2b7cc26e6811cce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755862d expref: 8 pid: 8442 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222194.771813:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77bf2c2c-f408-43f9-ae59-449550631d05+8:12223:x1868795060759552:12345-192.168.203.27@tcp:101:bash.0 Request processed in 5434us (5613us total) trans 0 rc 0/0 00010000:00010000:1.0:1782222194.771823:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b4f5f40c/0xe2b7cc26e6811cce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755862d expref: 8 pid: 8442 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222194.771825:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 56 00010000:00010000:1.0:1782222194.771853:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4f5f40c/0xe2b7cc26e6811cce lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755862d expref: 7 pid: 8442 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222194.771867:0:6513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222194.771882:0:6513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222194.771890:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6515f7c/0xe2b7cc26e6811cd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558634 expref: 6 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222194.771900:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6515f7c/0xe2b7cc26e6811cd5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558634 expref: 6 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222194.771934:0:6513:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d6515f7c/0xe2b7cc26e6811cd5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558634 expref: 6 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222194.771950:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747c6c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6513:1868795081809792:192.168.203.27@tcp:105: 00000100:00100000:1.0:1782222194.772015:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0844c0cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1782222194.775449:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747c6c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6513:1868795081809792:192.168.203.27@tcp:105: 00010000:00010000:3.0:1782222194.775475:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782222194.775529:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+6:2389:x1868795060759680:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 3774us (3949us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222194.775540:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 79 00000100:00100000:0.0:1782222194.784125:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222194.784353:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060759936 00000100:00100000:2.0:1782222194.784364:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060759936 00000100:00100000:2.0:1782222194.784425:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 36 00000100:00100000:2.0:1782222194.784435:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0875aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+20:12223:x1868795060759936:12345-192.168.203.27@tcp:35:bash.0 00000100:00100000:2.0:1782222194.785136:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0875aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+21:12223:x1868795060759936:12345-192.168.203.27@tcp:35:bash.0 Request processed in 697us (1016us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1782222194.785145:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 36 00000100:00100000:0.0:1782222194.892995:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222194.893565:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060760192 00000100:00100000:1.0:1782222194.893590:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060760192 00000100:00100000:1.0:1782222194.894140:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 158 00000100:00100000:1.0:1782222194.894436:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0875aafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+21:12233:x1868795060760192:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:1.0:1782222194.894461:0:13817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222194.894481:0:13817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e6811cdc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755863b expref: -99 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782222194.894583:0:13817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1782222194.898893:0:13817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e6811cdc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755863b expref: 23 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222194.898926:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0849b70a00) 00010000:00010000:1.0:1782222194.898929:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782222194.898940:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e6811cdc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755863b expref: 23 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222194.898963:0:13817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744de00, rc 0) 00000100:00100000:1.0:1782222194.899104:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0875aafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+22:12233:x1868795060760192:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 4677us (6116us total) trans 4294967421 rc 301/301 00000100:00100000:1.0:1782222194.899114:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 158 00000100:00100000:2.0:1782222194.904756:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222194.904924:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060760448 00000100:00100000:0.0:1782222194.904936:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060760448 00000100:00100000:0.0:1782222194.905056:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 37 00000100:00100000:0.0:1782222194.905066:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747561c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+22:12233:x1868795060760448:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:0.0:1782222194.905757:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747561c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+23:12233:x1868795060760448:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 689us (1006us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1782222194.905767:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 37 00000100:00100000:0.0:1782222194.995165:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222195.004506:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060760576 00000100:00100000:1.0:1782222195.004521:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060760576 00000100:00100000:1.0:1782222195.004602:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 159 00000100:00100000:1.0:1782222195.004613:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0875aac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+23:12239:x1868795060760576:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:1.0:1782222195.004639:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222195.004670:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e6811cea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558642 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222195.005080:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811cf1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222195.005095:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222195.005107:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782222195.005150:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1782222195.005154:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782222195.005185:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222195.005213:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e6811cea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558642 expref: 25 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222195.005277:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811cf1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558642 expref: 24 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222195.005288:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:1.0:1782222195.005291:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782222195.005294:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744ce00, rc 0) 00000100:00100000:1.0:1782222195.005368:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0875aac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+24:12239:x1868795060760576:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 756us (10211us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222195.005376:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 159 00000100:00100000:1.0:1782222195.014671:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222195.014752:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060760832 00000100:00100000:2.0:1782222195.014772:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060760832 00000100:00100000:2.0:1782222195.014845:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 160 00000100:00100000:2.0:1782222195.014855:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+24:12239:x1868795060760832:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1782222195.014874:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222195.014895:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811cf8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558649 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.015010:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811cff lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.015024:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811cff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.015035:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811cff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782222195.015046:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1782222195.015164:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811cf8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558649 expref: 27 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.015184:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811cff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558649 expref: 26 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.015193:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f087f8f1400) 00010000:00010000:2.0:1782222195.015196:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782222195.015199:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb82600, rc 0) 00000100:00100000:2.0:1782222195.015311:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+26:12239:x1868795060760832:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 458us (649us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1782222195.015331:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 160 00000100:00100000:3.0:1782222195.020639:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222195.020780:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060760960 00000100:00100000:0.0:1782222195.020800:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060760960 00000100:00100000:0.0:1782222195.020868:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 13 00000100:00100000:0.0:1782222195.020879:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77bf2c2c-f408-43f9-ae59-449550631d05+26:2389:x1868795060760960:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782222195.020895:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222195.020919:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811cff lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558649 expref: 26 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.020938:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f087f8f1400) 00010000:00010000:0.0:1782222195.020942:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782222195.021006:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77bf2c2c-f408-43f9-ae59-449550631d05+25:2389:x1868795060760960:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 128us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222195.021013:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 13 00000100:00100000:3.0:1782222195.022593:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222195.023901:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060761216 00000100:00100000:1.0:1782222195.023931:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060761216 00000100:00100000:1.0:1782222195.024013:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 161 00000100:00100000:1.0:1782222195.024024:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+25:12239:x1868795060761216:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:1.0:1782222195.024047:0:13817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222195.024074:0:13817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e6811d0d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558650 expref: -99 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222195.024179:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e6811d14 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222195.024193:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e6811d14 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222195.024203:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e6811d14 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782222195.024215:0:13817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1782222195.024366:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e6811d0d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558650 expref: 28 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222195.024385:0:13817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e6811d14 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558650 expref: 27 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222195.024393:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f087f8f1400) 00010000:00010000:1.0:1782222195.024396:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1782222195.024399:0:13817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744de00, rc 0) 00000100:00100000:1.0:1782222195.024460:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+27:12239:x1868795060761216:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 438us (1872us total) trans 4294967424 rc 0/0 00000100:00100000:1.0:1782222195.024467:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 161 00000100:00100000:3.0:1782222195.031879:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222195.032713:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060761344 00000100:00100000:1.0:1782222195.032724:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060761344 00000100:00080000:3.0:1782222195.032954:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782222195.033153:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 57 00000100:00100000:0.0:1782222195.033164:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77bf2c2c-f408-43f9-ae59-449550631d05+6:2390:x1868795060761344:12345-192.168.203.27@tcp:1:lfs.0 00010000:00010000:0.0:1782222195.033219:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074365dc6/0xe2b7cc26e6811d22 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.033269:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6515f7c/0xe2b7cc26e6811cd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558634 expref: 6 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.033279:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1782222195.033283:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782222195.033407:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074365dc6/0xe2b7cc26e6811d22 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.033446:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d6515f7c/0xe2b7cc26e6811cd5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558634 expref: 6 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.033474:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d6515f7c/0xe2b7cc26e6811cd5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558634 expref: 6 pid: 14437 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222195.033489:0:8443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0847002a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8443:1868795081809920:192.168.203.27@tcp:104: 00000100:00100000:0.0:1782222195.033570:0:8443:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875d4a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782222195.035812:0:8443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0847002a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8443:1868795081809920:192.168.203.27@tcp:104: 00010000:00010000:3.0:1782222195.035841:0:8443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000074365dc6/0xe2b7cc26e6811d22 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222195.037728:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222195.037866:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060761472 00000100:00100000:1.0:1782222195.037876:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060761472 00002000:00100000:1.0:1782222195.037922:0:8448:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8f0747ef6680 x1868795060761472/t0(0) o4->77bf2c2c-f408-43f9-ae59-449550631d05@192.168.203.27@tcp:161/0 lens 504/0 e 0 to 0 dl 1782222206 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782222195.037932:0:8448:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f0747ef6680 with x1868795060761472 ext(0->12) 00010000:00010000:1.0:1782222195.037951:0:8448:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d6515f7c/0xe2b7cc26e6811cd5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558634 expref: 7 pid: 14437 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222195.037975:0:8448:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d6515f7c/0xe2b7cc26e6811cd5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558634 expref: 7 pid: 14437 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782222195.037982:0:8448:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8f0747ef6680 00000100:00100000:1.0:1782222195.038012:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 2 00000100:00100000:1.0:1782222195.038021:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77bf2c2c-f408-43f9-ae59-449550631d05+7:2390:x1868795060761472:12345-192.168.203.27@tcp:4:lfs.0 00000100:00100000:1.0:1782222195.039600:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77bf2c2c-f408-43f9-ae59-449550631d05+9:2390:x1868795060761472:12345-192.168.203.27@tcp:4:lfs.0 Request processed in 1574us (1872us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1782222195.039612:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 2 00002000:00100000:1.0:1782222195.039621:0:8448:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8f0747ef6680 x1868795060761472/t4294967306(0) o4->77bf2c2c-f408-43f9-ae59-449550631d05@192.168.203.27@tcp:161/0 lens 504/448 e 0 to 0 dl 1782222206 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782222195.039631:0:8448:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f0747ef6680 with x1868795060761472 ext(0->12) 00010000:00010000:1.0:1782222195.039641:0:8448:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d6515f7c/0xe2b7cc26e6811cd5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558634 expref: 9 pid: 14437 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222195.039657:0:8448:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d6515f7c/0xe2b7cc26e6811cd5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558634 expref: 9 pid: 14437 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782222195.039674:0:8448:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8f0747ef6680 00000100:00100000:0.0:1782222195.045827:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222195.046094:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060761600 00000100:00100000:1.0:1782222195.046103:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060761600 00010000:00010000:1.0:1782222195.046144:0:9532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d6515f7c/0xe2b7cc26e6811cd5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558634 expref: 9 pid: 14437 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222195.046337:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 80 00000100:00100000:3.0:1782222195.046363:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847002a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+9:2389:x1868795060761600:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782222195.046379:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1782222195.046398:0:6513:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1782222195.046400:0:6513:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1782222193 00002000:00010000:3.0:1782222195.046403:0:6513:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1782222194 00002000:00010000:3.0:1782222195.046405:0:6513:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1782222193 00002000:00010000:3.0:1782222195.046406:0:6513:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1782222195.046412:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d6515f7c/0xe2b7cc26e6811cd5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558634 expref: 9 pid: 14437 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222195.046426:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d6515f7c/0xe2b7cc26e6811cd5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558634 expref: 9 pid: 14437 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222195.046448:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6515f7c/0xe2b7cc26e6811cd5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558634 expref: 9 pid: 14437 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222195.046465:0:6513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782222195.046469:0:6513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782222195.046474:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000074365dc6/0xe2b7cc26e6811d22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222195.046483:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074365dc6/0xe2b7cc26e6811d22 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222195.046519:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782222195.046581:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847002a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+8:2389:x1868795060761600:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 221us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222195.046597:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 80 00010000:00010000:0.0:1782222195.046675:0:8443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000074365dc6/0xe2b7cc26e6811d22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.046685:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074365dc6/0xe2b7cc26e6811d22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.046706:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074365dc6/0xe2b7cc26e6811d22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.046714:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074365dc6/0xe2b7cc26e6811d22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.046722:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074365dc6/0xe2b7cc26e6811d22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.046729:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb8600 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:0.0:1782222195.046733:0:8443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074365dc6/0xe2b7cc26e6811d22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.046755:0:8443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074365dc6/0xe2b7cc26e6811d22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.046767:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074365dc6/0xe2b7cc26e6811d22 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.046775:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074365dc6/0xe2b7cc26e6811d22 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222195.046831:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77bf2c2c-f408-43f9-ae59-449550631d05+7:2390:x1868795060761344:12345-192.168.203.27@tcp:1:lfs.0 Request processed in 13670us (14960us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222195.046840:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 57 00000100:00100000:2.0:1782222195.051478:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222195.051550:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060761856 00000100:00100000:0.0:1782222195.051561:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060761856 00000100:00100000:0.0:1782222195.051622:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 38 00000100:00100000:0.0:1782222195.051632:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087d4ba050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+27:12239:x1868795060761856:12345-192.168.203.27@tcp:35:lfs.0 00000004:00010000:0.0:1782222195.051690:0:6530:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e6811d14 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558650 expref: 27 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782222195.051960:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:0.0:1782222195.052002:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1782222195.052534:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:0.0:1782222195.052575:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811d29 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.052591:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e6811cc0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558626 expref: 31 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.052608:0:6530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811d29 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.052643:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e6811cc0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558626 expref: 31 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.052658:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e6811cc0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558626 expref: 31 pid: 8465 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222195.052672:0:6530:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08504cad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6530:1868795081810048:192.168.203.27@tcp:104: 00000100:00100000:0.0:1782222195.052749:0:6530:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875d4a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782222195.055317:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222195.055447:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060761984 00000100:00100000:1.0:1782222195.055457:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060761984 00010000:00010000:1.0:1782222195.055495:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e6811cc0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558626 expref: 32 pid: 8465 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222195.055529:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 81 00000100:00100000:1.0:1782222195.055538:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747561180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77bf2c2c-f408-43f9-ae59-449550631d05+32:2390:x1868795060761984:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782222195.055551:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222195.055558:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e6811cc0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558626 expref: 32 pid: 8465 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222195.055569:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e6811cc0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558626 expref: 32 pid: 8465 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222195.055590:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f087f8f1400) 00010000:00010000:1.0:1782222195.055595:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811d29 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222195.055605:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811d29 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222195.055629:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811d29 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222195.055646:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782222195.055709:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747561180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77bf2c2c-f408-43f9-ae59-449550631d05+32:2390:x1868795060761984:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 171us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222195.055717:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 81 00010000:00010000:0.0:1782222195.055997:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e6811cc0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558626 expref: 31 pid: 8465 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222195.056014:0:6530:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08504cad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6530:1868795081810048:192.168.203.27@tcp:104: 00010000:00010000:0.0:1782222195.056034:0:6530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811d29 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.056044:0:6530:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811d29 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.056049:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811d29 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782222195.056165:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:0.0:1782222195.056317:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:0.0:1782222195.056401:0:6530:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08504cad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6530:1868795081810176:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782222195.056460:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222195.056484:0:6530:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746166840 going to sleep for 11 seconds 00000100:00100000:1.0:1782222195.056801:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081810176 00000100:00100000:1.0:1782222195.056808:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081810176 00000100:00100000:1.0:1782222195.056852:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1782222195.056860:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6530:x1868795081810176:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1782222195.056932:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6530:x1868795081810176:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 73us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222195.056940:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1782222195.057721:0:6530:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08504cad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6530:1868795081810176:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1782222195.057876:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:0.0:1782222195.057935:0:6530:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08504cad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6530:1868795081810304:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782222195.058343:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222195.058406:0:6530:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746166480 going to sleep for 11 seconds 00000100:00100000:3.0:1782222195.060983:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081810304 00000100:00100000:3.0:1782222195.061000:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081810304 00000100:00100000:3.0:1782222195.061073:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1782222195.061083:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6530:x1868795081810304:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1782222195.061374:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6530:x1868795081810304:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 292us (3031us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1782222195.061383:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1782222195.061474:0:6530:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08504cad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6530:1868795081810304:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1782222195.061538:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:0.0:1782222195.061582:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811d29 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.061592:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811d29 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.061600:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811d29 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.061606:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb9800 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222195.061610:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811d29 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.061618:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811d29 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.061633:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f087f8f1400) 00010000:00010000:0.0:1782222195.061636:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1782222195.061640:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811d29 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.061979:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811d29 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782222195.062089:0:6530:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1782222195.062152:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1782222195.062163:0:6530:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 394090927466ns, next at 395090925399ns, rc = 0 00000001:00080000:0.0:1782222195.062169:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:0.0:1782222195.062193:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f087f8f1400) 00010000:00010000:0.0:1782222195.062197:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1782222195.062204:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e6811d14 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558650 expref: 35 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222195.062437:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087d4ba050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+34:12239:x1868795060761856:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 10805us (10967us total) trans 4294967433 rc 0/0 00000100:00100000:0.0:1782222195.062446:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 38 00000020:00080000:0.0:1782222195.062450:0:6530:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1782222195.078408:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222195.078590:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060762112 00000100:00100000:1.0:1782222195.078602:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060762112 00000100:00100000:1.0:1782222195.078666:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 162 00000100:00100000:1.0:1782222195.078677:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+34:12239:x1868795060762112:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:1.0:1782222195.078703:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222195.078727:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e6811d30 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558657 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222195.078800:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e6811d30 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558657 expref: 35 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222195.078816:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e6811d30 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558657 expref: 35 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222195.078860:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0842e7fa00) 00010000:00010000:1.0:1782222195.078864:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782222195.078867:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744c800, rc 0) 00000100:00100000:1.0:1782222195.078937:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+35:12239:x1868795060762112:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 261us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222195.079011:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 162 00000100:00100000:2.0:1782222195.099738:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222195.104103:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060762368 00000100:00100000:0.0:1782222195.104119:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060762368 00000100:00100000:0.0:1782222195.104201:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 39 00000100:00100000:0.0:1782222195.104212:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+35:12239:x1868795060762368:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:0.0:1782222195.104491:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+36:12239:x1868795060762368:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 280us (4762us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1782222195.104499:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 39 00000100:00100000:3.0:1782222195.201941:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222195.202553:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060762624 00000100:00100000:2.0:1782222195.202564:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060762624 00000100:00100000:2.0:1782222195.202632:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 163 00000100:00100000:2.0:1782222195.202643:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+36:12249:x1868795060762624:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1782222195.202669:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222195.202689:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6811d37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755865e expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782222195.202929:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1782222195.203033:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6811d37 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755865e expref: 38 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.203291:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0849b70a00) 00010000:00010000:2.0:1782222195.203295:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782222195.203301:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6811d37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755865e expref: 38 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.203316:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb83e00, rc 0) 00000100:00100000:2.0:1782222195.203399:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+37:12249:x1868795060762624:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 757us (1467us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1782222195.203406:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 163 00000100:00100000:3.0:1782222195.205656:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222195.205799:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060762752 00000100:00100000:0.0:1782222195.205836:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060762752 00000100:00100000:0.0:1782222195.205924:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 164 00000100:00100000:0.0:1782222195.205934:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+37:12249:x1868795060762752:12345-192.168.203.27@tcp:34:lfs.0 00010000:00010000:0.0:1782222195.206048:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811d45 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.206065:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811d45 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.206077:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811d45 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.206087:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8600/0xe2b7cc26e6811d4c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.206095:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8600/0xe2b7cc26e6811d4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.206102:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8600/0xe2b7cc26e6811d4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.206180:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8000/0xe2b7cc26e6811d53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.206188:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8000/0xe2b7cc26e6811d53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.206195:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8000/0xe2b7cc26e6811d53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782222195.206277:0:8465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8000/0xe2b7cc26e6811d53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.206291:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811d45 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.206307:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811d45 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.206314:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811d45 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.206320:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb9800 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222195.206335:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811d45 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.206342:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811d45 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.206354:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:0.0:1782222195.206357:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782222195.206361:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811d45 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.206367:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811d45 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.206386:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8600/0xe2b7cc26e6811d4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.206391:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8600/0xe2b7cc26e6811d4c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.206396:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8600/0xe2b7cc26e6811d4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.206400:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb8600 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222195.206410:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8600/0xe2b7cc26e6811d4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.206416:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8600/0xe2b7cc26e6811d4c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.206424:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f087f8f1000) 00010000:00010000:0.0:1782222195.206427:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782222195.206430:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8600/0xe2b7cc26e6811d4c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.206436:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8600/0xe2b7cc26e6811d4c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.206446:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8000/0xe2b7cc26e6811d53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.206451:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8000/0xe2b7cc26e6811d53 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.206457:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8000/0xe2b7cc26e6811d53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.206462:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb8000 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222195.206465:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8000/0xe2b7cc26e6811d53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.206471:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8000/0xe2b7cc26e6811d53 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.206478:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0842e7fa00) 00010000:00010000:0.0:1782222195.206480:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782222195.206490:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8000/0xe2b7cc26e6811d53 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.206496:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8000/0xe2b7cc26e6811d53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222195.206565:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+37:12249:x1868795060762752:12345-192.168.203.27@tcp:34:lfs.0 Request processed in 632us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222195.206573:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 164 00000100:00100000:3.0:1782222195.212177:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222195.212282:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060763008 00000100:00100000:0.0:1782222195.212293:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060763008 00000100:00100000:0.0:1782222195.212354:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 40 00000100:00100000:0.0:1782222195.212364:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+37:12249:x1868795060763008:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:0.0:1782222195.212599:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+38:12249:x1868795060763008:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 236us (431us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1782222195.212608:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 40 00010000:00010000:3.0:1782222195.242524:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222195.265181:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222195.265392:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060763264 00000100:00100000:2.0:1782222195.265403:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060763264 00000100:00100000:2.0:1782222195.265470:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 165 00000100:00100000:2.0:1782222195.265480:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+38:12252:x1868795060763264:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1782222195.265504:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222195.265525:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6811d5a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558665 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.265593:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811d61 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.265605:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811d61 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.265615:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811d61 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.265622:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811d68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.265628:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811d68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.265633:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811d68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.265748:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811d6f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.265757:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811d6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.265783:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811d6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782222195.265809:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1782222195.265893:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811d61 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.265900:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811d61 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.265905:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811d61 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.265910:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83c00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222195.265913:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811d61 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.265919:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811d61 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.265936:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:2.0:1782222195.265938:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782222195.265942:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811d61 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.265946:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811d61 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.265957:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811d68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.265961:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811d68 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.265971:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811d68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.265975:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb82800 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222195.265977:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811d68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.265982:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811d68 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.265988:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f087f8f1000) 00010000:00010000:2.0:1782222195.265990:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782222195.265993:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811d68 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.265997:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811d68 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.266034:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6811d5a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558665 expref: 41 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.266047:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811d6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558665 expref: 40 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.266054:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0842e7fa00) 00010000:00010000:2.0:1782222195.266056:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782222195.266059:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb82600, rc 0) 00000100:00100000:2.0:1782222195.266125:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+40:12252:x1868795060763264:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 646us (953us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1782222195.266146:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 165 00000100:00100000:3.0:1782222195.270462:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222195.270813:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060763392 00000100:00100000:2.0:1782222195.270823:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060763392 00000100:00100000:2.0:1782222195.270922:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 166 00000100:00100000:2.0:1782222195.270933:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+40:12252:x1868795060763392:12345-192.168.203.27@tcp:54:lfs.0 00010000:00010000:2.0:1782222195.271018:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811d7d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.271035:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811d7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.271056:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811d7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.271089:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811d7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.271096:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811d7d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.271104:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811d7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.271109:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83200 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222195.271113:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811d7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.271121:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811d7d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.271143:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0842e7fa00) 00010000:00010000:2.0:1782222195.271152:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782222195.271158:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811d7d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.271165:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811d7d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222195.271259:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+40:12252:x1868795060763392:12345-192.168.203.27@tcp:54:lfs.0 Request processed in 328us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222195.271268:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 166 00000100:00100000:3.0:1782222195.273551:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222195.273873:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060763648 00000100:00100000:0.0:1782222195.273882:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060763648 00000100:00100000:0.0:1782222195.273932:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 41 00000100:00100000:0.0:1782222195.273951:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+40:12252:x1868795060763648:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:0.0:1782222195.274211:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+41:12252:x1868795060763648:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 269us (667us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1782222195.274220:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 41 00000100:00100000:3.0:1782222195.521002:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222195.521116:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060763904 00000100:00100000:1.0:1782222195.521125:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060763904 00000100:00100000:1.0:1782222195.521189:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 167 00000100:00100000:1.0:1782222195.521199:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+41:12283:x1868795060763904:12345-192.168.203.27@tcp:101:cat.0 00010000:00010000:1.0:1782222195.521231:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222195.521286:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811d84 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755866c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222195.521396:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811d8b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222195.521411:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811d8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222195.521423:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811d8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782222195.521434:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1782222195.521556:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811d84 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755866c expref: 44 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222195.521593:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811d8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755866c expref: 43 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222195.521600:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0842e7fa00) 00010000:00010000:1.0:1782222195.521603:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782222195.521606:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744c000, rc 0) 00000100:00100000:1.0:1782222195.522073:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+43:12283:x1868795060763904:12345-192.168.203.27@tcp:101:cat.0 Request processed in 872us (1078us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1782222195.522081:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 167 00000100:00100000:3.0:1782222195.526845:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222195.526930:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060764032 00000100:00100000:1.0:1782222195.526949:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060764032 00000100:00100000:1.0:1782222195.527021:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 14 00000100:00100000:1.0:1782222195.527032:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+43:2387:x1868795060764032:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782222195.527049:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222195.527074:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811d8b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755866c expref: 43 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222195.527092:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0842e7fa00) 00010000:00010000:1.0:1782222195.527097:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782222195.527156:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+42:2387:x1868795060764032:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 124us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222195.527164:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 14 00000100:00100000:3.0:1782222195.530916:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222195.531029:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060764288 00000100:00100000:0.0:1782222195.531040:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060764288 00000100:00100000:0.0:1782222195.531098:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 42 00000100:00100000:0.0:1782222195.531107:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+42:12283:x1868795060764288:12345-192.168.203.27@tcp:35:cat.0 00000100:00100000:0.0:1782222195.531424:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+43:12283:x1868795060764288:12345-192.168.203.27@tcp:35:cat.0 Request processed in 317us (516us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1782222195.531432:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 42 00000100:00100000:2.0:1782222195.631699:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222195.631843:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060764544 00000100:00100000:3.0:1782222195.631853:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060764544 00000100:00100000:3.0:1782222195.631914:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 168 00000100:00100000:3.0:1782222195.631924:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747561c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+43:12289:x1868795060764544:12345-192.168.203.27@tcp:101:dd.0 00010000:00010000:3.0:1782222195.631947:0:13817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222195.631950:0:13817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1782222195.631976:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6811cf1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558642 expref: 43 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222195.632014:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:3.0:1782222195.632019:0:13817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782222195.632032:0:13817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811d99 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558673 expref: -99 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222195.632130:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811da0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222195.632143:0:13817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811d6f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558665 expref: 43 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222195.632152:0:13817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811da0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222195.632184:0:13817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811d6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558665 expref: 43 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222195.632195:0:13817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811d6f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558665 expref: 43 pid: 6528 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222195.632209:0:13817:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747e70380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13817:1868795081810432:192.168.203.27@tcp:104: 00000100:00100000:3.0:1782222195.632308:0:13817:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f084921a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782222195.635400:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222195.635481:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060764672 00000100:00100000:1.0:1782222195.635490:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060764672 00000100:00100000:0.0:1782222195.635495:0:13817:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747e70380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13817:1868795081810432:192.168.203.27@tcp:104: 00010000:00010000:0.0:1782222195.635521:0:13817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811da0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222195.635529:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811d6f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558665 expref: 44 pid: 6528 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222195.635629:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 82 00000100:00100000:1.0:1782222195.635639:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08429a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77bf2c2c-f408-43f9-ae59-449550631d05+44:2390:x1868795060764672:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782222195.635655:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222195.635663:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811d6f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558665 expref: 44 pid: 6528 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222195.635675:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811d6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558665 expref: 44 pid: 6528 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222195.636402:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811d6f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558665 expref: 44 pid: 6528 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222195.636420:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0842e7fa00) 00010000:00010000:1.0:1782222195.636424:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811da0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222195.636434:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811da0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222195.636441:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811da0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222195.636462:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782222195.636525:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08429a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77bf2c2c-f408-43f9-ae59-449550631d05+43:2390:x1868795060764672:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 887us (1132us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222195.636534:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 82 00010000:00010000:0.0:1782222195.639848:0:13817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811da0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.639865:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811da0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782222195.639889:0:13817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1782222195.640038:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811d99 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558673 expref: 44 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.640058:0:13817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811da0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558673 expref: 43 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.640066:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0842e7fa00) 00010000:00010000:0.0:1782222195.640070:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782222195.640074:0:13817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746431200, rc 0) 00000100:00100000:0.0:1782222195.640147:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747561c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+43:12289:x1868795060764544:12345-192.168.203.27@tcp:101:dd.0 Request processed in 8224us (8455us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1782222195.640155:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 168 00000100:00100000:3.0:1782222195.646921:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222195.647081:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060764800 00000100:00100000:2.0:1782222195.647090:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060764800 00000100:00100000:2.0:1782222195.647138:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 169 00000100:00100000:2.0:1782222195.647155:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+43:12289:x1868795060764800:12345-192.168.203.27@tcp:101:dd.0 00010000:00010000:2.0:1782222195.647180:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222195.647200:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811dae lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755867a expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.647265:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811db5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.647281:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811db5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.647292:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811db5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.647405:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811dae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755867a expref: 45 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.647430:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811db5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755867a expref: 44 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222195.647439:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0842e7fa00) 00010000:00010000:2.0:1782222195.647443:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782222195.647446:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb82800, rc 0) 00000100:00100000:2.0:1782222195.647505:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+44:12289:x1868795060764800:12345-192.168.203.27@tcp:101:dd.0 Request processed in 360us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222195.647511:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 169 00000100:00100000:2.0:1782222195.654474:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222195.654576:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060765056 00000100:00100000:0.0:1782222195.654598:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060765056 00000100:00100000:0.0:1782222195.654654:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 170 00000100:00100000:0.0:1782222195.654664:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+44:12289:x1868795060765056:12345-192.168.203.27@tcp:36:dd.0 00010000:00010000:0.0:1782222195.654906:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8000/0xe2b7cc26e6811dbc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.654924:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8000/0xe2b7cc26e6811dbc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.654935:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8000/0xe2b7cc26e6811dbc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782222195.654977:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:0.0:1782222195.655000:0:6528:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003d76839b reply state 0000000009b176ab transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8000/0xe2b7cc26e6811dbc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.655012:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8000/0xe2b7cc26e6811dbc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.655020:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0842e7fa00) 00010000:00010000:0.0:1782222195.655023:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782222195.655026:0:6528:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782222195.655110:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+47:12289:x1868795060765056:12345-192.168.203.27@tcp:36:dd.0 Request processed in 447us (645us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1782222195.655117:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 170 00000020:00080000:0.0:1782222195.655121:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1782222195.987673:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222195.987778:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060765184 00000100:00100000:0.0:1782222195.987796:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060765184 00000100:00100000:0.0:1782222195.987863:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 171 00000100:00100000:0.0:1782222195.987873:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+47:12303:x1868795060765184:12345-192.168.203.27@tcp:101:stat.0 00010000:00010000:0.0:1782222195.987901:0:13817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222195.987931:0:13817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8600/0xe2b7cc26e6811dc3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558681 expref: -99 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.987996:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811dca lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.988010:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811dca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.988023:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811dca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.988034:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e6811dd1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.988041:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e6811dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.988048:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e6811dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.988135:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811dd8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.988146:0:13817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811da0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558673 expref: 48 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.988154:0:13817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811dd8 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.988187:0:13817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811da0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558673 expref: 48 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222195.988220:0:13817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811da0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558673 expref: 48 pid: 13817 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222195.988282:0:13817:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08504cbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13817:1868795081810560:192.168.203.27@tcp:104: 00000100:00100000:0.0:1782222195.988364:0:13817:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0858d5b240 going to sleep for 11 seconds 00000100:00100000:0.0:1782222195.990086:0:13817:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08504cbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13817:1868795081810560:192.168.203.27@tcp:104: 00010000:00010000:0.0:1782222195.990112:0:13817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811dd8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222195.996409:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222195.996549:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060765440 00000100:00100000:0.0:1782222195.996560:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060765440 00000100:00100000:0.0:1782222195.996625:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 43 00000100:00100000:0.0:1782222195.996635:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+49:6158:x1868795060765440:12345-192.168.203.27@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1782222195.996922:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+50:6158:x1868795060765440:12345-192.168.203.27@tcp:35:ldlm_bl.0 Request processed in 287us (523us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1782222195.996930:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 43 00000100:00100000:3.0:1782222196.001095:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222196.001278:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060765568 00000100:00100000:1.0:1782222196.001294:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060765568 00000100:00080000:3.0:1782222196.001381:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782222196.001596:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811da0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558673 expref: 50 pid: 13817 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222196.001644:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 83 00000100:00100000:1.0:1782222196.001655:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+50:2387:x1868795060765568:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782222196.001671:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222196.001679:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811da0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558673 expref: 50 pid: 13817 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.001695:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811da0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558673 expref: 50 pid: 13817 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.001719:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811da0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558673 expref: 50 pid: 13817 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.001736:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0842e7fa00) 00010000:00010000:1.0:1782222196.001741:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811dd8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.001752:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.001760:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811dd8 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.001799:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782222196.001856:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+49:2387:x1868795060765568:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 203us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222196.001876:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 83 00010000:00010000:0.0:1782222196.002108:0:13817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.002118:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782222196.002168:0:13817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1782222196.002173:0:13817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782222196.002202:0:13817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.002227:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.002358:0:13817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811dca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.002367:0:13817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811dca lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.002374:0:13817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811dca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.002380:0:13817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb9800 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222196.002384:0:13817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811dca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.002392:0:13817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811dca lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.002403:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:0.0:1782222196.002406:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782222196.002409:0:13817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811dca lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.002415:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811dca lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.002427:0:13817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e6811dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.002433:0:13817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e6811dd1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.002445:0:13817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e6811dd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.002450:0:13817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb9000 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222196.002452:0:13817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e6811dd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.002458:0:13817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e6811dd1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.002466:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f087f8f1000) 00010000:00010000:0.0:1782222196.002468:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782222196.002470:0:13817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e6811dd1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.002475:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e6811dd1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.002510:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8600/0xe2b7cc26e6811dc3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558681 expref: 49 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.002523:0:13817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811dd8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558681 expref: 48 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.002530:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0842e7fa00) 00010000:00010000:0.0:1782222196.002532:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782222196.002535:0:13817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fcb9a00, rc 0) 00000100:00100000:0.0:1782222196.002566:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+48:12303:x1868795060765184:12345-192.168.203.27@tcp:101:stat.0 Request processed in 14694us (14901us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222196.002582:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 171 00000100:00100000:3.0:1782222196.080613:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222196.080857:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060765824 00000100:00100000:2.0:1782222196.080868:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060765824 00000100:00100000:2.0:1782222196.080931:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 172 00000100:00100000:2.0:1782222196.080941:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+48:12309:x1868795060765824:12345-192.168.203.27@tcp:36:truncate.0 00010000:00010000:2.0:1782222196.081001:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782222196.081026:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811dd8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558681 expref: 48 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.081048:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0842e7fa00) 00010000:00010000:2.0:1782222196.081053:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782222196.081299:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6811ddf lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.081315:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6811ddf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.081325:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6811ddf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782222196.081385:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:2.0:1782222196.081409:0:6526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004b959259 reply state 0000000085e4f82c transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6811ddf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.081421:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6811ddf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.081427:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0842e7fa00) 00010000:00010000:2.0:1782222196.081430:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782222196.081432:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782222196.081544:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+50:12309:x1868795060765824:12345-192.168.203.27@tcp:36:truncate.0 Request processed in 602us (937us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1782222196.081551:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 172 00000020:00080000:2.0:1782222196.081556:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1782222196.237135:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222196.237231:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060765952 00000100:00100000:0.0:1782222196.237265:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060765952 00000100:00100000:0.0:1782222196.237332:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 173 00000100:00100000:0.0:1782222196.237344:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+50:12323:x1868795060765952:12345-192.168.203.27@tcp:101:stat.0 00010000:00010000:0.0:1782222196.237370:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222196.237389:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e6811de6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558688 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.237453:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811ded lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.237467:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811ded lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.237477:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811ded lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.237488:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9400/0xe2b7cc26e6811df4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.237494:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9400/0xe2b7cc26e6811df4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.237500:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9400/0xe2b7cc26e6811df4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.237567:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8e00/0xe2b7cc26e6811dfb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.237593:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8e00/0xe2b7cc26e6811dfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.237600:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8e00/0xe2b7cc26e6811dfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782222196.237639:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1782222196.237643:0:6528:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782222196.237661:0:6528:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8e00/0xe2b7cc26e6811dfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.237672:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8e00/0xe2b7cc26e6811dfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.237680:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811ded lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.237686:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811ded lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.237692:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811ded lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.237721:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb9800 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222196.237725:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811ded lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.237731:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811ded lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.237743:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:0.0:1782222196.237752:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782222196.237757:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811ded lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.237763:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811ded lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.237777:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9400/0xe2b7cc26e6811df4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.237793:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9400/0xe2b7cc26e6811df4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.237799:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9400/0xe2b7cc26e6811df4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.237803:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb9400 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222196.237806:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9400/0xe2b7cc26e6811df4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.237811:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9400/0xe2b7cc26e6811df4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.237818:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f087f8f1000) 00010000:00010000:0.0:1782222196.237821:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782222196.237823:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9400/0xe2b7cc26e6811df4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.237828:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9400/0xe2b7cc26e6811df4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.237854:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e6811de6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558688 expref: 52 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.237881:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8e00/0xe2b7cc26e6811dfb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558688 expref: 51 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.237889:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0842e7fa00) 00010000:00010000:0.0:1782222196.237892:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782222196.237895:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fcb8e00, rc 0) 00000100:00100000:0.0:1782222196.237957:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+51:12323:x1868795060765952:12345-192.168.203.27@tcp:101:stat.0 Request processed in 615us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222196.237966:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 173 00010000:00010000:3.0:1782222196.270172:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222196.330410:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222196.330569:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060766208 00000100:00100000:3.0:1782222196.330579:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060766208 00000100:00100000:3.0:1782222196.330635:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 174 00000100:00100000:3.0:1782222196.330646:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+51:12333:x1868795060766208:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1782222196.330667:0:13817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222196.330687:0:13817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811e02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755868f expref: -99 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782222196.330798:0:13817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1782222196.330896:0:13817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811e02 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755868f expref: 53 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.330909:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0849b70a00) 00010000:00010000:3.0:1782222196.330911:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782222196.330916:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811e02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755868f expref: 53 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.330929:0:13817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746431a00, rc 0) 00000100:00100000:3.0:1782222196.331970:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+52:12333:x1868795060766208:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 1322us (1566us total) trans 4294967447 rc 301/301 00000100:00100000:3.0:1782222196.331980:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 174 00000100:00100000:3.0:1782222196.341620:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222196.341803:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060766464 00000100:00100000:0.0:1782222196.341813:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060766464 00000100:00100000:0.0:1782222196.341873:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 44 00000100:00100000:0.0:1782222196.341884:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087d4b9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+52:12333:x1868795060766464:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:0.0:1782222196.342272:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087d4b9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+53:12333:x1868795060766464:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 353us (624us total) trans 4294967448 rc 0/0 00000100:00100000:0.0:1782222196.342281:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 44 00000100:00100000:0.0:1782222196.429909:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222196.430009:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060766720 00000100:00100000:3.0:1782222196.430019:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060766720 00000100:00100000:3.0:1782222196.430101:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 175 00000100:00100000:3.0:1782222196.430110:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+53:12339:x1868795060766720:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:3.0:1782222196.430144:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222196.430163:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811e10 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558696 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.430310:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811e17 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.430326:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8e00/0xe2b7cc26e6811dfb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558688 expref: 54 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.430335:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811e17 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.430366:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8e00/0xe2b7cc26e6811dfb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558688 expref: 54 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.430380:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8e00/0xe2b7cc26e6811dfb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558688 expref: 54 pid: 6528 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222196.430411:0:8465:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747e70e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8465:1868795081810688:192.168.203.27@tcp:104: 00000100:00100000:3.0:1782222196.431205:0:8465:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f084921a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782222196.438159:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222196.438258:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060766848 00000100:00100000:1.0:1782222196.438268:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060766848 00010000:00010000:1.0:1782222196.438306:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8e00/0xe2b7cc26e6811dfb lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558688 expref: 55 pid: 6528 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222196.438356:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 84 00000100:00100000:1.0:1782222196.438367:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77bf2c2c-f408-43f9-ae59-449550631d05+55:2390:x1868795060766848:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782222196.438383:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222196.438390:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8e00/0xe2b7cc26e6811dfb lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558688 expref: 55 pid: 6528 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.438419:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8e00/0xe2b7cc26e6811dfb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558688 expref: 55 pid: 6528 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.438443:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0842e7fa00) 00010000:00010000:1.0:1782222196.438449:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811e17 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.438461:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811e17 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.438469:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811e17 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.438487:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782222196.438555:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77bf2c2c-f408-43f9-ae59-449550631d05+55:2390:x1868795060766848:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 189us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222196.438578:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 84 00010000:00010000:0.0:1782222196.440160:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8e00/0xe2b7cc26e6811dfb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558688 expref: 54 pid: 6528 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222196.440186:0:8465:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747e70e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8465:1868795081810688:192.168.203.27@tcp:104: 00010000:00010000:0.0:1782222196.440208:0:8465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811e17 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.440330:0:8465:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811e17 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.440339:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811e17 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782222196.440359:0:8465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1782222196.440490:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811e10 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558696 expref: 55 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.440505:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811e17 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558696 expref: 54 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.440512:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0842e7fa00) 00010000:00010000:0.0:1782222196.440515:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782222196.440517:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746431c00, rc 0) 00000100:00100000:0.0:1782222196.440579:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+54:12339:x1868795060766720:12345-192.168.203.27@tcp:101:bash.0 Request processed in 10469us (10679us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1782222196.440587:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 175 00000100:00100000:3.0:1782222196.446693:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222196.447086:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060767104 00000100:00100000:1.0:1782222196.447096:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060767104 00000100:00100000:1.0:1782222196.447164:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 176 00000100:00100000:1.0:1782222196.447175:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+54:12339:x1868795060767104:12345-192.168.203.27@tcp:36:bash.0 00010000:00010000:1.0:1782222196.448816:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811e25 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.448839:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811e25 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.448851:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811e25 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782222196.448924:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:1.0:1782222196.448961:0:6527:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000032db4e22 reply state 000000006f3f3041 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811e25 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.448975:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811e25 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.448984:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0842e7fa00) 00010000:00010000:1.0:1782222196.448987:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782222196.448990:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782222196.449571:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+57:12339:x1868795060767104:12345-192.168.203.27@tcp:36:bash.0 Request processed in 2393us (2883us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1782222196.449580:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 176 00000020:00080000:1.0:1782222196.449585:0:6527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1782222196.457798:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222196.457959:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060767232 00000100:00100000:3.0:1782222196.457969:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060767232 00000100:00100000:3.0:1782222196.458038:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 177 00000100:00100000:3.0:1782222196.458048:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+57:12339:x1868795060767232:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:3.0:1782222196.458086:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222196.458107:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811e2c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755869d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.458206:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e6811e33 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.458221:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811e17 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558696 expref: 58 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.458394:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e6811e33 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.458482:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811e17 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558696 expref: 58 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.458495:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811e17 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558696 expref: 58 pid: 8465 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222196.458508:0:6526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747e73b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6526:1868795081810816:192.168.203.27@tcp:104: 00000100:00100000:3.0:1782222196.458865:0:6526:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f084921a480 going to sleep for 11 seconds 00000100:00100000:0.0:1782222196.464904:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222196.465051:0:6526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747e73b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6526:1868795081810816:192.168.203.27@tcp:104: 00010000:00010000:3.0:1782222196.465080:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e6811e33 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222196.465471:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060767360 00000100:00100000:1.0:1782222196.465494:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060767360 00010000:00010000:1.0:1782222196.465537:0:9532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811e17 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558696 expref: 59 pid: 8465 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222196.465609:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 85 00000100:00100000:1.0:1782222196.465619:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77bf2c2c-f408-43f9-ae59-449550631d05+59:2390:x1868795060767360:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782222196.465634:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222196.465640:0:9532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811e17 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558696 expref: 59 pid: 8465 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.465652:0:9532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811e17 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558696 expref: 59 pid: 8465 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.465675:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811e17 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558696 expref: 59 pid: 8465 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.465691:0:9532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0842e7fa00) 00010000:00010000:1.0:1782222196.465709:0:9532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e6811e33 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.465719:0:9532:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e6811e33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.465726:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e6811e33 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.465753:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782222196.465826:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77bf2c2c-f408-43f9-ae59-449550631d05+58:2390:x1868795060767360:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 207us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222196.465843:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 85 00010000:00010000:2.0:1782222196.466031:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e6811e33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.466039:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e6811e33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782222196.466095:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1782222196.466100:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782222196.466122:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e6811e33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.466164:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811e2c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755869d expref: 58 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.466179:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e6811e33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755869d expref: 57 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.466194:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0842e7fa00) 00010000:00010000:2.0:1782222196.466196:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782222196.466199:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746431600, rc 0) 00000100:00100000:2.0:1782222196.466263:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+57:12339:x1868795060767232:12345-192.168.203.27@tcp:101:bash.0 Request processed in 8217us (8483us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222196.466271:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 177 00000100:00100000:0.0:1782222196.469868:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222196.469964:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060767616 00000100:00100000:2.0:1782222196.469974:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060767616 00000100:00100000:2.0:1782222196.470038:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 45 00000100:00100000:2.0:1782222196.470049:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+57:12339:x1868795060767616:12345-192.168.203.27@tcp:35:bash.0 00000100:00100000:2.0:1782222196.470290:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+58:12339:x1868795060767616:12345-192.168.203.27@tcp:35:bash.0 Request processed in 242us (430us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1782222196.470297:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 45 00000100:00100000:0.0:1782222196.555202:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222196.555360:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060767872 00000100:00100000:3.0:1782222196.555370:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060767872 00000100:00100000:3.0:1782222196.555424:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 178 00000100:00100000:3.0:1782222196.555445:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0875aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+58:12349:x1868795060767872:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1782222196.555468:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222196.555485:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e6811e3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75586a4 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782222196.555575:0:8465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1782222196.555660:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e6811e3a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586a4 expref: 60 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.555674:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0849b70a00) 00010000:00010000:3.0:1782222196.555677:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782222196.555681:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e6811e3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586a4 expref: 60 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.555863:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746430800, rc 0) 00000100:00100000:3.0:1782222196.555928:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0875aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+59:12349:x1868795060767872:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 484us (800us total) trans 4294967453 rc 301/301 00000100:00100000:3.0:1782222196.555935:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 178 00000100:00100000:0.0:1782222196.561827:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222196.562159:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060768000 00000100:00100000:1.0:1782222196.562169:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060768000 00000100:00100000:1.0:1782222196.562227:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 179 00000100:00100000:1.0:1782222196.562270:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+59:12349:x1868795060768000:12345-192.168.203.27@tcp:34:lfs.0 00010000:00010000:1.0:1782222196.562341:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811e48 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.562357:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811e48 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.562368:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811e48 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.562379:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811e4f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.562386:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811e4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.562393:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811e4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.562468:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811e56 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.562477:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811e56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.562484:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811e56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782222196.562549:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811e56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.562562:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811e48 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.562568:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811e48 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.562575:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811e48 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.562580:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744da00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222196.562584:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811e48 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.562591:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811e48 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.562606:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:1.0:1782222196.562608:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222196.562613:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811e48 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.562618:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811e48 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.562632:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811e4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.562637:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811e4f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.562649:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811e4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.562654:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744dc00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222196.562657:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811e4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.562663:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811e4f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.562672:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f087f8f1000) 00010000:00010000:1.0:1782222196.562674:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222196.562677:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811e4f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.562683:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6811e4f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.562693:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811e56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.562715:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811e56 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.562721:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811e56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.562726:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744d400 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222196.562729:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811e56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.562746:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811e56 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.562756:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0842e7fa00) 00010000:00010000:1.0:1782222196.562759:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222196.562762:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811e56 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222196.562768:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6811e56 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222196.562853:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+59:12349:x1868795060768000:12345-192.168.203.27@tcp:34:lfs.0 Request processed in 615us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222196.562861:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 179 00000100:00100000:0.0:1782222196.567196:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222196.567473:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060768256 00000100:00100000:2.0:1782222196.567485:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060768256 00000100:00100000:2.0:1782222196.567546:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 46 00000100:00100000:2.0:1782222196.567556:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847004380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+59:12349:x1868795060768256:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:2.0:1782222196.567850:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847004380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+60:12349:x1868795060768256:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 294us (663us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1782222196.567858:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 46 00000100:00100000:3.0:1782222196.619839:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222196.620687:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060768512 00000100:00100000:2.0:1782222196.620862:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060768512 00000100:00100000:2.0:1782222196.621098:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 180 00000100:00100000:2.0:1782222196.621109:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+60:12352:x1868795060768512:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1782222196.621160:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222196.621180:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e6811e5d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75586ab expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.621277:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811e64 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.621292:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811e64 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.621303:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811e64 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.621313:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811e6b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.621320:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811e6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.621327:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811e6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.621429:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811e72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.621438:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811e72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.621445:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811e72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782222196.621454:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1782222196.621533:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811e64 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.621540:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811e64 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.621547:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811e64 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.621553:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83000 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222196.621557:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811e64 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.621564:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811e64 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.621577:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:2.0:1782222196.621580:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782222196.621585:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811e64 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.621591:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811e64 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.621603:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811e6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.621609:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811e6b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.621614:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811e6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.621619:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83200 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222196.621629:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811e6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.621636:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811e6b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.621644:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f087f8f1000) 00010000:00010000:2.0:1782222196.621646:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782222196.621649:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811e6b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.621655:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811e6b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.622072:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e6811e5d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586ab expref: 63 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.622093:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811e72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586ab expref: 62 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.622100:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0842e7fa00) 00010000:00010000:2.0:1782222196.622102:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782222196.622104:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb83c00, rc 0) 00000100:00100000:2.0:1782222196.622189:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+62:12352:x1868795060768512:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 1081us (2357us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1782222196.622196:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 180 00000100:00100000:3.0:1782222196.625542:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222196.627915:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222196.627945:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060768768 00000100:00100000:3.0:1782222196.627956:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060768768 00000100:00100000:3.0:1782222196.628026:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 15 00000100:00100000:3.0:1782222196.628035:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77bf2c2c-f408-43f9-ae59-449550631d05+62:2387:x1868795060768768:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782222196.628051:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222196.628076:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811e72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586ab expref: 62 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.628109:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0842e7fa00) 00010000:00010000:3.0:1782222196.628114:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782222196.629283:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77bf2c2c-f408-43f9-ae59-449550631d05+61:2387:x1868795060768768:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 1241us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222196.629297:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 15 00000100:00100000:0.0:1782222196.630468:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060768640 00000100:00100000:0.0:1782222196.630481:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060768640 00000100:00100000:0.0:1782222196.630553:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 181 00000100:00100000:0.0:1782222196.630563:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+61:12352:x1868795060768640:12345-192.168.203.27@tcp:54:lfs.0 00010000:00010000:0.0:1782222196.630640:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e6811e80 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.630657:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e6811e80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.630668:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e6811e80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.630847:0:13817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e6811e80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.630856:0:13817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e6811e80 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.630864:0:13817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e6811e80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.630870:0:13817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb9600 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222196.630874:0:13817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e6811e80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.630883:0:13817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e6811e80 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.630895:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0842e7fa00) 00010000:00010000:0.0:1782222196.630898:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782222196.630902:0:13817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e6811e80 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222196.630909:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e6811e80 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222196.631289:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+61:12352:x1868795060768640:12345-192.168.203.27@tcp:54:lfs.0 Request processed in 724us (5753us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222196.631297:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 181 00000100:00100000:3.0:1782222196.633885:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222196.634114:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060769024 00000100:00100000:2.0:1782222196.634188:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060769024 00000100:00100000:2.0:1782222196.634270:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 47 00000100:00100000:2.0:1782222196.634280:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+61:12352:x1868795060769024:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:2.0:1782222196.634596:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+62:12352:x1868795060769024:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 316us (718us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1782222196.634603:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 47 00000004:00080000:1.0:1782222196.714598:0:9974:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 395743360172ns, next at 396743357517ns, rc = 0 00000100:00100000:0.0:1782222196.714665:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782222196.714686:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747c6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081810944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782222196.714765:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222196.714968:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782222196.714979:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081811072:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782222196.715016:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222196.715091:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081810944 00000100:00100000:1.0:1782222196.715100:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081810944 00000100:00100000:3.0:1782222196.715160:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081811072 00000100:00100000:3.0:1782222196.715164:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081811072 00000100:00100000:1.0:1782222196.715167:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1782222196.715175:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847005500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1868795081810944:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782222196.715196:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00002000:00000024:1.0:1782222196.715197:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222196.715203:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847007100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081811072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782222196.715211:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00080000:0.0:1782222196.715282:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782222196.715318:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081811072:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782222196.715353:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747c6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081810944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782222196.716437:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847005500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1868795081810944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1257us (1666us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222196.716448:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1782222196.716568:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847007100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081811072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1360us (1546us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222196.716576:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1782222196.784720:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222196.784874:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060769280 00000100:00100000:2.0:1782222196.784885:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060769280 00000100:00100000:2.0:1782222196.784949:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 182 00000100:00100000:2.0:1782222196.784960:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+62:12370:x1868795060769280:12345-192.168.203.27@tcp:101:cat.0 00010000:00010000:2.0:1782222196.784984:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222196.785005:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e6811e87 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75586b2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.785110:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811e8e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.785124:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811e8e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.785136:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811e8e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782222196.785148:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1782222196.785284:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e6811e87 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586b2 expref: 65 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.785302:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811e8e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586b2 expref: 64 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222196.785310:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0842e7fa00) 00010000:00010000:2.0:1782222196.785326:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1782222196.785330:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb83200, rc 0) 00000100:00100000:2.0:1782222196.785399:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+64:12370:x1868795060769280:12345-192.168.203.27@tcp:101:cat.0 Request processed in 441us (688us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1782222196.785407:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 182 00000100:00100000:1.0:1782222196.811340:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222196.811578:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060769408 00000100:00100000:3.0:1782222196.811588:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060769408 00000100:00100000:3.0:1782222196.811649:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 183 00000100:00100000:3.0:1782222196.811660:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+64:12371:x1868795060769408:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1782222196.811684:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222196.811703:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e6811e9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75586b9 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.811771:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811ea3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.811799:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.811825:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782222196.811870:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1782222196.811874:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782222196.811892:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.811916:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e6811e9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586b9 expref: 66 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.811942:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811ea3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586b9 expref: 65 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.811951:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:3.0:1782222196.811953:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782222196.811957:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746431c00, rc 0) 00000100:00100000:3.0:1782222196.812031:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+65:12371:x1868795060769408:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 373us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222196.812038:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 183 00000100:00100000:0.0:1782222196.828884:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222196.829056:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060769792 00000100:00100000:2.0:1782222196.829066:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060769792 00000100:00100000:2.0:1782222196.829123:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 48 00000100:00100000:2.0:1782222196.829134:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+65:12371:x1868795060769792:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:2.0:1782222196.829446:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+66:12371:x1868795060769792:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 313us (571us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1782222196.829454:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 48 00000100:00100000:1.0:1782222196.833538:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222196.833862:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060769920 00000100:00100000:3.0:1782222196.833871:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060769920 00000100:00100000:3.0:1782222196.833952:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 16 00000100:00100000:3.0:1782222196.833963:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+66:12371:x1868795060769920:12345-192.168.203.27@tcp:103:lfs.0 00010000:00010000:3.0:1782222196.833980:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1782222196.834004:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e6811e33 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755869d expref: 66 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.834046:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811e8e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586b2 expref: 65 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.834059:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e6811d30 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558657 expref: 64 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.834069:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0842e7fa00) 00010000:00010000:3.0:1782222196.834074:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782222196.834137:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+63:12371:x1868795060769920:12345-192.168.203.27@tcp:103:lfs.0 Request processed in 176us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222196.834146:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 16 00000100:00100000:1.0:1782222196.837897:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222196.838083:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060770048 00000100:00100000:3.0:1782222196.838093:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060770048 00000100:00100000:3.0:1782222196.838203:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 184 00000100:00100000:3.0:1782222196.838214:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+63:12371:x1868795060770048:12345-192.168.203.27@tcp:58:lfs.0 00010000:00010000:3.0:1782222196.838349:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e6811eaa lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.838367:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e6811eaa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.838380:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e6811eaa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782222196.838473:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1782222196.838594:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+63:12371:x1868795060770048:12345-192.168.203.27@tcp:58:lfs.0 Request processed in 381us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222196.838617:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 184 00000100:00100000:0.0:1782222196.871460:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222196.871549:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060770176 00000100:00100000:3.0:1782222196.871560:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060770176 00000100:00100000:3.0:1782222196.871624:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 185 00000100:00100000:3.0:1782222196.871634:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+63:12373:x1868795060770176:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1782222196.871654:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222196.871674:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e6811eb1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75586c0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.871738:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811eb8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.871751:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811eb8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.871762:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811eb8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.871772:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811ebf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.871789:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811ebf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.871795:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811ebf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.871862:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811ec6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.871891:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811ec6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.871899:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811ec6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782222196.871942:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1782222196.871946:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782222196.871966:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811ec6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.871978:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811ec6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.871986:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811eb8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.871993:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811eb8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.871999:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811eb8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.872005:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746430000 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222196.872010:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811eb8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.872017:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811eb8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.872029:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:3.0:1782222196.872032:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222196.872043:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811eb8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.872048:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811eb8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.872063:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811ebf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.872069:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811ebf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.872074:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811ebf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.872078:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746431a00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222196.872081:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811ebf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.872085:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811ebf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.872092:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f087f8f1000) 00010000:00010000:3.0:1782222196.872094:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222196.872096:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811ebf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.872102:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811ebf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.872128:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e6811eb1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586c0 expref: 65 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.872153:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811ec6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586c0 expref: 64 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222196.872160:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0842e7fa00) 00010000:00010000:3.0:1782222196.872162:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782222196.872165:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746431200, rc 0) 00000100:00100000:3.0:1782222196.872231:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+64:12373:x1868795060770176:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 598us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222196.872287:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 185 00000040:00080000:1.0:1782222197.099840:0:13806:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782222197.099850:0:13806:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782222197.099911:0:13806:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1782222197.099918:0:13806:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782222197.100052:0:13806:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747c6df80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1868795081811200:192.168.203.27@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1782222197.100152:0:13806:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0844c0c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782222197.104141:0:13806:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747c6df80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1868795081811200:192.168.203.27@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1782222197.104502:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222197.104614:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060770304 00000100:00100000:3.0:1782222197.104621:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060770304 00000100:00100000:3.0:1782222197.104677:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 186 00000100:00100000:3.0:1782222197.104688:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+64:12384:x1868795060770304:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1782222197.104719:0:13817:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1782222197.104852:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+64:12384:x1868795060770304:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 Request processed in 165us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222197.104859:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 186 00000100:00100000:3.0:1782222197.108676:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222197.108795:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060770432 00000100:00100000:1.0:1782222197.108805:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060770432 00000100:00100000:1.0:1782222197.108868:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 187 00000100:00100000:1.0:1782222197.108879:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+64:12384:x1868795060770432:12345-192.168.203.27@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1782222197.108948:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811ecd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.108964:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811ecd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.108978:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811ecd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.109055:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811ed4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.109073:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.109080:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.109107:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811edb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782222197.109283:0:6505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000004:00080000:0.0:1782222197.109293:0:6505:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00010000:00010000:1.0:1782222197.109442:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811edb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.109450:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811edb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782222197.109492:0:8465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1782222197.109496:0:8465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782222197.109512:0:8465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811edb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.109523:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811ecd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.109530:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811ecd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.109537:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811ecd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.109544:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744d600 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222197.109548:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811ecd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.109555:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811ecd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782222197.109560:0:6505:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00010000:00010000:1.0:1782222197.109566:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f087f8f2900) 00010000:00010000:1.0:1782222197.109571:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:0.0:1782222197.109571:0:6505:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f0746166c00 refcount 2 committed 0 result 0 batchid 5 00010000:00010000:1.0:1782222197.109575:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811ecd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1782222197.109577:0:6505:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8f07462c0400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f0746166840 00000020:00080000:0.0:1782222197.109585:0:6505:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8f07462c0c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f0747c71400 00010000:00010000:1.0:1782222197.109598:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811ecd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.109614:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.109620:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811ed4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.109627:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.109632:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744ca00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222197.109635:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.109641:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811ed4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.109650:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff8f0842e7f200) 00010000:00010000:1.0:1782222197.109652:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222197.109655:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811ed4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.109661:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811ed4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.109676:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811edb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.109684:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811edb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222197.109709:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0847006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081811328:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782222197.109764:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782222197.109769:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811edb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.109785:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744c200 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222197.109789:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811edb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.109796:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811edb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1782222197.109822:0:6558:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1782222197.109875:0:6558:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1782222197.109888:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081811328 00000100:00100000:2.0:1782222197.109893:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081811328 00000100:00100000:2.0:1782222197.109932:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782222197.109940:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877152450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3654:x1868795081811328:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782222197.109973:0:8442:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:2.0:1782222197.110008:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a3a8d71, atime: 0x6a3a8d72, ctime: 0x6a3a8d71, blocks: 0x8 00010000:00010000:2.0:1782222197.110015:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055a306da/0xe2b7cc26e6811ee2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.110028:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1782222197.110032:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782222197.110038:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055a306da/0xe2b7cc26e6811ee2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.110072:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055a306da/0xe2b7cc26e6811ee2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.110081:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055a306da/0xe2b7cc26e6811ee2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.110088:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055a306da/0xe2b7cc26e6811ee2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.110104:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782222197.110313:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0842e7fa00) 00010000:00010000:1.0:1782222197.110316:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222197.110319:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811edb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.110325:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811edb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222197.110392:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+22:12384:x1868795060770432:12345-192.168.203.27@tcp:34:lhsmtool_posix.0 Request processed in 1514us (1724us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222197.110401:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 187 00010000:00010000:0.0:1782222197.110596:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782222197.110610:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055a306da/0xe2b7cc26e6811ee2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.110620:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83800 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:0.0:1782222197.110624:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055a306da/0xe2b7cc26e6811ee2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.110632:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055a306da/0xe2b7cc26e6811ee2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.110647:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055a306da/0xe2b7cc26e6811ee2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.110654:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055a306da/0xe2b7cc26e6811ee2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.110671:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222197.110672:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222197.110674:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222197.110689:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877152450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3654:x1868795081811328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 748us (923us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1782222197.110709:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:3.0:1782222197.111542:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e6811c73 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111553:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e6811c73 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111560:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e6811c73 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111579:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746431e00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222197.111583:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e6811c73 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111590:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e6811c73 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111602:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8f087f8f1f00) 00010000:00010000:3.0:1782222197.111605:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222197.111608:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e6811c73 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111614:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e6811c73 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111630:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811c7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111635:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811c7a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111640:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811c7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111644:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746430200 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222197.111647:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811c7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111652:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811c7a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111667:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:3.0:1782222197.111669:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222197.111672:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811c7a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111678:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811c7a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111690:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811cb9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111781:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811cb9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111789:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811cb9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111794:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746430400 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222197.111796:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811cb9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111801:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811cb9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111809:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f087f8f1000) 00010000:00010000:3.0:1782222197.111811:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222197.111813:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811cb9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111817:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811cb9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111843:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8000/0xe2b7cc26e6811dbc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111849:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8000/0xe2b7cc26e6811dbc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111854:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8000/0xe2b7cc26e6811dbc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111859:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb8000 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222197.111862:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8000/0xe2b7cc26e6811dbc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111867:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8000/0xe2b7cc26e6811dbc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111874:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0842e7fa00) 00010000:00010000:3.0:1782222197.111876:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222197.111878:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8000/0xe2b7cc26e6811dbc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111882:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8000/0xe2b7cc26e6811dbc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111893:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6811ddf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111899:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6811ddf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111905:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6811ddf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111915:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83e00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222197.111919:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6811ddf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111924:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6811ddf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111943:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0842e7fa00) 00010000:00010000:3.0:1782222197.111945:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222197.111948:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6811ddf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111954:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6811ddf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111967:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811e25 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111972:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811e25 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111977:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811e25 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111981:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744c000 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222197.111983:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811e25 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.111989:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811e25 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782222197.112623:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f0847006a00/2, rc 0, transno 4294967308 00000100:00100000:1.0:1782222197.112633:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0847006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081811328:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1782222197.112716:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0842e7fa00) 00010000:00010000:3.0:1782222197.112718:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222197.112722:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811e25 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.112728:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811e25 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222197.115055:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222197.115167:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060770688 00000100:00100000:2.0:1782222197.115177:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060770688 00000100:00100000:2.0:1782222197.115269:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 188 00000100:00100000:2.0:1782222197.115280:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+17:12384:x1868795060770688:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782222197.115300:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222197.115316:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811ee9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75586c7 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.115421:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811ef0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.115434:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.115462:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782222197.115474:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1782222197.115552:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.115561:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811ef0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.115568:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.115573:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb82600 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222197.115577:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.115584:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811ef0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.115596:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0842e7fa00) 00010000:00010000:2.0:1782222197.115599:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782222197.115603:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811ef0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.115610:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811ef0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.115648:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811ee9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586c7 expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.115669:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f087f8f2900) 00010000:00010000:2.0:1782222197.115672:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782222197.115676:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811ee9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586c7 expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.115686:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb83000, rc 0) 00000100:00100000:2.0:1782222197.116380:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+18:12384:x1868795060770688:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 1097us (1328us total) trans 4294967459 rc 301/301 00000100:00100000:2.0:1782222197.116388:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 188 00000100:00100000:1.0:1782222197.122312:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222197.122434:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060770816 00000100:00100000:2.0:1782222197.122443:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060770816 00000100:00100000:2.0:1782222197.122501:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 189 00000100:00100000:2.0:1782222197.122511:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+18:12384:x1868795060770816:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1782222197.122544:0:6528:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1782222197.122644:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+18:12384:x1868795060770816:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 Request processed in 135us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222197.122651:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 189 00000100:00100000:3.0:1782222197.127746:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222197.127854:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060771072 00000100:00100000:1.0:1782222197.127864:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060771072 00000100:00100000:1.0:1782222197.127922:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 190 00000100:00100000:1.0:1782222197.127937:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+18:12384:x1868795060771072:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782222197.127971:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222197.127974:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1782222197.128007:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431c00/0xe2b7cc26e6811ea3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586b9 expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.128027:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:1.0:1782222197.128031:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782222197.128043:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811efe lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75586ce expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782222197.128628:0:6527:0:(osp_object.c:1673:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:1.0:1782222197.128783:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811f05 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.128796:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811f05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.128806:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811f05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.128859:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811efe lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586ce expref: 20 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.128875:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811f05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586ce expref: 19 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.128883:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f0842e7f200) 00010000:00010000:1.0:1782222197.128886:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782222197.128896:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744ca00, rc 0) 00000100:00100000:1.0:1782222197.129193:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+19:12384:x1868795060771072:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 1261us (1454us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1782222197.129201:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 190 00000100:00100000:0.0:1782222197.134437:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222197.134536:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060771328 00000100:00100000:2.0:1782222197.134546:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060771328 00000100:00100000:2.0:1782222197.134631:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 191 00000100:00100000:2.0:1782222197.134641:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847005c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+19:12384:x1868795060771328:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782222197.134693:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782222197.134727:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6811f05 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586ce expref: 19 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.134764:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f0842e7f200) 00010000:00010000:2.0:1782222197.134782:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782222197.134801:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811f13 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.134814:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811f13 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.134822:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811f13 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.134836:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811f1a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xd8a9a76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.134842:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811f1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd8a9a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.134847:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811f1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd8a9a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.134884:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811f13 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.134891:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811f13 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.134897:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811f13 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.134903:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb82600 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222197.134908:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811f13 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.134921:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811f13 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.135194:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:2.0:1782222197.135197:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782222197.135202:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811f13 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.135208:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811f13 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.135219:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811f1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd8a9a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.135225:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811f1a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd8a9a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.135230:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811f1a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd8a9a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.135410:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83000 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222197.135414:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811f1a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd8a9a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.135420:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811f1a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd8a9a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.135429:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xd8a9a76 (ffff8f0849b70100) 00010000:00010000:2.0:1782222197.135431:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782222197.135434:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811f1a lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xd8a9a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.135451:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811f1a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xd8a9a76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222197.135573:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847005c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+18:12384:x1868795060771328:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 Request processed in 931us (1143us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782222197.135580:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 191 00000100:00100000:2.0:1782222197.139424:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222197.139521:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060771456 00000100:00100000:1.0:1782222197.139530:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060771456 00000100:00100000:1.0:1782222197.139614:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 192 00000100:00100000:1.0:1782222197.139623:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+18:12384:x1868795060771456:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782222197.139643:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222197.139674:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811f21 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75586d5 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.139707:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811f28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.139719:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811f28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.139730:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811f28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.139843:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811f21 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586d5 expref: 20 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.139861:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811f28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586d5 expref: 19 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.139868:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f0842e7f800) 00010000:00010000:1.0:1782222197.139871:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782222197.139879:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744d600, rc 0) 00000100:00100000:1.0:1782222197.139981:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+19:12384:x1868795060771456:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 359us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222197.139987:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 192 00000100:00100000:2.0:1782222197.143711:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222197.144007:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060771712 00000100:00100000:3.0:1782222197.144018:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060771712 00000100:00100000:3.0:1782222197.144083:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 193 00000100:00100000:3.0:1782222197.144093:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747560a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+19:12384:x1868795060771712:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782222197.144183:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e6811f2f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.144201:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e6811f2f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.144211:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e6811f2f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782222197.144705:0:13817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1782222197.144715:0:13817:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 396173479977ns, next at 397173477792ns, rc = 0 00000004:00010000:3.0:1782222197.144765:0:13817:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d12544a8 reply state 00000000f7344ebc transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e6811f2f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.144790:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e6811f2f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.144815:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f0842e7f800) 00010000:00010000:3.0:1782222197.144818:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1782222197.144821:0:13817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782222197.145038:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747560a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+21:12384:x1868795060771712:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 Request processed in 945us (1333us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1782222197.145046:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 193 00000100:00100000:0.0:1782222197.148992:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222197.149365:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060771840 00000100:00100000:2.0:1782222197.149375:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060771840 00000100:00100000:2.0:1782222197.149477:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 194 00000100:00100000:2.0:1782222197.149487:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+21:12384:x1868795060771840:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782222197.149517:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222197.149537:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6811f36 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75586dc expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.149595:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6811f36 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586dc expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.149611:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6811f36 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586dc expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.149630:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f0842e7f800) 00010000:00010000:2.0:1782222197.149634:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782222197.149637:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb83e00, rc 0) 00000100:00100000:2.0:1782222197.149700:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+22:12384:x1868795060771840:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 214us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222197.149720:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 194 00000100:00100000:1.0:1782222197.152632:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222197.152718:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060771968 00000100:00100000:0.0:1782222197.152727:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060771968 00000100:00100000:0.0:1782222197.152796:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 59 00000100:00100000:0.0:1782222197.152805:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77bf2c2c-f408-43f9-ae59-449550631d05+6:2389:x1868795060771968:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1782222197.153020:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77bf2c2c-f408-43f9-ae59-449550631d05+7:2389:x1868795060771968:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 Request processed in 216us (396us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1782222197.153043:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 59 00000100:00080000:3.0:1782222197.153496:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782222197.156309:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222197.156404:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060772224 00000100:00100000:2.0:1782222197.156414:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060772224 00000100:00100000:2.0:1782222197.156469:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 49 00000100:00100000:2.0:1782222197.156479:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+22:12384:x1868795060772224:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1782222197.156694:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+23:12384:x1868795060772224:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 Request processed in 216us (392us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1782222197.156715:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 49 00000100:00100000:0.0:1782222197.171423:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222197.171499:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060772480 00000100:00100000:1.0:1782222197.171509:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060772480 00000100:00100000:1.0:1782222197.171569:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 195 00000100:00100000:1.0:1782222197.171579:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+23:12384:x1868795060772480:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1782222197.171680:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+23:12384:x1868795060772480:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 Request processed in 103us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222197.171688:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 195 00000100:00100000:1.0:1782222197.176936:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222197.177016:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060772608 00000100:00100000:3.0:1782222197.177026:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060772608 00000100:00100000:3.0:1782222197.177095:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 196 00000100:00100000:3.0:1782222197.177106:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+23:12384:x1868795060772608:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782222197.177134:0:13817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222197.177153:0:13817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811f3d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75586e3 expref: -99 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.177263:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811f44 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.177277:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811f44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.177287:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811f44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782222197.177330:0:13817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782222197.177349:0:13817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811f44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.177376:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811f3d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586e3 expref: 25 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.177401:0:13817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811f44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586e3 expref: 24 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.177409:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f0842e7f800) 00010000:00010000:3.0:1782222197.177412:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1782222197.177416:0:13817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746430200, rc 0) 00000100:00100000:3.0:1782222197.177469:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+24:12384:x1868795060772608:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 365us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222197.177476:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 196 00000100:00100000:2.0:1782222197.183701:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222197.183791:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060772736 00000100:00100000:0.0:1782222197.183801:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060772736 00000100:00100000:0.0:1782222197.183857:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 60 00000100:00100000:0.0:1782222197.183867:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747561180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77bf2c2c-f408-43f9-ae59-449550631d05+7:2390:x1868795060772736:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782222197.183885:0:8443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222197.183903:0:8443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c308adb0/0xe2b7cc26e6811f4b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75586ea expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782222197.184033:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3a8d74, blocks: 0x0 00010000:00010000:0.0:1782222197.184068:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=396s v=(0 0) 00010000:00010000:0.0:1782222197.184074:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782222197.184083:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c308adb0/0xe2b7cc26e6811f4b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586ea expref: 8 pid: 8443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.184101:0:8443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c308adb0/0xe2b7cc26e6811f4b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586ea expref: 8 pid: 8443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.184113:0:8443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fcb9400, rc 0) 00000100:00100000:0.0:1782222197.185099:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747561180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77bf2c2c-f408-43f9-ae59-449550631d05+8:2390:x1868795060772736:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 1229us (1404us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222197.185109:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 60 00000100:00100000:3.0:1782222197.194703:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222197.195209:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060772992 00000100:00100000:2.0:1782222197.195219:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060772992 00000100:00100000:2.0:1782222197.195312:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 197 00000100:00100000:2.0:1782222197.195323:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+24:12384:x1868795060772992:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1782222197.195426:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+24:12384:x1868795060772992:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 Request processed in 105us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222197.195434:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 197 00000100:00100000:2.0:1782222197.203199:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222197.203505:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060773120 00000100:00100000:1.0:1782222197.203515:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060773120 00000100:00100000:1.0:1782222197.203576:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 61 00000100:00100000:1.0:1782222197.203592:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+8:12384:x1868795060773120:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782222197.203612:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222197.203630:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000016c8bb/0xe2b7cc26e6811f52 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75586f1 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.203664:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c308adb0/0xe2b7cc26e6811f4b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586ea expref: 9 pid: 8443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.203673:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222197.203677:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222197.203691:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000016c8bb/0xe2b7cc26e6811f52 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586f1 expref: 9 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.203732:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c308adb0/0xe2b7cc26e6811f4b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586ea expref: 9 pid: 8443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.203747:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c308adb0/0xe2b7cc26e6811f4b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586ea expref: 9 pid: 8443 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222197.203762:0:8442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747503b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8442:1868795081811456:192.168.203.27@tcp:104: 00000100:00100000:1.0:1782222197.203857:0:8442:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0844c0c240 going to sleep for 11 seconds 00000100:00100000:2.0:1782222197.214296:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222197.214328:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060773248 00000100:00100000:2.0:1782222197.214336:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060773248 00010000:00010000:2.0:1782222197.214375:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c308adb0/0xe2b7cc26e6811f4b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586ea expref: 10 pid: 8443 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222197.214412:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 86 00000100:00100000:2.0:1782222197.214421:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77bf2c2c-f408-43f9-ae59-449550631d05+10:2389:x1868795060773248:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782222197.214446:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782222197.214466:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c308adb0/0xe2b7cc26e6811f4b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586ea expref: 10 pid: 8443 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.214481:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c308adb0/0xe2b7cc26e6811f4b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586ea expref: 10 pid: 8443 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.214506:0:6512:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782222197.214510:0:6512:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782222197.214518:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000016c8bb/0xe2b7cc26e6811f52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586f1 expref: 10 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.214529:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000016c8bb/0xe2b7cc26e6811f52 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586f1 expref: 10 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.214566:0:6512:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000016c8bb/0xe2b7cc26e6811f52 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586f1 expref: 10 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222197.214580:0:6512:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08485a0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6512:1868795081811584:192.168.203.27@tcp:105: 00000100:00100000:2.0:1782222197.214648:0:6512:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b63ec00 going to sleep for 11 seconds 00010000:00010000:1.0:1782222197.216480:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c308adb0/0xe2b7cc26e6811f4b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586ea expref: 10 pid: 8443 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222197.216501:0:8442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747503b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8442:1868795081811456:192.168.203.27@tcp:104: 00010000:00010000:1.0:1782222197.216528:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000016c8bb/0xe2b7cc26e6811f52 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586f1 expref: 9 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.216541:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744dc00, rc 0) 00000100:00100000:1.0:1782222197.216609:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+9:12384:x1868795060773120:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 13019us (13418us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222197.216617:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 61 00000100:00100000:2.0:1782222197.226738:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222197.226804:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060773376 00000100:00100000:1.0:1782222197.226814:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060773376 00002000:00100000:1.0:1782222197.226857:0:8446:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8f08412ac700 x1868795060773376/t0(0) o4->77bf2c2c-f408-43f9-ae59-449550631d05@192.168.203.27@tcp:163/0 lens 504/0 e 0 to 0 dl 1782222208 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782222197.226885:0:8446:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f08412ac700 with x1868795060773376 ext(0->8) 00002000:00010000:1.0:1782222197.226891:0:8446:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f08412ac700 00000100:00100000:1.0:1782222197.226929:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 4 00000100:00100000:1.0:1782222197.226938:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77bf2c2c-f408-43f9-ae59-449550631d05+9:2390:x1868795060773376:12345-192.168.203.27@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1782222197.227716:0:6512:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08485a0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6512:1868795081811584:192.168.203.27@tcp:105: 00010000:00010000:3.0:1782222197.227737:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782222197.227798:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77bf2c2c-f408-43f9-ae59-449550631d05+11:2389:x1868795060773248:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 13378us (13512us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222197.227806:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 86 00000100:00100000:3.0:1782222197.228305:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77bf2c2c-f408-43f9-ae59-449550631d05+10:2390:x1868795060773376:12345-192.168.203.27@tcp:4:lhsmtool_posix.0 Request processed in 1367us (1575us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1782222197.228314:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 4 00002000:00100000:3.0:1782222197.228322:0:8446:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8f08412ac700 x1868795060773376/t4294967315(0) o4->77bf2c2c-f408-43f9-ae59-449550631d05@192.168.203.27@tcp:163/0 lens 504/448 e 0 to 0 dl 1782222208 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782222197.228331:0:8446:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f08412ac700 with x1868795060773376 ext(0->8) 00002000:00010000:3.0:1782222197.228336:0:8446:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f08412ac700 00000100:00100000:2.0:1782222197.233864:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222197.233938:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060773504 00000100:00100000:0.0:1782222197.233959:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060773504 00000100:00100000:0.0:1782222197.234018:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 198 00000100:00100000:0.0:1782222197.234029:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+24:12384:x1868795060773504:12345-192.168.203.27@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1782222197.235763:0:6505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:0.0:1782222197.235788:0:6505:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:0.0:1782222197.235805:0:6505:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1782222197.235936:0:6558:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1782222197.235947:0:6558:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1782222197.235954:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+20:12384:x1868795060773504:12345-192.168.203.27@tcp:44:lhsmtool_posix.0 Request processed in 1924us (2095us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222197.235964:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 198 00000100:00100000:3.0:1782222197.236476:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782222197.236492:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081811712:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1782222197.236550:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222197.236606:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081811712 00000100:00100000:1.0:1782222197.236613:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081811712 00000100:00100000:1.0:1782222197.236656:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782222197.236665:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081811712:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1782222197.236679:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1782222197.236784:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1782222197.236788:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1782222196 00002000:00010000:1.0:1782222197.236790:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1782222197.236792:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1782222196 -> 1782222196 00002000:00010000:1.0:1782222197.236794:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1782222197.236833:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3656:x1868795081811712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 170us (283us total) trans 4294967316 rc 0/0 00010000:00010000:2.0:1782222197.236839:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e6811f2f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222197.236840:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00010000:2.0:1782222197.236848:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e6811f2f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.236863:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e6811f2f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.236869:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746431600 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222197.236874:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e6811f2f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.236882:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e6811f2f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.236898:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f0842e7f800) 00010000:00010000:2.0:1782222197.236901:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782222197.236906:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e6811f2f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.236913:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431600/0xe2b7cc26e6811f2f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782222197.237020:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f0747e71180/2, rc 0, transno 4294967316 00000100:00100000:3.0:1782222197.237025:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081811712:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1782222197.239557:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222197.239716:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060773632 00000100:00100000:3.0:1782222197.239726:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060773632 00000100:00100000:3.0:1782222197.239791:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 63 00000100:00100000:3.0:1782222197.239800:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77bf2c2c-f408-43f9-ae59-449550631d05+10:2390:x1868795060773632:12345-192.168.203.27@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1782222197.247514:0:8436:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:1.0:1782222197.247527:0:8436:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:3.0:1782222197.247705:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77bf2c2c-f408-43f9-ae59-449550631d05+7:2390:x1868795060773632:12345-192.168.203.27@tcp:16:lhsmtool_posix.0 Request processed in 7900us (8152us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222197.247717:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 63 00000100:00100000:1.0:1782222197.251667:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222197.251749:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060773888 00000100:00100000:3.0:1782222197.251758:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060773888 00000100:00100000:3.0:1782222197.251822:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 199 00000100:00100000:3.0:1782222197.251833:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+19:12384:x1868795060773888:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782222197.251906:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222197.251933:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430200/0xe2b7cc26e6811f44 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586e3 expref: 19 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.251950:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f0842e7f800) 00010000:00010000:3.0:1782222197.251955:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782222197.251982:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e6811f59 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.251997:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e6811f59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.252022:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e6811f59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782222197.252485:0:6527:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000988020b7 reply state 000000004a33240b transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e6811f59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.252499:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e6811f59 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.252506:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f0842e7f800) 00010000:00010000:3.0:1782222197.252509:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782222197.252512:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782222197.252597:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+20:12384:x1868795060773888:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 Request processed in 765us (936us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1782222197.252605:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 199 00000100:00100000:0.0:1782222197.260889:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222197.261011:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060774016 00000100:00100000:1.0:1782222197.261022:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060774016 00000100:00100000:1.0:1782222197.261080:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 64 00000100:00100000:1.0:1782222197.261091:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+7:2390:x1868795060774016:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1782222197.261289:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1782222197.261294:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1782222196 -> 1782222195 00002000:00010000:1.0:1782222197.261296:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1782222194 00002000:00010000:1.0:1782222197.261299:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1782222196 -> 1782222195 00002000:00010000:1.0:1782222197.261301:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1782222197.261355:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+8:2390:x1868795060774016:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 Request processed in 265us (474us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1782222197.261362:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 64 00000100:00100000:1.0:1782222197.264711:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222197.265644:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060774272 00000100:00100000:3.0:1782222197.265653:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060774272 00000100:00100000:3.0:1782222197.265737:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 200 00000100:00100000:3.0:1782222197.265746:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+20:12384:x1868795060774272:12345-192.168.203.27@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1782222197.265816:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811f60 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.265832:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811f28 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586d5 expref: 20 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.265842:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811f60 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.265871:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811f28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586d5 expref: 20 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.265890:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811f28 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586d5 expref: 20 pid: 8465 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222197.265904:0:8465:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08485a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8465:1868795081811840:192.168.203.27@tcp:104: 00000100:00100000:3.0:1782222197.265974:0:8465:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f084921a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782222197.277841:0:8465:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08485a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8465:1868795081811840:192.168.203.27@tcp:104: 00010000:00010000:3.0:1782222197.277870:0:8465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811f60 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222197.278200:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222197.278523:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060774400 00000100:00100000:3.0:1782222197.278530:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060774400 00010000:00010000:3.0:1782222197.278561:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811f28 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586d5 expref: 21 pid: 8465 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222197.278646:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 87 00000100:00100000:3.0:1782222197.278654:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08429ab450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+21:2389:x1868795060774400:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782222197.278667:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222197.278674:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811f28 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586d5 expref: 21 pid: 8465 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.278685:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811f28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586d5 expref: 21 pid: 8465 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.278705:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6811f28 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586d5 expref: 21 pid: 8465 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.278728:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f0842e7f800) 00010000:00010000:3.0:1782222197.278732:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811f60 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.278741:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811f60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.278747:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811f60 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.278781:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782222197.278839:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08429ab450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+20:2389:x1868795060774400:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 185us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222197.278846:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 87 00010000:00010000:0.0:1782222197.279845:0:8465:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811f60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.279857:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811f60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.279898:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811f60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.279906:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811f60 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.279912:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811f60 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.279918:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746430400 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222197.279922:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811f60 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.279929:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811f60 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.279953:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f0842e7f800) 00010000:00010000:0.0:1782222197.279956:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1782222197.279961:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811f60 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.279967:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430400/0xe2b7cc26e6811f60 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222197.280028:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+19:12384:x1868795060774272:12345-192.168.203.27@tcp:55:lhsmtool_posix.0 Request processed in 14281us (15322us total) trans 0 rc -22/-22 00000100:00100000:0.0:1782222197.280037:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 200 00000100:00100000:1.0:1782222197.284675:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222197.284756:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060774528 00000100:00100000:3.0:1782222197.284765:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060774528 00000100:00100000:3.0:1782222197.284825:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 65 00000100:00100000:3.0:1782222197.284835:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77bf2c2c-f408-43f9-ae59-449550631d05+8:2390:x1868795060774528:12345-192.168.203.27@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1782222197.284881:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aac29f12/0xe2b7cc26e6811f67 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.284902:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000016c8bb/0xe2b7cc26e6811f52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586f1 expref: 8 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.284910:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782222197.284915:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782222197.284920:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aac29f12/0xe2b7cc26e6811f67 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.284964:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000016c8bb/0xe2b7cc26e6811f52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586f1 expref: 8 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.284979:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000016c8bb/0xe2b7cc26e6811f52 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586f1 expref: 8 pid: 8442 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222197.284994:0:8440:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08485a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8440:1868795081811968:192.168.203.27@tcp:104: 00000100:00100000:3.0:1782222197.285830:0:8440:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f084921a300 going to sleep for 11 seconds 00010000:00010000:0.0:1782222197.291032:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222197.293632:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222197.293663:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060774656 00000100:00100000:3.0:1782222197.293671:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060774656 00010000:00010000:3.0:1782222197.293705:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000016c8bb/0xe2b7cc26e6811f52 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586f1 expref: 9 pid: 8442 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222197.293740:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 88 00000100:00100000:3.0:1782222197.293749:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77bf2c2c-f408-43f9-ae59-449550631d05+9:2389:x1868795060774656:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782222197.293765:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222197.293797:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000016c8bb/0xe2b7cc26e6811f52 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586f1 expref: 9 pid: 8442 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.293811:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000016c8bb/0xe2b7cc26e6811f52 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586f1 expref: 9 pid: 8442 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.293835:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782222197.293846:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782222197.293852:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aac29f12/0xe2b7cc26e6811f67 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.293861:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aac29f12/0xe2b7cc26e6811f67 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.293881:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782222197.293924:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77bf2c2c-f408-43f9-ae59-449550631d05+9:2389:x1868795060774656:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 176us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222197.293932:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 88 00010000:00010000:1.0:1782222197.294015:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000016c8bb/0xe2b7cc26e6811f52 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586f1 expref: 8 pid: 8442 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222197.294029:0:8440:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08485a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8440:1868795081811968:192.168.203.27@tcp:104: 00010000:00010000:1.0:1782222197.294058:0:8440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000aac29f12/0xe2b7cc26e6811f67 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.294069:0:8440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000aac29f12/0xe2b7cc26e6811f67 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.294076:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aac29f12/0xe2b7cc26e6811f67 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.294096:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aac29f12/0xe2b7cc26e6811f67 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.294109:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aac29f12/0xe2b7cc26e6811f67 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.294131:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aac29f12/0xe2b7cc26e6811f67 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.294139:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746430200 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:1.0:1782222197.294144:0:8440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aac29f12/0xe2b7cc26e6811f67 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.294153:0:8440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aac29f12/0xe2b7cc26e6811f67 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.294165:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aac29f12/0xe2b7cc26e6811f67 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.294173:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aac29f12/0xe2b7cc26e6811f67 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222197.294216:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77bf2c2c-f408-43f9-ae59-449550631d05+7:2390:x1868795060774528:12345-192.168.203.27@tcp:1:lhsmtool_posix.0 Request processed in 9382us (9551us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222197.294225:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 65 00000100:00100000:1.0:1782222197.297294:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222197.297561:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060774912 00000100:00100000:0.0:1782222197.297571:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060774912 00000100:00100000:0.0:1782222197.297632:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 201 00000100:00100000:0.0:1782222197.297642:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+19:12384:x1868795060774912:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1782222197.297718:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8600/0xe2b7cc26e6811f6e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.297736:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811db5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755867a expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.297746:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8600/0xe2b7cc26e6811f6e lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.297789:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811db5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755867a expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.297816:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811db5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755867a expref: 19 pid: 6526 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222197.297830:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cfc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6528:1868795081812096:192.168.203.27@tcp:104: 00000100:00100000:0.0:1782222197.297951:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0841254780 going to sleep for 11 seconds 00000100:00100000:0.0:1782222197.308223:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cfc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6528:1868795081812096:192.168.203.27@tcp:104: 00010000:00010000:0.0:1782222197.308265:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8600/0xe2b7cc26e6811f6e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222197.308324:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222197.308384:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060775040 00000100:00100000:0.0:1782222197.308390:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060775040 00010000:00010000:0.0:1782222197.308419:0:9532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811db5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755867a expref: 20 pid: 6526 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222197.308452:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 89 00000100:00100000:0.0:1782222197.308460:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77bf2c2c-f408-43f9-ae59-449550631d05+20:2390:x1868795060775040:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782222197.308474:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222197.308481:0:9532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811db5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755867a expref: 20 pid: 6526 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.308493:0:9532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811db5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755867a expref: 20 pid: 6526 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.308514:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6811db5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755867a expref: 20 pid: 6526 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.308542:0:9532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0842e7fa00) 00010000:00010000:0.0:1782222197.308547:0:9532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8600/0xe2b7cc26e6811f6e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.308557:0:9532:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8600/0xe2b7cc26e6811f6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.308564:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8600/0xe2b7cc26e6811f6e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.308582:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782222197.308619:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77bf2c2c-f408-43f9-ae59-449550631d05+19:2390:x1868795060775040:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 160us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222197.308627:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 89 00010000:00010000:0.0:1782222197.308646:0:6528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8600/0xe2b7cc26e6811f6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.308653:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8600/0xe2b7cc26e6811f6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.308804:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811f75 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.308815:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6811f36 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586dc expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.308823:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811f75 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.308847:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6811f36 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586dc expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.308865:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6811f36 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586dc expref: 19 pid: 6526 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222197.308878:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cfc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6528:1868795081812224:192.168.203.27@tcp:104: 00000100:00100000:0.0:1782222197.308920:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0841254180 going to sleep for 11 seconds 00000100:00100000:1.0:1782222197.316398:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222197.316458:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cfc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6528:1868795081812224:192.168.203.27@tcp:104: 00010000:00010000:1.0:1782222197.316482:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811f75 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222197.317456:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060775168 00000100:00100000:3.0:1782222197.317467:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060775168 00010000:00010000:3.0:1782222197.317504:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6811f36 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586dc expref: 20 pid: 6526 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222197.317583:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 90 00000100:00100000:3.0:1782222197.317592:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0847002a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77bf2c2c-f408-43f9-ae59-449550631d05+20:2389:x1868795060775168:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782222197.317606:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222197.317612:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6811f36 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586dc expref: 20 pid: 6526 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.317624:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6811f36 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586dc expref: 20 pid: 6526 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.317644:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6811f36 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586dc expref: 20 pid: 6526 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.317673:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f0842e7f800) 00010000:00010000:3.0:1782222197.317679:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811f75 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.317688:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811f75 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.317696:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811f75 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.317724:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782222197.317785:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0847002a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77bf2c2c-f408-43f9-ae59-449550631d05+19:2389:x1868795060775168:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 183us (1383us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222197.317793:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 90 00010000:00010000:1.0:1782222197.317856:0:6528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811f75 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.317864:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811f75 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782222197.317965:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:1.0:1782222197.318076:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:1.0:1782222197.318111:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:1.0:1782222197.319571:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747780a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6528:1868795081812352:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1782222197.319642:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222197.319676:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0858d5b240 going to sleep for 11 seconds 00000100:00100000:2.0:1782222197.319752:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081812352 00000100:00100000:2.0:1782222197.319760:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081812352 00000100:00100000:2.0:1782222197.319817:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1782222197.319826:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f084a282050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6528:x1868795081812352:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1782222197.319910:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f084a282050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6528:x1868795081812352:12345-0@lo:1000:mdt00_002.0 Request processed in 85us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222197.319917:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1782222197.320214:0:6528:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:2.0:1782222197.320220:0:6528:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f0747e71180, transno 4294967316 00000100:00100000:2.0:1782222197.320281:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747780a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6528:1868795081812352:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1782222197.320422:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:2.0:1782222197.320471:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6528:1868795081812480:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1782222197.320505:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222197.320523:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0844c0cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1782222197.320596:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081812480 00000100:00100000:2.0:1782222197.320601:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081812480 00000100:00100000:2.0:1782222197.320626:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1782222197.320633:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6528:x1868795081812480:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1782222197.320728:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6528:x1868795081812480:12345-0@lo:1000:mdt00_002.0 Request processed in 94us (221us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1782222197.320736:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1782222197.320768:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6528:1868795081812480:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1782222197.320814:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811f75 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.320825:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811f75 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.320833:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811f75 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.320840:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb9a00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222197.320845:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811f75 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.320853:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811f75 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.320869:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f0842e7f800) 00010000:00010000:2.0:1782222197.320879:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782222197.320885:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811f75 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.320891:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6811f75 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.320917:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e6811eaa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.320924:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e6811eaa lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.320929:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e6811eaa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.320935:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746430800 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222197.320938:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e6811eaa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.320944:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e6811eaa lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.320952:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0842e7fa00) 00010000:00010000:2.0:1782222197.320954:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782222197.320957:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e6811eaa lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.320963:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430800/0xe2b7cc26e6811eaa lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.320985:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811f7c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.321009:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811ec6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586c0 expref: 22 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.321018:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811f7c lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.321040:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811ec6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586c0 expref: 22 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.321054:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811ec6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586c0 expref: 22 pid: 6527 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222197.321065:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07475a8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6528:1868795081812608:192.168.203.27@tcp:104: 00000100:00100000:2.0:1782222197.321115:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746166c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782222197.328650:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222197.329262:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07475a8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6528:1868795081812608:192.168.203.27@tcp:104: 00010000:00010000:2.0:1782222197.329286:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811f7c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222197.330583:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060775296 00000100:00100000:0.0:1782222197.330595:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060775296 00010000:00010000:0.0:1782222197.330632:0:9532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811ec6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586c0 expref: 23 pid: 6527 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222197.330675:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 91 00000100:00100000:0.0:1782222197.330684:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747783800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77bf2c2c-f408-43f9-ae59-449550631d05+23:2390:x1868795060775296:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782222197.330697:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222197.330704:0:9532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811ec6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586c0 expref: 23 pid: 6527 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.330717:0:9532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811ec6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586c0 expref: 23 pid: 6527 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.330737:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431200/0xe2b7cc26e6811ec6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586c0 expref: 23 pid: 6527 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.330750:0:9532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0842e7fa00) 00010000:00010000:0.0:1782222197.330755:0:9532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811f7c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.330786:0:9532:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811f7c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.330795:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811f7c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.330824:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782222197.330878:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747783800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77bf2c2c-f408-43f9-ae59-449550631d05+22:2390:x1868795060775296:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 194us (2234us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222197.330886:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 91 00010000:00010000:2.0:1782222197.332462:0:6528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811f7c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.332478:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811f7c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.332493:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811f7c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.332500:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811f7c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.332513:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811f7c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.332520:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb82600 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222197.332524:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811f7c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.332532:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811f7c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.332546:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0842e7fa00) 00010000:00010000:2.0:1782222197.332549:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782222197.332553:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811f7c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.332560:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6811f7c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.332573:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8600/0xe2b7cc26e6811f6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.332579:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8600/0xe2b7cc26e6811f6e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.332585:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8600/0xe2b7cc26e6811f6e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.332590:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb8600 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222197.332593:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8600/0xe2b7cc26e6811f6e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.332609:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8600/0xe2b7cc26e6811f6e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.332617:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0842e7fa00) 00010000:00010000:2.0:1782222197.332619:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782222197.332622:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8600/0xe2b7cc26e6811f6e lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.332628:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8600/0xe2b7cc26e6811f6e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222197.332812:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+21:12384:x1868795060774912:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 Request processed in 35165us (35519us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1782222197.332823:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 201 00000020:00080000:2.0:1782222197.332827:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1782222197.333036:0:13806:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782222197.333041:0:13806:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782222197.333549:0:13806:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1782222197.333558:0:13806:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782222197.347207:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222197.347326:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060775552 00000100:00100000:3.0:1782222197.347337:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060775552 00000100:00100000:3.0:1782222197.347395:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 50 00000100:00100000:3.0:1782222197.347405:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087d4b9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+21:12384:x1868795060775552:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1782222197.347648:0:6530:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1782222197.347676:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:3.0:1782222197.347706:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811f83 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.347722:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811f83 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.347744:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811f83 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.347754:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811f83 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.347761:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811f83 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.347769:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811f83 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.347797:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782222197.348083:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087d4b9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+23:12384:x1868795060775552:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 Request processed in 677us (883us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1782222197.348092:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 50 00000020:00080000:3.0:1782222197.348098:0:6530:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782222197.348161:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782222197.348167:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811f83 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.348176:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746431a00 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:3.0:1782222197.348180:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811f83 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.348189:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811f83 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.348202:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f0842e7f800) 00010000:00010000:3.0:1782222197.348205:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782222197.348217:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811f83 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.348223:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811f83 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.348259:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222197.348260:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222197.348262:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782222197.667551:0:14719:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782222197.667560:0:14719:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782222197.667585:0:14719:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1782222197.667595:0:14719:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782222197.743150:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07475a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081812736:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782222197.743217:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222197.743285:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081812736 00000100:00100000:2.0:1782222197.743291:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081812736 00000100:00100000:2.0:1782222197.743334:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1782222197.743343:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081812736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782222197.743376:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1782222197.743421:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081812736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222197.743429:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1782222197.743473:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07475a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081812736:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782222197.743603:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782222197.743612:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08485a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081812864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782222197.743641:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222197.743670:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081812864 00000100:00100000:3.0:1782222197.743675:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081812864 00000100:00100000:3.0:1782222197.743704:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1782222197.743710:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081812864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782222197.743729:0:7480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1782222197.743763:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081812864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222197.743779:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1782222197.743807:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08485a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081812864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782222197.812995:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222197.813083:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060775808 00000100:00100000:1.0:1782222197.813094:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060775808 00000100:00100000:1.0:1782222197.813157:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 202 00000100:00100000:1.0:1782222197.813166:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+23:12395:x1868795060775808:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:1.0:1782222197.813191:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222197.813210:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811f8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75586f8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.813348:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811f91 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.813363:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811f91 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.813391:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811f91 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782222197.813404:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1782222197.813503:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6811f8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586f8 expref: 26 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.813522:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811f91 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586f8 expref: 25 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.813530:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:1.0:1782222197.813533:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782222197.813536:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744da00, rc 0) 00000100:00100000:1.0:1782222197.813590:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+25:12395:x1868795060775808:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 426us (605us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1782222197.813597:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 202 00000100:00100000:3.0:1782222197.817416:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222197.817454:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060775936 00000100:00100000:3.0:1782222197.817464:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060775936 00000100:00100000:3.0:1782222197.817513:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 203 00000100:00100000:3.0:1782222197.817522:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+25:12395:x1868795060775936:12345-192.168.203.27@tcp:34:lfs.0 00010000:00010000:3.0:1782222197.817593:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811f9f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.817617:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811f9f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.817629:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811f9f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.817644:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811fa6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.817652:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.817659:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.817741:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811fad lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.817749:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811fad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.817756:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811fad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782222197.817811:0:8465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811fad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.817824:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811f9f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.817831:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811f9f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.817848:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811f9f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.817857:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746431a00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222197.817861:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811f9f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.817868:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811f9f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.817881:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:3.0:1782222197.817883:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222197.817887:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811f9f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.817893:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e6811f9f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.817904:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.817909:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811fa6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.817914:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811fa6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.817918:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746430000 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222197.817921:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811fa6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.817936:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811fa6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.817945:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f087f8f1000) 00010000:00010000:3.0:1782222197.817947:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222197.817950:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811fa6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.817956:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6811fa6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.818444:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811fad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.818454:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811fad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.818459:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811fad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.818463:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746430e00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222197.818466:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811fad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.818472:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811fad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.818481:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f087f8f1f00) 00010000:00010000:3.0:1782222197.818483:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222197.818486:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811fad lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.818502:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811fad lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222197.818644:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+25:12395:x1868795060775936:12345-192.168.203.27@tcp:34:lfs.0 Request processed in 1121us (1233us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222197.818652:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 203 00000100:00100000:1.0:1782222197.873191:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222197.873313:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060776192 00000100:00100000:2.0:1782222197.873323:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060776192 00000100:00100000:2.0:1782222197.873380:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 204 00000100:00100000:2.0:1782222197.873390:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+25:12398:x1868795060776192:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1782222197.873410:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222197.873429:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811fb4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75586ff expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.873500:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811fbb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.873514:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811fbb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.873524:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811fbb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.873537:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e6811fc2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.873543:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e6811fc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.873549:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e6811fc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.873649:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811fc9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.873657:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.873829:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782222197.873840:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1782222197.873915:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811fbb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.873990:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811fbb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.874066:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811fbb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.874073:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83200 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222197.874078:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811fbb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.874085:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811fbb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.874098:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:2.0:1782222197.874101:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782222197.874106:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811fbb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.874112:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6811fbb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.874126:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e6811fc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.874133:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e6811fc2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.874146:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e6811fc2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.874150:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83800 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222197.874153:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e6811fc2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.874159:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e6811fc2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.874166:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f0849b72b00) 00010000:00010000:2.0:1782222197.874168:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782222197.874171:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e6811fc2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.874176:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e6811fc2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.874219:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e6811fb4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586ff expref: 28 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.874231:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811fc9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586ff expref: 27 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222197.874465:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0849b72200) 00010000:00010000:2.0:1782222197.874467:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782222197.874470:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb83000, rc 0) 00000100:00100000:0.0:1782222197.876390:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+27:12398:x1868795060776192:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 2991us (3198us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1782222197.876404:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 204 00000100:00100000:3.0:1782222197.879682:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222197.879790:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060776320 00000100:00100000:1.0:1782222197.879799:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060776320 00000100:00100000:1.0:1782222197.879856:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 205 00000100:00100000:1.0:1782222197.879865:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+27:12398:x1868795060776320:12345-192.168.203.27@tcp:54:lfs.0 00010000:00010000:1.0:1782222197.879940:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811fd7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.879955:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.879967:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.880120:0:13817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.880128:0:13817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811fd7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.880135:0:13817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811fd7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.880141:0:13817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744c200 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222197.880145:0:13817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811fd7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.880153:0:13817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811fd7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.880165:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0849b72200) 00010000:00010000:1.0:1782222197.880168:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782222197.880173:0:13817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811fd7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.880178:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6811fd7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222197.880470:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+27:12398:x1868795060776320:12345-192.168.203.27@tcp:54:lfs.0 Request processed in 604us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222197.880479:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 205 00000100:00100000:1.0:1782222197.889576:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222197.889710:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060776576 00000100:00100000:0.0:1782222197.889720:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060776576 00000100:00100000:0.0:1782222197.889787:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 51 00000100:00100000:0.0:1782222197.889797:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+27:12398:x1868795060776576:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:0.0:1782222197.890038:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+28:12398:x1868795060776576:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 241us (469us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1782222197.890045:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 51 00000100:00100000:2.0:1782222197.926828:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222197.926926:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060776832 00000100:00100000:3.0:1782222197.926938:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060776832 00000100:00100000:3.0:1782222197.927008:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 206 00000100:00100000:3.0:1782222197.927018:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+28:11930:x1868795060776832:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:3.0:1782222197.927041:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222197.927059:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e6811fde lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558706 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.927166:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811fe5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.927182:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811fc9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586ff expref: 29 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.927191:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811fe5 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.927224:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811fc9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586ff expref: 29 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222197.927526:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811fc9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586ff expref: 29 pid: 6528 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222197.927555:0:6526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08504c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6526:1868795081812992:192.168.203.27@tcp:104: 00000100:00100000:3.0:1782222197.927640:0:6526:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08485ec480 going to sleep for 11 seconds 00000100:00100000:3.0:1782222197.929501:0:6526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08504c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6526:1868795081812992:192.168.203.27@tcp:104: 00010000:00010000:3.0:1782222197.929531:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811fe5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222197.930062:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222197.930147:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060776960 00000100:00100000:0.0:1782222197.930155:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060776960 00010000:00010000:0.0:1782222197.930189:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811fc9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586ff expref: 30 pid: 6528 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222197.930230:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 92 00000100:00100000:0.0:1782222197.930279:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77bf2c2c-f408-43f9-ae59-449550631d05+30:2389:x1868795060776960:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782222197.930296:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222197.930304:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811fc9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586ff expref: 30 pid: 6528 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.930316:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811fc9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586ff expref: 30 pid: 6528 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.930337:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e6811fc9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586ff expref: 30 pid: 6528 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.930353:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0849b72200) 00010000:00010000:0.0:1782222197.930358:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811fe5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.930367:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811fe5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.930374:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811fe5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.930397:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782222197.930443:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77bf2c2c-f408-43f9-ae59-449550631d05+29:2389:x1868795060776960:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 173us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222197.930451:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 92 00010000:00010000:1.0:1782222197.930571:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811fe5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.930590:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811fe5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782222197.930607:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1782222197.930726:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430c00/0xe2b7cc26e6811fde lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558706 expref: 30 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.930740:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811fe5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558706 expref: 29 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.930747:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0849b72200) 00010000:00010000:1.0:1782222197.930750:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782222197.930752:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746430e00, rc 0) 00000100:00100000:1.0:1782222197.930788:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+29:11930:x1868795060776832:12345-192.168.203.27@tcp:101:bash.0 Request processed in 3772us (3970us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1782222197.930795:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 206 00000100:00100000:1.0:1782222197.937399:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222197.937562:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060777088 00000100:00100000:0.0:1782222197.937586:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060777088 00000100:00100000:0.0:1782222197.937650:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 207 00000100:00100000:0.0:1782222197.937660:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+29:11930:x1868795060777088:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:0.0:1782222197.937682:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222197.937701:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811ff3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755870d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.937732:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e6811ffa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.937746:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e6811ffa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.937756:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e6811ffa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.937871:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6811ff3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755870d expref: 31 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.937889:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e6811ffa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755870d expref: 30 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.937897:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0849b72200) 00010000:00010000:0.0:1782222197.937900:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782222197.937903:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fcb8c00, rc 0) 00000100:00100000:0.0:1782222197.937972:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+30:11930:x1868795060777088:12345-192.168.203.27@tcp:101:bash.0 Request processed in 314us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222197.937979:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 207 00000100:00100000:2.0:1782222197.941374:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222197.941472:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060777344 00000100:00100000:0.0:1782222197.941492:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060777344 00000100:00100000:0.0:1782222197.941540:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 208 00000100:00100000:0.0:1782222197.941550:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+30:11930:x1868795060777344:12345-192.168.203.27@tcp:36:bash.0 00010000:00010000:0.0:1782222197.941749:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8800/0xe2b7cc26e6812001 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.941765:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8800/0xe2b7cc26e6812001 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.941789:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8800/0xe2b7cc26e6812001 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782222197.941828:0:13817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:0.0:1782222197.941848:0:13817:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000036d97641 reply state 000000000dac7dec transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8800/0xe2b7cc26e6812001 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.941860:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8800/0xe2b7cc26e6812001 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.941867:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0849b72200) 00010000:00010000:0.0:1782222197.941870:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782222197.941872:0:13817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1782222197.941905:0:13817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:0.0:1782222197.942005:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+34:11930:x1868795060777344:12345-192.168.203.27@tcp:36:bash.0 Request processed in 456us (639us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1782222197.942013:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 208 00000020:00080000:0.0:1782222197.942018:0:13817:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1782222197.947543:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222197.947639:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060777472 00000100:00100000:1.0:1782222197.947650:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060777472 00000100:00100000:1.0:1782222197.947710:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 209 00000100:00100000:1.0:1782222197.947719:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+34:11930:x1868795060777472:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:1.0:1782222197.947745:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222197.947764:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e6812008 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558714 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.947837:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e6812008 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558714 expref: 35 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.947870:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e6812008 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558714 expref: 35 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222197.947889:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0849b72200) 00010000:00010000:1.0:1782222197.947892:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782222197.947896:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744c800, rc 0) 00000100:00100000:1.0:1782222197.947958:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+35:11930:x1868795060777472:12345-192.168.203.27@tcp:101:bash.0 Request processed in 240us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222197.947965:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 209 00000100:00100000:3.0:1782222197.952526:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222197.952604:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060777600 00000100:00100000:0.0:1782222197.952614:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060777600 00000100:00100000:0.0:1782222197.952673:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 66 00000100:00100000:0.0:1782222197.952684:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77bf2c2c-f408-43f9-ae59-449550631d05+7:11930:x1868795060777600:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:0.0:1782222197.952715:0:8443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222197.952737:0:8443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb9f395d/0xe2b7cc26e681200f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755871b expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782222197.952765:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a3a8d73, atime: 0x6a3a8d72, ctime: 0x6a3a8d73, blocks: 0x8 00010000:00010000:0.0:1782222197.952804:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=396s v=(0 0) 00010000:00010000:0.0:1782222197.952808:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782222197.952816:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb9f395d/0xe2b7cc26e681200f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755871b expref: 8 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.952833:0:8443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eb9f395d/0xe2b7cc26e681200f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755871b expref: 8 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222197.952845:0:8443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fcb9800, rc 0) 00000100:00100000:0.0:1782222197.952906:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77bf2c2c-f408-43f9-ae59-449550631d05+8:11930:x1868795060777600:12345-192.168.203.27@tcp:101:bash.0 Request processed in 224us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222197.952914:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 66 00000100:00100000:2.0:1782222197.960754:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222197.961654:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060777728 00000100:00100000:1.0:1782222197.961665:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060777728 00002000:00010000:1.0:1782222197.961706:0:8448:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:1.0:1782222197.961711:0:8448:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f07474be300 with x1868795060777728 ext(0->18446744073709551615) 00002000:00010000:1.0:1782222197.961722:0:8448:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f07474be300. 00000100:00100000:1.0:1782222197.961762:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 5 00000100:00100000:1.0:1782222197.961782:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77bf2c2c-f408-43f9-ae59-449550631d05+8:2387:x1868795060777728:12345-192.168.203.27@tcp:10:bash.0 00002000:00010000:1.0:1782222197.962222:0:8448:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1782222197.962226:0:8448:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1782222195 -> 1782222197 00002000:00010000:1.0:1782222197.962229:0:8448:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1782222194 -> 1782222194 00002000:00010000:1.0:1782222197.962251:0:8448:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1782222195 -> 1782222197 00002000:00010000:1.0:1782222197.962254:0:8448:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1782222197.962485:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:77bf2c2c-f408-43f9-ae59-449550631d05+9:2387:x1868795060777728:12345-192.168.203.27@tcp:10:bash.0 Request processed in 713us (1737us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1782222197.962493:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 5 00002000:00010000:1.0:1782222197.962497:0:8448:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:1.0:1782222197.962508:0:8448:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f07474be300 with x1868795060777728 ext(0->18446744073709551615) 00002000:00010000:1.0:1782222197.962514:0:8448:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f07474be300. 00000100:00100000:2.0:1782222198.051589:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222198.051680:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060777856 00000100:00100000:3.0:1782222198.051690:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060777856 00000100:00100000:3.0:1782222198.051953:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 210 00000100:00100000:3.0:1782222198.051964:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+35:12412:x1868795060777856:12345-192.168.203.27@tcp:34:lfs.0 00010000:00010000:3.0:1782222198.052037:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6812016 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.052053:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6812016 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.052067:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6812016 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.052082:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e681201d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.052089:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e681201d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.052096:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e681201d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.052197:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430600/0xe2b7cc26e6812024 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.052206:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430600/0xe2b7cc26e6812024 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.052213:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430600/0xe2b7cc26e6812024 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782222198.052307:0:8465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430600/0xe2b7cc26e6812024 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.052319:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6812016 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.052326:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6812016 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.052332:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6812016 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.052338:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746430000 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222198.052342:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6812016 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.052349:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6812016 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.052360:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:3.0:1782222198.052363:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222198.052367:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6812016 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.052380:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6812016 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.052393:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e681201d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.052400:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e681201d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.052406:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e681201d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.052411:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746431a00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222198.052414:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e681201d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.052420:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e681201d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.052428:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f087f8f1f00) 00010000:00010000:3.0:1782222198.052430:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222198.052433:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e681201d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.052439:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e681201d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.052451:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430600/0xe2b7cc26e6812024 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.052457:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430600/0xe2b7cc26e6812024 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.052467:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430600/0xe2b7cc26e6812024 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.052472:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746430600 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222198.052474:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430600/0xe2b7cc26e6812024 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.052480:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430600/0xe2b7cc26e6812024 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.052487:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0849b72200) 00010000:00010000:3.0:1782222198.052490:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222198.052493:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430600/0xe2b7cc26e6812024 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.052498:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430600/0xe2b7cc26e6812024 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222198.052558:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+35:12412:x1868795060777856:12345-192.168.203.27@tcp:34:lfs.0 Request processed in 596us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222198.052566:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 210 00000100:00080000:0.0:1782222198.055585:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782222198.101721:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222198.101839:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060778112 00000100:00100000:1.0:1782222198.101849:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060778112 00000100:00100000:1.0:1782222198.101912:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 211 00000100:00100000:1.0:1782222198.101922:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+35:12415:x1868795060778112:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:1.0:1782222198.101942:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222198.101961:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681202b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558722 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.102029:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6812032 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.102043:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6812032 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.102054:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6812032 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.102069:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6812039 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.102077:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6812039 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.102084:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6812039 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.102193:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e6812040 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.102219:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e6812040 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.102226:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e6812040 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782222198.102266:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1782222198.102546:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6812032 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.102554:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6812032 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.102560:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6812032 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.102566:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744d400 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222198.102570:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6812032 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.102577:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6812032 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.102589:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:1.0:1782222198.102592:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222198.102596:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6812032 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.102602:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6812032 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.102614:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6812039 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.102626:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6812039 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.102631:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6812039 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.102636:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744ce00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222198.102638:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6812039 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.102643:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6812039 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.102651:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f0843b9b300) 00010000:00010000:1.0:1782222198.102654:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222198.102656:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6812039 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.102662:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e6812039 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.103484:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681202b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558722 expref: 38 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.103509:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e6812040 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558722 expref: 37 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.103515:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0849b72200) 00010000:00010000:1.0:1782222198.103518:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1782222198.103528:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744de00, rc 0) 00000100:00100000:1.0:1782222198.103599:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+37:12415:x1868795060778112:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 1677us (1886us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1782222198.103607:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 211 00000100:00100000:2.0:1782222198.108022:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222198.108156:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060778240 00000100:00100000:0.0:1782222198.108166:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060778240 00000100:00100000:0.0:1782222198.108304:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 212 00000100:00100000:0.0:1782222198.108315:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+37:12415:x1868795060778240:12345-192.168.203.27@tcp:54:lfs.0 00010000:00010000:0.0:1782222198.108382:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e681204e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.108399:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811fe5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558706 expref: 37 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.108421:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e681204e lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.108455:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811fe5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558706 expref: 37 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.108468:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811fe5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558706 expref: 37 pid: 6526 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222198.108482:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cfd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6528:1868795081813120:192.168.203.27@tcp:104: 00000100:00100000:0.0:1782222198.108556:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0841254780 going to sleep for 11 seconds 00000100:00100000:0.0:1782222198.115503:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cfd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6528:1868795081813120:192.168.203.27@tcp:104: 00010000:00010000:0.0:1782222198.115532:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e681204e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222198.118386:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222198.118575:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060778496 00000100:00100000:0.0:1782222198.118584:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060778496 00000100:00100000:0.0:1782222198.118646:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 52 00000100:00100000:0.0:1782222198.118656:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+38:6159:x1868795060778496:12345-192.168.203.27@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1782222198.119288:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+39:6159:x1868795060778496:12345-192.168.203.27@tcp:35:ldlm_bl.0 Request processed in 631us (911us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1782222198.119299:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 52 00000100:00100000:2.0:1782222198.125053:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222198.131162:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060778624 00000100:00100000:0.0:1782222198.131175:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060778624 00010000:00010000:0.0:1782222198.131225:0:9532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811fe5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558706 expref: 39 pid: 6526 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222198.131318:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 93 00000100:00100000:0.0:1782222198.131328:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77bf2c2c-f408-43f9-ae59-449550631d05+39:2390:x1868795060778624:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782222198.131343:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222198.131350:0:9532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811fe5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558706 expref: 39 pid: 6526 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.131362:0:9532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811fe5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558706 expref: 39 pid: 6526 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.131383:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430e00/0xe2b7cc26e6811fe5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558706 expref: 39 pid: 6526 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.131399:0:9532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0849b72200) 00010000:00010000:0.0:1782222198.131404:0:9532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e681204e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.131412:0:9532:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e681204e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.131419:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e681204e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.131451:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782222198.131508:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77bf2c2c-f408-43f9-ae59-449550631d05+38:2390:x1868795060778624:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 181us (6463us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222198.131516:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 93 00010000:00010000:2.0:1782222198.131615:0:6528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e681204e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222198.131624:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e681204e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222198.131662:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e681204e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222198.131678:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e681204e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222198.131686:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e681204e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222198.131691:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb9600 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222198.131696:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e681204e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222198.131703:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e681204e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222198.131713:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0849b72200) 00010000:00010000:2.0:1782222198.131723:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782222198.131727:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e681204e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222198.131734:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e681204e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222198.131786:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+37:12415:x1868795060778240:12345-192.168.203.27@tcp:54:lfs.0 Request processed in 23472us (23772us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222198.131794:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 212 00000100:00100000:2.0:1782222198.137581:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222198.137661:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060778880 00000100:00100000:3.0:1782222198.137741:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060778880 00000100:00100000:3.0:1782222198.137848:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 53 00000100:00100000:3.0:1782222198.137859:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+37:12415:x1868795060778880:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:3.0:1782222198.138079:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+38:12415:x1868795060778880:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 221us (507us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1782222198.138088:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 53 00000100:00100000:1.0:1782222198.223336:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222198.223980:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060779136 00000100:00100000:3.0:1782222198.223990:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060779136 00000100:00100000:3.0:1782222198.224052:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 213 00000100:00100000:3.0:1782222198.224062:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+38:12426:x1868795060779136:12345-192.168.203.27@tcp:101:cat.0 00010000:00010000:3.0:1782222198.224087:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222198.224105:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430600/0xe2b7cc26e6812055 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558729 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.224368:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e681205c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.224384:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e681205c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.224396:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e681205c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.224411:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6812063 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.224417:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6812063 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.224424:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6812063 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.224528:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431400/0xe2b7cc26e681206a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.224539:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431400/0xe2b7cc26e681206a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.224564:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431400/0xe2b7cc26e681206a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782222198.224576:0:8465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:3.0:1782222198.224652:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e681205c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.224660:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e681205c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.224666:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e681205c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.224672:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746431a00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222198.224676:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e681205c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.224682:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e681205c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.224694:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:3.0:1782222198.224697:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222198.224701:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e681205c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.224707:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e681205c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.224720:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6812063 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.224727:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6812063 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.224740:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6812063 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.224745:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746430000 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222198.224748:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6812063 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.224754:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6812063 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.224763:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f087f8f1f00) 00010000:00010000:3.0:1782222198.224817:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222198.224821:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6812063 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.224828:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e6812063 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.224871:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430600/0xe2b7cc26e6812055 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558729 expref: 41 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.224886:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431400/0xe2b7cc26e681206a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558729 expref: 40 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.224894:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0849b72200) 00010000:00010000:3.0:1782222198.224896:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782222198.224899:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746431400, rc 0) 00000100:00100000:3.0:1782222198.225024:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+40:12426:x1868795060779136:12345-192.168.203.27@tcp:101:cat.0 Request processed in 962us (1694us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1782222198.225041:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 213 00000100:00100000:2.0:1782222198.233343:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222198.233440:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060779392 00000100:00100000:0.0:1782222198.233463:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060779392 00000100:00100000:0.0:1782222198.233521:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 54 00000100:00100000:0.0:1782222198.233530:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+40:12426:x1868795060779392:12345-192.168.203.27@tcp:35:cat.0 00000100:00100000:0.0:1782222198.233813:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+41:12426:x1868795060779392:12345-192.168.203.27@tcp:35:cat.0 Request processed in 283us (479us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1782222198.233822:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 54 00000100:00100000:3.0:1782222198.250757:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081813248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782222198.250837:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222198.251102:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081813248 00000100:00100000:0.0:1782222198.251111:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081813248 00000100:00100000:0.0:1782222198.251181:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1782222198.251191:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3654:x1868795081813248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782222198.251213:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:0.0:1782222198.251283:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3654:x1868795081813248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222198.251289:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1782222198.251365:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081813248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782222198.251599:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782222198.251611:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081813376:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782222198.251640:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222198.251818:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081813376 00000100:00100000:0.0:1782222198.251823:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081813376 00000100:00100000:0.0:1782222198.251868:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1782222198.251876:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081813376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782222198.251890:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00080000:3.0:1782222198.252016:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782222198.252154:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081813376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 278us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222198.252257:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1782222198.252333:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081813376:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782222198.278551:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222198.279419:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060779648 00000100:00100000:1.0:1782222198.279431:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060779648 00000100:00100000:1.0:1782222198.279497:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 214 00000100:00100000:1.0:1782222198.279508:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+41:12427:x1868795060779648:12345-192.168.203.27@tcp:36:rm.0 00010000:00010000:1.0:1782222198.279564:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1782222198.279589:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e6812008 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558714 expref: 41 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.279612:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431400/0xe2b7cc26e681206a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558729 expref: 40 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.279623:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e6812040 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558722 expref: 39 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.279634:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e6811ffa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755870d expref: 38 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.279645:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0849b72200) 00010000:00010000:1.0:1782222198.279650:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782222198.279671:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6812078 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.279703:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6812078 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.279712:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6812078 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.279726:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e681207f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.279732:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e681207f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.279739:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e681207f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.279826:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6812086 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.279834:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6812086 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.279841:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6812086 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782222198.280458:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1782222198.280469:0:6527:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 397309233729ns, next at 398309231133ns, rc = 0 00010000:00010000:1.0:1782222198.280515:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e681208d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.280525:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e681208d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.280545:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e681208d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.280554:0:6527:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e681208d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.280560:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e681208d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.280566:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e681208d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.280630:0:6527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782222198.280650:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6812086 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.280657:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6812086 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.280663:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6812086 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.280668:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744d600 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222198.280672:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6812086 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.280680:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6812086 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.280690:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0849b72200) 00010000:00010000:1.0:1782222198.280693:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782222198.280704:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6812086 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.280711:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e6812086 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.280728:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6812078 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.280735:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6812078 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.280740:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6812078 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.280744:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744d400 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222198.280746:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6812078 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.280752:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6812078 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.280758:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:1.0:1782222198.280761:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222198.280764:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6812078 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.280781:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6812078 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782222198.280790:0:6527:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000a605420 reply state 0000000025f18056 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e681207f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.280810:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e681207f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.280815:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f0843b9b300) 00010000:00010000:1.0:1782222198.280817:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782222198.280820:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782222198.280903:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+39:12427:x1868795060779648:12345-192.168.203.27@tcp:36:rm.0 Request processed in 1396us (2360us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1782222198.280911:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 214 00010000:00010000:0.0:1782222198.290543:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782222198.290559:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e681208d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.290571:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744dc00 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:0.0:1782222198.290594:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e681208d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.290604:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e681208d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.290623:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0849b72200) 00010000:00010000:0.0:1782222198.290627:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782222198.290632:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e681208d lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.290638:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e681208d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.290668:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222198.290670:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222198.290672:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222198.314548:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782222198.339349:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222198.339653:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060779904 00000100:00100000:2.0:1782222198.339665:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060779904 00000100:00100000:2.0:1782222198.339730:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 215 00000100:00100000:2.0:1782222198.339740:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+39:12433:x1868795060779904:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:2.0:1782222198.339763:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222198.339795:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6812094 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558730 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222198.339907:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e681209b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222198.339922:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e681209b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222198.339933:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e681209b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222198.339963:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e68120a2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222198.339971:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e68120a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222198.339978:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e68120a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782222198.340673:0:6528:0:(osp_object.c:1673:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:2.0:1782222198.340819:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e68120a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222198.340830:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e68120a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222198.340838:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e68120a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222198.340883:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e681209b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222198.340890:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e681209b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222198.342490:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e681209b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222198.343084:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83c00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222198.343092:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e681209b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222198.343123:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e681209b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222198.343142:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:2.0:1782222198.343145:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782222198.343150:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e681209b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222198.343156:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83c00/0xe2b7cc26e681209b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782222198.343175:0:6528:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d1993839 reply state 00000000846a5e49 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e68120a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222198.343186:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e68120a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222198.343193:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f0843b9b300) 00010000:00010000:2.0:1782222198.343195:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782222198.343199:0:6528:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782222198.343303:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6812094 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558730 expref: 42 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222198.343320:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e68120a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558730 expref: 41 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222198.343327:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f0849b72b00) 00010000:00010000:2.0:1782222198.343329:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782222198.343332:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb83800, rc 0) 00000100:00100000:2.0:1782222198.343415:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+42:12433:x1868795060779904:12345-192.168.203.27@tcp:101:bash.0 Request processed in 3675us (4075us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1782222198.343431:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 215 00000100:00100000:2.0:1782222198.350451:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222198.352067:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060780032 00000100:00100000:3.0:1782222198.352081:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060780032 00000100:00100000:3.0:1782222198.352170:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 67 00000100:00100000:3.0:1782222198.352180:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77bf2c2c-f408-43f9-ae59-449550631d05+7:2390:x1868795060780032:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:3.0:1782222198.352197:0:8887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222198.352216:0:8887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017be3bf3/0xe2b7cc26e68120b7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558737 expref: -99 pid: 8887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782222198.352389:0:8887:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782222198.352423:0:8887:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=397s v=(0 0) 00010000:00010000:3.0:1782222198.352428:0:8887:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782222198.352437:0:8887:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017be3bf3/0xe2b7cc26e68120b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558737 expref: 8 pid: 8887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.352459:0:8887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000017be3bf3/0xe2b7cc26e68120b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558737 expref: 8 pid: 8887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.352492:0:8887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746430600, rc 0) 00000100:00080000:0.0:1782222198.352663:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782222198.352851:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77bf2c2c-f408-43f9-ae59-449550631d05+8:2390:x1868795060780032:12345-192.168.203.27@tcp:101:bash.0 Request processed in 671us (2408us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222198.352859:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 67 00000100:00100000:0.0:1782222198.356347:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222198.356535:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060780160 00000100:00100000:1.0:1782222198.356547:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060780160 00000100:00100000:1.0:1782222198.356609:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 68 00000100:00100000:1.0:1782222198.356618:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77bf2c2c-f408-43f9-ae59-449550631d05+8:12433:x1868795060780160:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:1.0:1782222198.356634:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222198.356651:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac77c6d5/0xe2b7cc26e68120be lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755873e expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.356680:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000017be3bf3/0xe2b7cc26e68120b7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558737 expref: 9 pid: 8887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.356688:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222198.356692:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222198.356698:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac77c6d5/0xe2b7cc26e68120be lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755873e expref: 9 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.356729:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000017be3bf3/0xe2b7cc26e68120b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558737 expref: 9 pid: 8887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.356756:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000017be3bf3/0xe2b7cc26e68120b7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558737 expref: 9 pid: 8887 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222198.356778:0:8440:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747781880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8440:1868795081813504:192.168.203.27@tcp:104: 00000100:00100000:1.0:1782222198.357605:0:8440:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b778000 going to sleep for 11 seconds 00000100:00100000:3.0:1782222198.362840:0:8440:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747781880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8440:1868795081813504:192.168.203.27@tcp:104: 00010000:00010000:3.0:1782222198.362884:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ac77c6d5/0xe2b7cc26e68120be lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755873e expref: 9 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.362907:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744d600, rc 0) 00000100:00100000:3.0:1782222198.362971:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77bf2c2c-f408-43f9-ae59-449550631d05+9:12433:x1868795060780160:12345-192.168.203.27@tcp:101:bash.0 Request processed in 6353us (6632us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222198.362981:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 68 00000100:00100000:3.0:1782222198.365983:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222198.366971:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060780288 00000100:00100000:0.0:1782222198.366983:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060780288 00010000:00010000:0.0:1782222198.367024:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000017be3bf3/0xe2b7cc26e68120b7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558737 expref: 9 pid: 8887 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222198.367074:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 94 00000100:00100000:0.0:1782222198.367084:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08429a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77bf2c2c-f408-43f9-ae59-449550631d05+9:2389:x1868795060780288:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782222198.367099:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222198.367396:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000017be3bf3/0xe2b7cc26e68120b7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558737 expref: 9 pid: 8887 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.367429:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000017be3bf3/0xe2b7cc26e68120b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558737 expref: 9 pid: 8887 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.367451:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017be3bf3/0xe2b7cc26e68120b7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558737 expref: 9 pid: 8887 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.367466:0:6512:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782222198.367470:0:6512:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782222198.367477:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac77c6d5/0xe2b7cc26e68120be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755873e expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.367487:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac77c6d5/0xe2b7cc26e68120be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755873e expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.367524:0:6512:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ac77c6d5/0xe2b7cc26e68120be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755873e expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222198.367539:0:6512:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cfd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6512:1868795081813632:192.168.203.27@tcp:105: 00000100:00100000:0.0:1782222198.368994:0:6512:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0841254180 going to sleep for 11 seconds 00000100:00100000:0.0:1782222198.380587:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222198.380878:0:6512:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cfd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6512:1868795081813632:192.168.203.27@tcp:105: 00010000:00010000:3.0:1782222198.380902:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782222198.380967:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08429a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77bf2c2c-f408-43f9-ae59-449550631d05+8:2389:x1868795060780288:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 13883us (14991us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222198.380978:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 94 00000100:00100000:1.0:1782222198.381291:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060780544 00000100:00100000:1.0:1782222198.381299:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060780544 00000100:00100000:1.0:1782222198.381342:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 55 00000100:00100000:1.0:1782222198.381351:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+42:12433:x1868795060780544:12345-192.168.203.27@tcp:35:bash.0 00000100:00100000:1.0:1782222198.381952:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+43:12433:x1868795060780544:12345-192.168.203.27@tcp:35:bash.0 Request processed in 599us (1371us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1782222198.381961:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 55 00000100:00100000:2.0:1782222198.567885:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222198.568366:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060780672 00000100:00100000:3.0:1782222198.568377:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060780672 00000100:00100000:3.0:1782222198.568455:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 216 00000100:00100000:3.0:1782222198.568465:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+43:12449:x1868795060780672:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1782222198.568490:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222198.568526:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e68120c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558745 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.568596:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e68120cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.568611:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e68120cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.569200:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e68120cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782222198.569274:0:8465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1782222198.569279:0:8465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782222198.569298:0:8465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e68120cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.569325:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e68120c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558745 expref: 45 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.569342:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e68120cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558745 expref: 44 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.569351:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:3.0:1782222198.569353:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782222198.569356:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746431a00, rc 0) 00000100:00100000:3.0:1782222198.569482:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+44:12449:x1868795060780672:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 1018us (1606us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222198.569490:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 216 00000100:00100000:2.0:1782222198.580967:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222198.581227:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060780928 00000100:00100000:1.0:1782222198.581260:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060780928 00000100:00100000:1.0:1782222198.581325:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 217 00000100:00100000:1.0:1782222198.581335:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b784700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+44:12449:x1868795060780928:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:1.0:1782222198.581354:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222198.581373:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e68120d3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755874c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.581483:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e68120da lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.581497:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e68120da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.581534:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e68120da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782222198.581546:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1782222198.581638:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e68120d3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755874c expref: 47 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.581657:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e68120da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755874c expref: 46 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.581664:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f0849b72b00) 00010000:00010000:1.0:1782222198.581668:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782222198.581671:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744c200, rc 0) 00000100:00100000:1.0:1782222198.581729:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b784700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+46:12449:x1868795060780928:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 396us (771us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1782222198.581736:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 217 00000100:00100000:2.0:1782222198.586722:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222198.587169:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060781184 00000100:00100000:0.0:1782222198.587179:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060781184 00000100:00100000:0.0:1782222198.587276:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 218 00000100:00100000:0.0:1782222198.587285:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b785180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+46:12449:x1868795060781184:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:0.0:1782222198.587327:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222198.587347:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9c00/0xe2b7cc26e68120e8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558753 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.587457:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e68120ef lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.587472:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e68120ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.587483:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e68120ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782222198.587495:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1782222198.587604:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9c00/0xe2b7cc26e68120e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558753 expref: 49 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.587623:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e68120ef lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558753 expref: 48 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.587631:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f0849b72b00) 00010000:00010000:0.0:1782222198.587634:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1782222198.587638:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fcb9200, rc 0) 00000100:00100000:0.0:1782222198.587691:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b785180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+48:12449:x1868795060781184:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 407us (978us total) trans 4294967487 rc 0/0 00000100:00100000:0.0:1782222198.587699:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 218 00000100:00100000:2.0:1782222198.596601:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222198.596981:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060781312 00000100:00100000:0.0:1782222198.597153:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060781312 00000100:00100000:0.0:1782222198.597314:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 17 00000100:00100000:0.0:1782222198.597337:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074767b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77bf2c2c-f408-43f9-ae59-449550631d05+48:2390:x1868795060781312:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782222198.597354:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222198.597379:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e68120da lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755874c expref: 48 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.597409:0:9532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f0849b72b00) 00010000:00010000:0.0:1782222198.597415:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782222198.597474:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074767b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77bf2c2c-f408-43f9-ae59-449550631d05+47:2390:x1868795060781312:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 138us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222198.597481:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 17 00000100:00100000:2.0:1782222198.599589:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222198.599675:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060781440 00000100:00100000:0.0:1782222198.599684:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060781440 00000100:00100000:0.0:1782222198.599781:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 69 00000100:00100000:0.0:1782222198.599791:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747678e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77bf2c2c-f408-43f9-ae59-449550631d05+8:2389:x1868795060781440:12345-192.168.203.27@tcp:1:lfs.0 00010000:00010000:0.0:1782222198.599832:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d14254f/0xe2b7cc26e68120fd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.599850:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac77c6d5/0xe2b7cc26e68120be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755873e expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.599933:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782222198.599938:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782222198.599942:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d14254f/0xe2b7cc26e68120fd lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.599974:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ac77c6d5/0xe2b7cc26e68120be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755873e expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.600123:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ac77c6d5/0xe2b7cc26e68120be lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755873e expref: 8 pid: 8440 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222198.600140:0:8443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cfd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8443:1868795081813760:192.168.203.27@tcp:104: 00000100:00100000:0.0:1782222198.600214:0:8443:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0841254180 going to sleep for 11 seconds 00000100:00100000:2.0:1782222198.608545:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222198.608625:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060781568 00000100:00100000:3.0:1782222198.608646:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060781568 00002000:00100000:3.0:1782222198.608688:0:8447:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8f074767ad80 x1868795060781568/t0(0) o4->77bf2c2c-f408-43f9-ae59-449550631d05@192.168.203.27@tcp:164/0 lens 504/0 e 0 to 0 dl 1782222209 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782222198.608700:0:8447:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f074767ad80 with x1868795060781568 ext(0->8) 00010000:00010000:3.0:1782222198.608709:0:8447:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ac77c6d5/0xe2b7cc26e68120be lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755873e expref: 9 pid: 8440 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.608724:0:8447:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ac77c6d5/0xe2b7cc26e68120be lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755873e expref: 9 pid: 8440 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782222198.608732:0:8447:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8f074767ad80 00000100:00100000:3.0:1782222198.608787:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 3 00000100:00100000:3.0:1782222198.608798:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074767ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77bf2c2c-f408-43f9-ae59-449550631d05+9:2389:x1868795060781568:12345-192.168.203.27@tcp:4:lfs.0 00000100:00100000:3.0:1782222198.610288:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074767ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77bf2c2c-f408-43f9-ae59-449550631d05+11:2389:x1868795060781568:12345-192.168.203.27@tcp:4:lfs.0 Request processed in 1483us (1744us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1782222198.610301:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 3 00002000:00100000:3.0:1782222198.610310:0:8447:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8f074767ad80 x1868795060781568/t4294967309(0) o4->77bf2c2c-f408-43f9-ae59-449550631d05@192.168.203.27@tcp:164/0 lens 504/448 e 0 to 0 dl 1782222209 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782222198.610320:0:8447:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f074767ad80 with x1868795060781568 ext(0->8) 00010000:00010000:3.0:1782222198.610329:0:8447:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ac77c6d5/0xe2b7cc26e68120be lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755873e expref: 11 pid: 8440 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.610347:0:8447:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ac77c6d5/0xe2b7cc26e68120be lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755873e expref: 11 pid: 8440 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782222198.610373:0:8447:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8f074767ad80 00000100:00100000:0.0:1782222198.610924:0:8443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cfd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8443:1868795081813760:192.168.203.27@tcp:104: 00010000:00010000:0.0:1782222198.610951:0:8443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007d14254f/0xe2b7cc26e68120fd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222198.621358:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222198.621467:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060781696 00000100:00100000:3.0:1782222198.621477:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060781696 00010000:00010000:3.0:1782222198.621520:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ac77c6d5/0xe2b7cc26e68120be lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755873e expref: 11 pid: 8440 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222198.621556:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 95 00000100:00100000:3.0:1782222198.621565:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074767b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77bf2c2c-f408-43f9-ae59-449550631d05+11:2390:x1868795060781696:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782222198.621580:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1782222198.621597:0:6511:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1782222198.621599:0:6511:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1782222197 00002000:00010000:3.0:1782222198.621601:0:6511:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1782222197 00002000:00010000:3.0:1782222198.621604:0:6511:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1782222197 00002000:00010000:3.0:1782222198.621606:0:6511:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1782222198.621612:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ac77c6d5/0xe2b7cc26e68120be lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755873e expref: 11 pid: 8440 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.621625:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ac77c6d5/0xe2b7cc26e68120be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755873e expref: 11 pid: 8440 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.621648:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac77c6d5/0xe2b7cc26e68120be lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755873e expref: 11 pid: 8440 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.621663:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782222198.621667:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782222198.621687:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007d14254f/0xe2b7cc26e68120fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.621698:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d14254f/0xe2b7cc26e68120fd lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.621735:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782222198.621797:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074767b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77bf2c2c-f408-43f9-ae59-449550631d05+10:2390:x1868795060781696:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 232us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222198.621805:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 95 00010000:00010000:1.0:1782222198.624387:0:8443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007d14254f/0xe2b7cc26e68120fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.624407:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d14254f/0xe2b7cc26e68120fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.624437:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d14254f/0xe2b7cc26e68120fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.624446:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d14254f/0xe2b7cc26e68120fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.624471:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d14254f/0xe2b7cc26e68120fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.624478:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb9c00 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:1.0:1782222198.624483:0:8443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d14254f/0xe2b7cc26e68120fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.624491:0:8443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d14254f/0xe2b7cc26e68120fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.624521:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d14254f/0xe2b7cc26e68120fd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.624530:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d14254f/0xe2b7cc26e68120fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222198.624613:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747678e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77bf2c2c-f408-43f9-ae59-449550631d05+9:2389:x1868795060781440:12345-192.168.203.27@tcp:1:lfs.0 Request processed in 24821us (25028us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222198.624621:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 69 00000100:00100000:2.0:1782222198.629818:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222198.630145:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060781952 00000100:00100000:3.0:1782222198.630155:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060781952 00000100:00100000:3.0:1782222198.630212:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 56 00000100:00100000:3.0:1782222198.630222:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087d4bb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+47:12449:x1868795060781952:12345-192.168.203.27@tcp:35:lfs.0 00000004:00010000:3.0:1782222198.630311:0:6530:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e68120ef lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558753 expref: 47 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782222198.632931:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1782222198.632998:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1782222198.633641:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:2.0:1782222198.633685:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6812104 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222198.633705:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e68120a9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558730 expref: 51 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222198.633714:0:6530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6812104 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222198.633750:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e68120a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558730 expref: 51 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222198.633778:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e68120a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558730 expref: 51 pid: 6528 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222198.633793:0:6530:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074767b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6530:1868795081813888:192.168.203.27@tcp:104: 00000100:00100000:2.0:1782222198.634352:0:6530:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08412ed780 going to sleep for 11 seconds 00000100:00100000:0.0:1782222198.646298:0:6530:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074767b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6530:1868795081813888:192.168.203.27@tcp:104: 00010000:00010000:0.0:1782222198.646341:0:6530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6812104 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222198.650445:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222198.650784:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060782080 00000100:00100000:3.0:1782222198.650794:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060782080 00010000:00010000:3.0:1782222198.650933:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e68120a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558730 expref: 52 pid: 6528 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222198.651125:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 96 00000100:00100000:3.0:1782222198.651137:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747679180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+52:2390:x1868795060782080:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782222198.651154:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222198.651161:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e68120a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558730 expref: 52 pid: 6528 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.651198:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e68120a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558730 expref: 52 pid: 6528 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.651221:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e68120a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558730 expref: 52 pid: 6528 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.651261:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f0849b72b00) 00010000:00010000:3.0:1782222198.651266:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6812104 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.651274:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6812104 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.651280:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6812104 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.651314:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782222198.651428:0:6530:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6812104 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222198.651437:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6812104 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782222198.651545:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:2.0:1782222198.651657:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1782222198.651742:0:6530:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747678700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6530:1868795081814016:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1782222198.651810:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222198.651844:0:6530:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746166cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782222198.653672:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747679180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+53:2390:x1868795060782080:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 2528us (3226us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222198.653686:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 96 00000100:00100000:1.0:1782222198.653787:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081814016 00000100:00100000:1.0:1782222198.653796:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081814016 00000100:00100000:1.0:1782222198.653859:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1782222198.653869:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6530:x1868795081814016:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1782222198.653982:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6530:x1868795081814016:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 115us (2171us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222198.654020:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1782222198.654077:0:6530:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747678700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6530:1868795081814016:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1782222198.654267:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:1.0:1782222198.654337:0:6530:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747781c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6530:1868795081814144:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1782222198.654374:0:6530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222198.654404:0:6530:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b778d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782222198.654744:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081814144 00000100:00100000:0.0:1782222198.654750:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081814144 00000100:00100000:0.0:1782222198.654796:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1782222198.654804:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6530:x1868795081814144:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782222198.654926:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6530:x1868795081814144:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 122us (550us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1782222198.654933:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00080000:3.0:1782222198.655081:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782222198.655214:0:6530:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747781c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6530:1868795081814144:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1782222198.655299:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1782222198.655341:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6812104 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222198.655351:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6812104 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222198.655359:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6812104 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222198.655365:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb82600 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222198.655369:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6812104 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222198.655377:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6812104 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222198.655409:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f0849b72b00) 00010000:00010000:2.0:1782222198.655411:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1782222198.655415:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6812104 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222198.655421:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6812104 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782222198.655514:0:6530:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1782222198.655575:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1782222198.655587:0:6530:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 397684351743ns, next at 398684349786ns, rc = 0 00000001:00080000:2.0:1782222198.655593:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1782222198.655618:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f0849b72b00) 00010000:00010000:2.0:1782222198.655621:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1782222198.655628:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e68120ef lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558753 expref: 55 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222198.655719:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087d4bb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+54:12449:x1868795060781952:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 25497us (25909us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1782222198.655728:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 56 00000020:00080000:2.0:1782222198.655732:0:6530:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1782222198.659974:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222198.660604:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060782208 00000100:00100000:3.0:1782222198.660615:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060782208 00000100:00100000:3.0:1782222198.660716:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 219 00000100:00100000:3.0:1782222198.660727:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f084927f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+54:12449:x1868795060782208:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1782222198.660750:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222198.660809:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e681210b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755875a expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.660887:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e681210b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755875a expref: 55 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.660901:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e681210b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755875a expref: 55 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222198.661079:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:3.0:1782222198.661083:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782222198.661469:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746430000, rc 0) 00000100:00100000:3.0:1782222198.661537:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f084927f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+55:12449:x1868795060782208:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 810us (1569us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222198.661545:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 219 00000100:00100000:3.0:1782222198.665902:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222198.665983:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060782464 00000100:00100000:1.0:1782222198.666003:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060782464 00000100:00100000:1.0:1782222198.666065:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 57 00000100:00100000:1.0:1782222198.666075:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+55:12449:x1868795060782464:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:1.0:1782222198.666320:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+56:12449:x1868795060782464:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 245us (425us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1782222198.666327:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 57 00000100:00100000:2.0:1782222198.704534:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222198.704576:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222198.704613:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222198.704646:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222198.704728:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060782848 00000100:00100000:1.0:1782222198.704738:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060782848 00000100:00100000:1.0:1782222198.704804:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060782720 00000100:00100000:1.0:1782222198.704807:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060782720 00000100:00100000:1.0:1782222198.704823:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060782976 00000100:00100000:1.0:1782222198.704825:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060782976 00000100:00100000:1.0:1782222198.704839:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 352 00000100:00100000:1.0:1782222198.704848:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747679f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2388:x1868795060782848:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222198.704913:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747679f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2388:x1868795060782848:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 66us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222198.704920:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 352 00000100:00100000:1.0:1782222198.704942:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 353 00000100:00100000:1.0:1782222198.704948:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074767bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:2388:x1868795060782720:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222198.704986:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074767bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:2388:x1868795060782720:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 38us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222198.704992:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 353 00000100:00100000:1.0:1782222198.705006:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 354 00000100:00100000:1.0:1782222198.705012:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747679880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2388:x1868795060782976:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222198.705035:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747679880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2388:x1868795060782976:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 24us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222198.705040:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 354 00000100:00100000:3.0:1782222198.705727:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060782592 00000100:00100000:3.0:1782222198.705735:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060782592 00000100:00080000:2.0:1782222198.705862:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782222198.705867:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782222198.706626:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 396 00000100:00100000:3.0:1782222198.706640:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2388:x1868795060782592:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222198.706718:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2388:x1868795060782592:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 81us (2190us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222198.706725:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 396 00000100:00100000:2.0:1782222198.754760:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222198.754865:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060783104 00000100:00100000:1.0:1782222198.754876:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060783104 00000100:00100000:1.0:1782222198.754936:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 220 00000100:00100000:1.0:1782222198.754945:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+56:12459:x1868795060783104:12345-192.168.203.27@tcp:34:lfs.0 00010000:00010000:1.0:1782222198.755030:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812112 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.755046:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812112 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.755058:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812112 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.755071:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6812119 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.755078:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6812119 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.755085:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6812119 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.755176:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e6812120 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.755185:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e6812120 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.755192:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e6812120 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782222198.755457:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e6812120 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.755471:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812112 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.755477:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812112 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.755483:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812112 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.755488:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744ca00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222198.755492:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812112 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.755499:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812112 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.755510:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:1.0:1782222198.755513:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222198.755517:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812112 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.755530:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812112 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.755545:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6812119 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.755550:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6812119 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.755554:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6812119 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.755559:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744c000 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222198.755562:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6812119 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.755568:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6812119 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.755575:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f0843b9b300) 00010000:00010000:1.0:1782222198.755578:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222198.755580:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6812119 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.755585:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e6812119 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.755594:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e6812120 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.755599:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e6812120 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.755610:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e6812120 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.755614:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744c800 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222198.755617:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e6812120 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.755623:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e6812120 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.755629:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:1.0:1782222198.755631:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222198.755633:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e6812120 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.755638:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e6812120 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222198.755875:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+56:12459:x1868795060783104:12345-192.168.203.27@tcp:34:lfs.0 Request processed in 928us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222198.755884:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 220 00000100:00100000:2.0:1782222198.797117:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222198.797214:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060783360 00000100:00100000:1.0:1782222198.797225:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060783360 00000100:00100000:1.0:1782222198.797312:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 221 00000100:00100000:1.0:1782222198.797322:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074767a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+56:12462:x1868795060783360:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:1.0:1782222198.797341:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222198.797361:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e6812127 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558761 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.797894:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e681212e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.797908:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e681212e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.797919:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e681212e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.797929:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812135 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.797937:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812135 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.797943:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812135 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.798049:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681213c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.798059:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681213c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.798066:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681213c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782222198.798077:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1782222198.798150:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e681212e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.798158:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e681212e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.798172:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e681212e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.798178:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744c000 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222198.798183:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e681212e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.798191:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e681212e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.798203:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:1.0:1782222198.798206:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222198.798210:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e681212e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.798216:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e681212e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.798231:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812135 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.798525:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812135 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.798531:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812135 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.798536:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744ca00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222198.798539:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812135 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.798558:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812135 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.798568:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f0843b9b300) 00010000:00010000:1.0:1782222198.798570:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222198.798573:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812135 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.798578:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812135 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.798625:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e6812127 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558761 expref: 59 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.798646:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681213c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558761 expref: 58 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.798652:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:1.0:1782222198.798654:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782222198.798656:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744d600, rc 0) 00000100:00100000:1.0:1782222198.798732:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074767a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+58:12462:x1868795060783360:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 1411us (1624us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1782222198.798740:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 221 00000100:00100000:3.0:1782222198.802133:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222198.802216:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060783488 00000100:00100000:0.0:1782222198.802226:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060783488 00000100:00100000:0.0:1782222198.802306:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 222 00000100:00100000:0.0:1782222198.802317:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+58:12462:x1868795060783488:12345-192.168.203.27@tcp:54:lfs.0 00010000:00010000:0.0:1782222198.802413:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e681214a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.802431:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e681214a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.802442:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e681214a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.802473:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e681214a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.802480:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e681214a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.802487:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e681214a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.802493:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb9200 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222198.802498:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e681214a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.802505:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e681214a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.802517:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:0.0:1782222198.802520:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782222198.802524:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e681214a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.802529:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e681214a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222198.802625:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+58:12462:x1868795060783488:12345-192.168.203.27@tcp:54:lfs.0 Request processed in 309us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222198.802640:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 222 00000100:00100000:3.0:1782222198.805510:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222198.805587:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060783744 00000100:00100000:1.0:1782222198.805608:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060783744 00000100:00100000:1.0:1782222198.805670:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 58 00000100:00100000:1.0:1782222198.805681:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+58:12462:x1868795060783744:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:1.0:1782222198.805938:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+59:12462:x1868795060783744:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 258us (435us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1782222198.805946:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 58 00000100:00100000:2.0:1782222198.910346:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222198.910534:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060784000 00000100:00100000:1.0:1782222198.910546:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060784000 00000100:00100000:1.0:1782222198.910612:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 223 00000100:00100000:1.0:1782222198.910622:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+59:12472:x1868795060784000:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:1.0:1782222198.910656:0:13817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222198.910659:0:13817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1782222198.910686:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431a00/0xe2b7cc26e68120cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558745 expref: 59 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.910713:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:1.0:1782222198.910718:0:13817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782222198.910730:0:13817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e6812151 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558768 expref: -99 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.910832:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812158 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.910845:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812158 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.910854:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812158 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782222198.910863:0:13817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1782222198.910955:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e6812151 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558768 expref: 61 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.910981:0:13817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812158 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558768 expref: 60 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.910988:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:1.0:1782222198.910991:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782222198.910993:0:13817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744ca00, rc 0) 00000100:00100000:1.0:1782222198.911055:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+60:12472:x1868795060784000:12345-192.168.203.27@tcp:101:bash.0 Request processed in 434us (718us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1782222198.911062:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 223 00000100:00100000:3.0:1782222198.920549:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222198.920669:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222198.922359:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060784256 00000100:00100000:1.0:1782222198.922372:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060784256 00000100:00100000:1.0:1782222198.922435:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 224 00000100:00100000:1.0:1782222198.922445:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+60:12472:x1868795060784256:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:1.0:1782222198.922468:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222198.922487:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e6812166 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755876f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.922517:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e681216d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.922530:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e681216d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.922540:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e681216d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.922647:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e6812166 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755876f expref: 62 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.922674:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e681216d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755876f expref: 61 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.922682:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:1.0:1782222198.922685:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782222198.922688:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744c000, rc 0) 00000100:00100000:1.0:1782222198.924631:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+61:12472:x1868795060784256:12345-192.168.203.27@tcp:101:bash.0 Request processed in 2177us (3952us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222198.924643:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 224 00000100:00100000:3.0:1782222198.931061:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222198.931177:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060784512 00000100:00100000:1.0:1782222198.931186:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060784512 00000100:00100000:1.0:1782222198.931270:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 225 00000100:00100000:1.0:1782222198.931280:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+61:12472:x1868795060784512:12345-192.168.203.27@tcp:36:bash.0 00010000:00010000:1.0:1782222198.931334:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222198.931361:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681213c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558761 expref: 61 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.931379:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:1.0:1782222198.931384:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782222198.931536:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6812174 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.931549:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812158 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558768 expref: 61 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.931557:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6812174 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.931595:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812158 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558768 expref: 61 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.931607:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812158 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558768 expref: 61 pid: 13817 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222198.931620:0:6526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747782d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6526:1868795081814272:192.168.203.27@tcp:104: 00000100:00100000:1.0:1782222198.931710:0:6526:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b778000 going to sleep for 11 seconds 00000100:00100000:0.0:1782222198.932105:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060784128 00000100:00100000:0.0:1782222198.932111:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060784128 00010000:00010000:0.0:1782222198.932137:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812158 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558768 expref: 62 pid: 13817 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222198.932185:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 97 00000100:00100000:0.0:1782222198.932193:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77bf2c2c-f408-43f9-ae59-449550631d05+62:2389:x1868795060784128:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782222198.932203:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222198.932207:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812158 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558768 expref: 62 pid: 13817 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.932218:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812158 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558768 expref: 62 pid: 13817 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.932255:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:0.0:1782222198.932261:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6812174 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.932268:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6812174 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.932275:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6812174 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.932291:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782222198.932342:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77bf2c2c-f408-43f9-ae59-449550631d05+62:2389:x1868795060784128:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 149us (11807us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222198.932350:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 97 00010000:00010000:1.0:1782222198.935724:0:6526:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.27@tcp) returned -22 from blocking AST (req@00000000e9183e6c x1868795081814272) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812158 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558768 expref: 61 pid: 13817 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.935748:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812158 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558768 expref: 61 pid: 13817 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222198.935953:0:6526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747782d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6526:1868795081814272:192.168.203.27@tcp:104: 00010000:00010000:1.0:1782222198.935985:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:1.0:1782222198.935993:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6812174 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.936003:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6812174 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.936009:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6812174 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782222198.936096:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:1.0:1782222198.936170:0:6526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000048cdbace reply state 00000000430a4ce1 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6812174 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.936186:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6812174 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222198.936192:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:1.0:1782222198.936195:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782222198.936197:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782222198.936337:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+62:12472:x1868795060784512:12345-192.168.203.27@tcp:36:bash.0 Request processed in 5057us (5283us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1782222198.936345:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 225 00000020:00080000:1.0:1782222198.936351:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1782222198.945962:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222198.946100:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060784640 00000100:00100000:0.0:1782222198.946114:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060784640 00000100:00100000:0.0:1782222198.946186:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 226 00000100:00100000:0.0:1782222198.946197:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+62:12472:x1868795060784640:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:0.0:1782222198.946223:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222198.946294:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e681217b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558776 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.946389:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9c00/0xe2b7cc26e6812182 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.946403:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9c00/0xe2b7cc26e6812182 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.946413:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9c00/0xe2b7cc26e6812182 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782222198.946444:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1782222198.946448:0:6528:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782222198.946467:0:6528:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9c00/0xe2b7cc26e6812182 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.946493:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e681217b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558776 expref: 64 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.946512:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9c00/0xe2b7cc26e6812182 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558776 expref: 63 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222198.946540:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:0.0:1782222198.946543:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782222198.946547:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fcb9c00, rc 0) 00000100:00100000:0.0:1782222198.946612:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+63:12472:x1868795060784640:12345-192.168.203.27@tcp:101:bash.0 Request processed in 417us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222198.946619:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 226 00000100:00100000:3.0:1782222198.953365:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222198.958855:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060784896 00000100:00100000:1.0:1782222198.958869:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060784896 00000100:00100000:1.0:1782222198.959593:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 59 00000100:00100000:1.0:1782222198.959607:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+63:12472:x1868795060784896:12345-192.168.203.27@tcp:35:bash.0 00000100:00100000:1.0:1782222198.960822:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+64:12472:x1868795060784896:12345-192.168.203.27@tcp:35:bash.0 Request processed in 1212us (7460us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1782222198.960833:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 59 00000100:00100000:3.0:1782222199.039006:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222199.039080:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060785024 00000100:00100000:2.0:1782222199.039091:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060785024 00000100:00100000:2.0:1782222199.039150:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 227 00000100:00100000:2.0:1782222199.039161:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+64:12478:x1868795060785024:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1782222199.039185:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222199.039205:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6812189 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755877d expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.040128:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6812190 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.040145:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6812190 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.040157:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6812190 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782222199.040199:0:8465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1782222199.040204:0:8465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782222199.040221:0:8465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6812190 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.040272:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e6812189 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755877d expref: 66 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.040304:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6812190 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755877d expref: 65 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.040326:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:2.0:1782222199.040330:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782222199.040333:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb83200, rc 0) 00000100:00100000:2.0:1782222199.040491:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+65:12478:x1868795060785024:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 1332us (1493us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222199.040497:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 227 00000100:00100000:3.0:1782222199.044650:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222199.044929:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060785152 00000100:00100000:1.0:1782222199.044939:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060785152 00000100:00100000:1.0:1782222199.045044:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 228 00000100:00100000:1.0:1782222199.045054:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+65:12478:x1868795060785152:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:1.0:1782222199.045072:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222199.045091:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812197 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558784 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.045150:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681219e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.045176:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681219e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.045187:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681219e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.045199:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e68121a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.045206:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e68121a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.045212:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e68121a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.045340:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68121ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.045351:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68121ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.045358:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68121ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782222199.045413:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1782222199.045417:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782222199.045436:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68121ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.045448:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68121ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.045469:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681219e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.045475:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681219e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.045481:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681219e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.045487:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744d600 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222199.045491:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681219e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.045497:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681219e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.045509:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:1.0:1782222199.045512:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222199.045516:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681219e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.045522:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e681219e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.045534:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e68121a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.045539:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e68121a5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.045545:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e68121a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.045554:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744c800 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222199.045558:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e68121a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.045564:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e68121a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.045571:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f0843b9b300) 00010000:00010000:1.0:1782222199.045573:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222199.045575:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e68121a5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.045581:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e68121a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.045602:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812197 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558784 expref: 67 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.045613:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68121ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558784 expref: 66 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.045637:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:1.0:1782222199.045640:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782222199.045642:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744de00, rc 0) 00000100:00100000:1.0:1782222199.045691:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+66:12478:x1868795060785152:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 639us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222199.046617:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 228 00000100:00100000:3.0:1782222199.055536:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222199.055584:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222199.055768:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060785280 00000100:00100000:0.0:1782222199.055778:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060785280 00000100:00100000:0.0:1782222199.055848:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 18 00000100:00100000:0.0:1782222199.055858:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77bf2c2c-f408-43f9-ae59-449550631d05+66:2388:x1868795060785280:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782222199.055873:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222199.055896:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68121ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558784 expref: 66 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.055914:0:9532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:0.0:1782222199.055919:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782222199.055970:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77bf2c2c-f408-43f9-ae59-449550631d05+65:2388:x1868795060785280:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 114us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222199.055978:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 18 00000100:00100000:1.0:1782222199.057482:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060785536 00000100:00100000:1.0:1782222199.057508:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060785536 00000100:00100000:1.0:1782222199.057608:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 229 00000100:00100000:1.0:1782222199.057618:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+65:12478:x1868795060785536:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:1.0:1782222199.057635:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222199.057655:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e68121b3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755878b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.057944:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e68121ba lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.057959:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9c00/0xe2b7cc26e6812182 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558776 expref: 66 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.057968:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e68121ba lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.058002:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9c00/0xe2b7cc26e6812182 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558776 expref: 66 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.058015:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9c00/0xe2b7cc26e6812182 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558776 expref: 66 pid: 6528 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222199.058027:0:6527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747782d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6527:1868795081814400:192.168.203.27@tcp:104: 00000100:00100000:1.0:1782222199.058106:0:6527:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b7780c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782222199.061628:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222199.064510:0:6527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747782d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6527:1868795081814400:192.168.203.27@tcp:104: 00010000:00010000:1.0:1782222199.064542:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e68121ba lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222199.065755:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060785664 00000100:00100000:3.0:1782222199.065776:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060785664 00010000:00010000:3.0:1782222199.065830:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9c00/0xe2b7cc26e6812182 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558776 expref: 67 pid: 6528 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222199.065880:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 98 00000100:00100000:3.0:1782222199.065889:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77bf2c2c-f408-43f9-ae59-449550631d05+67:2389:x1868795060785664:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782222199.065904:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222199.065920:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9c00/0xe2b7cc26e6812182 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558776 expref: 67 pid: 6528 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.065933:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9c00/0xe2b7cc26e6812182 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558776 expref: 67 pid: 6528 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.065954:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9c00/0xe2b7cc26e6812182 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558776 expref: 67 pid: 6528 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.065972:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:3.0:1782222199.065977:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e68121ba lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.066330:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e68121ba lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.066356:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e68121ba lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.066389:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782222199.066446:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77bf2c2c-f408-43f9-ae59-449550631d05+66:2389:x1868795060785664:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 557us (4825us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222199.066454:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 98 00010000:00010000:1.0:1782222199.066676:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e68121ba lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.066697:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e68121ba lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782222199.066718:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1782222199.067227:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e68121b3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755878b expref: 67 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.068177:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e68121ba lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755878b expref: 66 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.068188:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:1.0:1782222199.068191:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782222199.068193:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744c800, rc 0) 00000100:00100000:1.0:1782222199.068281:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+66:12478:x1868795060785536:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 10664us (12695us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1782222199.068291:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 229 00000100:00100000:0.0:1782222199.078603:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222199.078907:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060785920 00000100:00100000:2.0:1782222199.078917:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060785920 00000100:00100000:2.0:1782222199.079092:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 19 00000100:00100000:2.0:1782222199.079103:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08429a9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77bf2c2c-f408-43f9-ae59-449550631d05+66:12478:x1868795060785920:12345-192.168.203.27@tcp:103:lfs.0 00010000:00010000:2.0:1782222199.079120:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782222199.079145:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430000/0xe2b7cc26e681210b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755875a expref: 66 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.079164:0:9532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:2.0:1782222199.079169:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782222199.079223:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08429a9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:77bf2c2c-f408-43f9-ae59-449550631d05+65:12478:x1868795060785920:12345-192.168.203.27@tcp:103:lfs.0 Request processed in 122us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222199.079232:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 19 00000100:00100000:3.0:1782222199.081364:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222199.081854:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060786048 00000100:00100000:0.0:1782222199.081864:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060786048 00000100:00100000:0.0:1782222199.082077:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 230 00000100:00100000:0.0:1782222199.082089:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+65:12478:x1868795060786048:12345-192.168.203.27@tcp:58:lfs.0 00010000:00010000:0.0:1782222199.082217:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e68121c8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.082258:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e68121c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.082269:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e68121c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782222199.082363:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1782222199.082464:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+65:12478:x1868795060786048:12345-192.168.203.27@tcp:58:lfs.0 Request processed in 376us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222199.082471:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 230 00000100:00100000:3.0:1782222199.084341:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222199.085259:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060786176 00000100:00100000:2.0:1782222199.085270:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060786176 00000100:00100000:2.0:1782222199.085328:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 231 00000100:00100000:2.0:1782222199.085338:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+65:12478:x1868795060786176:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1782222199.085357:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222199.085377:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e68121cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558792 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.085594:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e68121c8 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.085605:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e68121cf lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558792 expref: 66 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.085624:0:6528:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e68121c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.085845:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e68121cf lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558792 expref: 66 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.085858:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:2.0:1782222199.085861:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782222199.085865:0:6528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e68121cf lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558792 expref: 66 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.085872:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb82800, rc 0) 00000100:00100000:2.0:1782222199.086317:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+66:12478:x1868795060786176:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 978us (1981us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222199.086325:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 231 00000100:00100000:3.0:1782222199.274670:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08504cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081814784:0@lo:400:kworker.0 00000100:00100000:3.0:1782222199.274742:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222199.274792:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1868795081815296:0@lo:400:kworker.0 00000100:00100000:3.0:1782222199.274814:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222199.274827:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1868795081815808:0@lo:400:kworker.0 00000100:00100000:3.0:1782222199.274842:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222199.274861:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1782222199.274865:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08504c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1868795081814656:0@lo:400:kworker.0 00000100:00100000:3.0:1782222199.274881:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222199.274891:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1868795081815168:0@lo:400:kworker.0 00000100:00100000:3.0:1782222199.274905:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222199.274916:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1868795081815680:0@lo:400:kworker.0 00000100:00100000:3.0:1782222199.274935:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222199.274961:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081815296 00000100:00100000:3.0:1782222199.274968:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081815296 00000100:00100000:3.0:1782222199.275008:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081815808 00000100:00100000:3.0:1782222199.275026:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081815808 00000100:00100000:3.0:1782222199.275044:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081814656 00000100:00100000:3.0:1782222199.275047:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081814656 00000100:00100000:3.0:1782222199.275057:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081815168 00000100:00100000:3.0:1782222199.275059:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081815168 00000100:00100000:3.0:1782222199.275068:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081815680 00000100:00100000:3.0:1782222199.275070:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081815680 00000100:00100000:3.0:1782222199.275099:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1782222199.275107:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1868795081815296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222199.275159:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1868795081815296:12345-0@lo:400:kworker.0 Request processed in 53us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222199.275166:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1782222199.275179:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1782222199.275185:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1868795081815808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222199.275205:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1868795081815808:12345-0@lo:400:kworker.0 Request processed in 21us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222199.275211:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1782222199.275219:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1782222199.275224:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1868795081814656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222199.275264:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1868795081814656:12345-0@lo:400:kworker.0 Request processed in 40us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222199.275270:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1782222199.275278:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1782222199.275283:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1868795081815168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222199.275302:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1868795081815168:12345-0@lo:400:kworker.0 Request processed in 19us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222199.275307:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1782222199.275321:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1782222199.275326:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1868795081815680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222199.275346:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1868795081815680:12345-0@lo:400:kworker.0 Request processed in 20us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222199.275351:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1782222199.275382:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08504c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1868795081814656:0@lo:400:kworker.0 00000100:00100000:3.0:1782222199.275390:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1868795081815168:0@lo:400:kworker.0 00000100:00100000:3.0:1782222199.275398:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1868795081815680:0@lo:400:kworker.0 00010000:00080000:3.0:1782222199.275408:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f087fdb3800 x1868795081815296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222199.275418:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1868795081815296:0@lo:400:kworker.0 00010000:00080000:3.0:1782222199.275426:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f087fdb3480 x1868795081815808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222199.275434:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1868795081815808:0@lo:400:kworker.0 00000100:00100000:1.0:1782222199.275618:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08504cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081814528:0@lo:400:kworker.0 00000100:00100000:1.0:1782222199.275650:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222199.275680:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1868795081815040:0@lo:400:kworker.0 00000100:00100000:1.0:1782222199.275698:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222199.275721:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081815552:0@lo:400:kworker.0 00000100:00100000:1.0:1782222199.275745:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222199.275767:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081816064:0@lo:400:kworker.0 00000100:00100000:1.0:1782222199.275791:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222199.275802:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081814784 00000100:00100000:0.0:1782222199.275809:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081814784 00000100:00100000:1.0:1782222199.275811:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1782222199.275822:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081815552 00000100:00100000:2.0:1782222199.275826:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081815552 00000100:00100000:1.0:1782222199.275827:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081814912:0@lo:400:kworker.0 00000100:00100000:0.0:1782222199.275852:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1782222199.275857:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222199.275858:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081816064 00000100:00100000:2.0:1782222199.275861:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081816064 00000100:00100000:0.0:1782222199.275866:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081814784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222199.275876:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081815424:0@lo:400:kworker.0 00000100:00100000:2.0:1782222199.275882:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1782222199.275889:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3656:x1868795081815552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222199.275902:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222199.275920:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081815936:0@lo:400:kworker.0 00000100:00100000:0.0:1782222199.275929:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081814784:12345-0@lo:400:kworker.0 Request processed in 66us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222199.275936:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1782222199.275950:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081814912 00000100:00100000:0.0:1782222199.275953:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081814912 00000100:00100000:0.0:1782222199.275972:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1782222199.275975:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081814528 00000100:00100000:0.0:1782222199.275980:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081814912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222199.275982:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081814528 00000100:00100000:3.0:1782222199.276017:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1782222199.276023:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3656:x1868795081814528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222199.279313:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222199.279377:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081815424 00000100:00100000:1.0:1782222199.279520:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081815424 00000100:00100000:1.0:1782222199.279562:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081815936 00000100:00100000:1.0:1782222199.279565:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081815936 00000100:00100000:1.0:1782222199.279585:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1782222199.279593:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3656:x1868795081816064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222199.279664:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3656:x1868795081816064:12345-0@lo:400:kworker.0 Request processed in 71us (3871us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222199.279671:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1782222199.279691:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1782222199.279697:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081815424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222199.279730:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081815424:12345-0@lo:400:kworker.0 Request processed in 33us (3827us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222199.279736:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1782222199.279885:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1782222199.279968:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747782300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081815936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222199.280004:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747782300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081815936:12345-0@lo:400:kworker.0 Request processed in 38us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222199.280010:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1782222199.280053:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081815424:0@lo:400:kworker.0 00000100:00100000:1.0:1782222199.280081:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081815936:0@lo:400:kworker.0 00000100:00100000:1.0:1782222199.280092:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081816064:0@lo:400:kworker.0 00000100:00100000:1.0:1782222199.280122:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081815040 00000100:00100000:1.0:1782222199.280126:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081815040 00000100:00100000:1.0:1782222199.280149:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1782222199.280155:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1868795081815040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222199.280296:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1868795081815040:12345-0@lo:400:kworker.0 Request processed in 140us (4596us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222199.280302:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1782222199.280329:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1868795081815040:0@lo:400:kworker.0 00000100:00100000:1.0:1782222199.280570:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08504cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081814784:0@lo:400:kworker.0 00000100:00080000:1.0:1782222199.280623:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782222199.280627:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782222199.280630:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782222199.280633:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782222199.281435:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081814912:12345-0@lo:400:kworker.0 Request processed in 5452us (5576us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222199.281447:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1782222199.281489:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081814912:0@lo:400:kworker.0 00000100:00100000:2.0:1782222199.284507:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3656:x1868795081815552:12345-0@lo:400:kworker.0 Request processed in 8610us (8752us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222199.284522:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1782222199.284997:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081815552:0@lo:400:kworker.0 00000100:00100000:3.0:1782222199.285200:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3656:x1868795081814528:12345-0@lo:400:kworker.0 Request processed in 9174us (9546us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222199.285209:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1782222199.289178:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08504cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081814528:0@lo:400:kworker.0 00010000:00010000:3.0:1782222199.338468:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782222199.402951:0:13806:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782222199.402960:0:13806:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782222199.403004:0:13806:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1782222199.403012:0:13806:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782222199.403149:0:13806:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08412af800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1868795081816192:192.168.203.27@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782222199.403263:0:13806:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08485ecf00 going to sleep for 11 seconds 00000100:00100000:1.0:1782222199.409871:0:13806:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08412af800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1868795081816192:192.168.203.27@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782222199.411944:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222199.412475:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060786304 00000100:00100000:1.0:1782222199.412485:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060786304 00000100:00100000:1.0:1782222199.412606:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 232 00000100:00100000:1.0:1782222199.412617:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+66:12479:x1868795060786304:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1782222199.412652:0:13817:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1782222199.412754:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+66:12479:x1868795060786304:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 Request processed in 138us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222199.412772:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 232 00000100:00100000:3.0:1782222199.421881:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222199.423571:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060786432 00000100:00100000:1.0:1782222199.423585:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060786432 00000100:00100000:1.0:1782222199.423659:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 233 00000100:00100000:1.0:1782222199.423670:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+66:12479:x1868795060786432:12345-192.168.203.27@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1782222199.423742:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e68121d6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.423775:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e68121d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.423787:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e68121d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.423802:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e68121dd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.423810:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e68121dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.423816:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e68121dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.423838:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68121e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.423848:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68121e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.423854:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68121e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782222199.423897:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1782222199.423917:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782222199.423930:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68121e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.423941:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e68121d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.423947:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e68121d6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.423953:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e68121d6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.423959:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744ca00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222199.423963:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e68121d6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.423969:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e68121d6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.423981:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f087f8f2900) 00010000:00010000:1.0:1782222199.423983:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222199.423988:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e68121d6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.423994:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e68121d6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.424005:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e68121dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.424011:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e68121dd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.424026:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e68121dd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.424031:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744d600 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222199.424034:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e68121dd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.424041:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e68121dd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.424050:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff8f0843b9b100) 00010000:00010000:1.0:1782222199.424053:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222199.424055:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e68121dd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.424060:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e68121dd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.424075:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68121e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.424080:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68121e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.424085:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68121e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.424090:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744d400 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222199.424092:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68121e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.424108:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68121e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.424116:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:1.0:1782222199.424119:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222199.424121:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68121e4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.424127:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68121e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222199.424207:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+66:12479:x1868795060786432:12345-192.168.203.27@tcp:34:lhsmtool_posix.0 Request processed in 538us (2335us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222199.424215:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 233 00000100:00100000:0.0:1782222199.426954:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222199.427026:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060786688 00000100:00100000:1.0:1782222199.427035:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060786688 00000100:00100000:1.0:1782222199.427095:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 234 00000100:00100000:1.0:1782222199.427104:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+66:12479:x1868795060786688:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782222199.427122:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222199.427138:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e68121eb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558799 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.428166:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68121f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.428184:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68121f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.429573:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68121f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782222199.429610:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1782222199.429704:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68121f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.429712:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68121f2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.429719:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68121f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.429725:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744de00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222199.429729:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68121f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.429737:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68121f2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.429769:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:1.0:1782222199.429772:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782222199.429777:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68121f2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.429784:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e68121f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.429837:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e68121eb lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558799 expref: 68 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.429848:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f087f8f2900) 00010000:00010000:1.0:1782222199.429850:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782222199.429861:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e68121eb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558799 expref: 68 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.429870:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744dc00, rc 0) 00000100:00100000:1.0:1782222199.430674:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+67:12479:x1868795060786688:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 3566us (3722us total) trans 4294967505 rc 301/301 00000100:00100000:1.0:1782222199.430684:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 234 00000100:00100000:3.0:1782222199.436338:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222199.436424:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060786816 00000100:00100000:1.0:1782222199.436434:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060786816 00000100:00100000:1.0:1782222199.436559:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 235 00000100:00100000:1.0:1782222199.436570:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+67:12479:x1868795060786816:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1782222199.436612:0:13817:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1782222199.436725:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+67:12479:x1868795060786816:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 Request processed in 157us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222199.436733:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 235 00000100:00100000:3.0:1782222199.442319:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222199.442733:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060787072 00000100:00100000:0.0:1782222199.442742:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060787072 00000100:00100000:0.0:1782222199.442818:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 236 00000100:00100000:0.0:1782222199.442827:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+67:12479:x1868795060787072:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782222199.442847:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222199.442850:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782222199.442874:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e6812190 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755877d expref: 67 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.442892:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:0.0:1782222199.442896:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782222199.442919:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8600/0xe2b7cc26e6812200 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75587a0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782222199.443566:0:8465:0:(osp_object.c:1673:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:0.0:1782222199.445196:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6812207 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.445217:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6812207 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.445230:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6812207 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.445333:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8600/0xe2b7cc26e6812200 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587a0 expref: 69 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.445369:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6812207 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587a0 expref: 68 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.445378:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f0851377000) 00010000:00010000:0.0:1782222199.445381:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782222199.445383:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fcb9a00, rc 0) 00000100:00100000:0.0:1782222199.445447:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+68:12479:x1868795060787072:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 2621us (3136us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1782222199.445456:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 236 00000100:00100000:0.0:1782222199.450799:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222199.451258:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060787328 00000100:00100000:2.0:1782222199.451269:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060787328 00000100:00100000:2.0:1782222199.451328:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 237 00000100:00100000:2.0:1782222199.451339:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+68:12479:x1868795060787328:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782222199.451402:0:6528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782222199.451429:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6812207 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587a0 expref: 68 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.451458:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f0851377000) 00010000:00010000:2.0:1782222199.451468:0:6528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782222199.451487:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6812215 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.451500:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6812215 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.451509:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6812215 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.452902:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e681221c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xbc245161 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.452919:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e681221c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xbc245161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.452930:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e681221c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xbc245161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.452997:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6812215 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.453005:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6812215 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.453011:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6812215 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.453017:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb82600 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222199.453022:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6812215 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.453029:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6812215 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.453041:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:2.0:1782222199.453044:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782222199.453048:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6812215 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.453053:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e6812215 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.453069:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e681221c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xbc245161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.453074:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e681221c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xbc245161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.453081:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e681221c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xbc245161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.453092:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83800 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222199.453096:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e681221c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xbc245161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.453101:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e681221c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xbc245161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.453110:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xbc245161 (ffff8f0849b72b00) 00010000:00010000:2.0:1782222199.453112:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782222199.453115:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e681221c lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xbc245161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.453121:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e681221c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xbc245161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222199.453253:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+67:12479:x1868795060787328:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 Request processed in 1897us (2454us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782222199.453262:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 237 00000100:00100000:3.0:1782222199.460330:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222199.460562:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060787456 00000100:00100000:1.0:1782222199.460573:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060787456 00000100:00100000:1.0:1782222199.460625:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 238 00000100:00100000:1.0:1782222199.460633:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+67:12479:x1868795060787456:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782222199.460650:0:13817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222199.460671:0:13817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6812223 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75587a7 expref: -99 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.460703:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e681222a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.460822:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e681222a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.460845:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e681222a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.461109:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e6812223 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587a7 expref: 69 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.461128:0:13817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e681222a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587a7 expref: 68 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.461136:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f0843b9b100) 00010000:00010000:1.0:1782222199.461139:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782222199.461142:0:13817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744de00, rc 0) 00000100:00100000:1.0:1782222199.461207:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+68:12479:x1868795060787456:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 574us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222199.461214:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 238 00000100:00100000:3.0:1782222199.471779:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222199.472155:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060787712 00000100:00100000:2.0:1782222199.472165:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060787712 00000100:00100000:2.0:1782222199.472225:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 239 00000100:00100000:2.0:1782222199.472264:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+68:12479:x1868795060787712:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782222199.472351:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e6812231 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.472366:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e6812231 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.472376:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e6812231 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782222199.472542:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1782222199.472551:0:6526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 398501315902ns, next at 399501313847ns, rc = 0 00000004:00010000:2.0:1782222199.472595:0:6526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000008dc2afd reply state 000000007f528435 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e6812231 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.472607:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e6812231 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.472614:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f0843b9b100) 00010000:00010000:2.0:1782222199.472616:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1782222199.472619:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782222199.472702:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+70:12479:x1868795060787712:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 Request processed in 468us (931us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1782222199.472709:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 239 00000100:00100000:0.0:1782222199.477521:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222199.478183:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060787840 00000100:00100000:2.0:1782222199.478193:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060787840 00000100:00100000:0.0:1782222199.478354:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 240 00000100:00100000:0.0:1782222199.478366:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+70:12479:x1868795060787840:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782222199.478389:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222199.478408:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e6812238 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75587ae expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.478466:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e6812238 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587ae expref: 71 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.478480:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e6812238 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587ae expref: 71 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.478499:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f0843b9b100) 00010000:00010000:0.0:1782222199.478502:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782222199.478520:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fcb9000, rc 0) 00000100:00100000:0.0:1782222199.478583:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+71:12479:x1868795060787840:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 219us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222199.478591:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 240 00000100:00100000:3.0:1782222199.483307:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222199.485450:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060787968 00000100:00100000:1.0:1782222199.485464:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060787968 00000100:00100000:2.0:1782222199.485649:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 70 00000100:00100000:2.0:1782222199.485659:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77bf2c2c-f408-43f9-ae59-449550631d05+9:2387:x1868795060787968:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1782222199.486226:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782222199.486585:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77bf2c2c-f408-43f9-ae59-449550631d05+10:2387:x1868795060787968:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 Request processed in 924us (3284us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1782222199.486594:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 70 00000100:00100000:3.0:1782222199.493340:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222199.493447:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060788224 00000100:00100000:1.0:1782222199.493458:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060788224 00000100:00100000:1.0:1782222199.493568:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 60 00000100:00100000:1.0:1782222199.493578:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+71:12479:x1868795060788224:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1782222199.493803:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+72:12479:x1868795060788224:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 Request processed in 226us (472us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1782222199.493812:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 60 00000100:00100000:0.0:1782222199.497740:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222199.498100:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060788480 00000100:00100000:1.0:1782222199.498124:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060788480 00000100:00100000:1.0:1782222199.498186:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 241 00000100:00100000:1.0:1782222199.498196:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+72:12479:x1868795060788480:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1782222199.498345:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+72:12479:x1868795060788480:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 Request processed in 150us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222199.498353:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 241 00000100:00100000:3.0:1782222199.506358:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222199.507497:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060788608 00000100:00100000:1.0:1782222199.507509:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060788608 00000100:00100000:1.0:1782222199.507580:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 242 00000100:00100000:1.0:1782222199.507591:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+72:12479:x1868795060788608:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782222199.507608:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222199.507629:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e681223f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75587b5 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.507701:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6812246 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.507727:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6812246 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.507738:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6812246 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782222199.507998:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782222199.508019:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6812246 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.508045:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744dc00/0xe2b7cc26e681223f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587b5 expref: 74 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.508085:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6812246 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587b5 expref: 73 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.508094:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f0843b9b100) 00010000:00010000:1.0:1782222199.508096:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1782222199.508100:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744d400, rc 0) 00000100:00100000:1.0:1782222199.508170:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+73:12479:x1868795060788608:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 581us (1822us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222199.508178:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 242 00000100:00100000:3.0:1782222199.511311:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222199.511494:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060788736 00000100:00100000:1.0:1782222199.511504:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060788736 00000100:00100000:1.0:1782222199.511562:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 71 00000100:00100000:1.0:1782222199.511572:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+10:2389:x1868795060788736:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782222199.511589:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222199.511609:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac77c6d5/0xe2b7cc26e681224d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75587bc expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782222199.511635:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3a8d76, blocks: 0x0 00010000:00010000:1.0:1782222199.511652:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=398s v=(0 0) 00010000:00010000:1.0:1782222199.511657:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222199.511667:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac77c6d5/0xe2b7cc26e681224d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587bc expref: 11 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.511684:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ac77c6d5/0xe2b7cc26e681224d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587bc expref: 11 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.511717:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744d600, rc 0) 00000100:00100000:1.0:1782222199.512988:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+11:2389:x1868795060788736:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 1408us (1676us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222199.512998:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 71 00000100:00100000:3.0:1782222199.528326:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222199.529271:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060788992 00000100:00100000:2.0:1782222199.529283:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060788992 00000100:00100000:3.0:1782222199.529395:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 243 00000100:00100000:3.0:1782222199.529409:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+73:12479:x1868795060788992:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1782222199.529574:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+73:12479:x1868795060788992:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 Request processed in 165us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222199.529581:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 243 00000100:00100000:2.0:1782222199.536539:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222199.536680:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060789120 00000100:00100000:0.0:1782222199.536689:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060789120 00000100:00100000:0.0:1782222199.536802:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 72 00000100:00100000:0.0:1782222199.536813:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074767b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77bf2c2c-f408-43f9-ae59-449550631d05+11:12479:x1868795060789120:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782222199.536831:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222199.536847:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c308adb0/0xe2b7cc26e6812254 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75587c3 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.536875:0:14437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac77c6d5/0xe2b7cc26e681224d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587bc expref: 12 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.536884:0:14437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782222199.536888:0:14437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782222199.536893:0:14437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c308adb0/0xe2b7cc26e6812254 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587c3 expref: 12 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.536939:0:14437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ac77c6d5/0xe2b7cc26e681224d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587bc expref: 12 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.536953:0:14437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ac77c6d5/0xe2b7cc26e681224d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587bc expref: 12 pid: 8442 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222199.536990:0:14437:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14437:1868795081816320:192.168.203.27@tcp:104: 00000100:00100000:0.0:1782222199.537076:0:14437:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0841254780 going to sleep for 11 seconds 00000100:00100000:0.0:1782222199.541296:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222199.544003:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060789248 00000100:00100000:3.0:1782222199.544018:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060789248 00010000:00010000:3.0:1782222199.544067:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ac77c6d5/0xe2b7cc26e681224d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587bc expref: 13 pid: 8442 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222199.544114:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 99 00000100:00100000:3.0:1782222199.544123:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77bf2c2c-f408-43f9-ae59-449550631d05+13:2390:x1868795060789248:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782222199.544150:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222199.544170:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ac77c6d5/0xe2b7cc26e681224d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587bc expref: 13 pid: 8442 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.544184:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ac77c6d5/0xe2b7cc26e681224d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587bc expref: 13 pid: 8442 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.544209:0:6512:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782222199.544213:0:6512:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782222199.544221:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c308adb0/0xe2b7cc26e6812254 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587c3 expref: 13 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.544230:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c308adb0/0xe2b7cc26e6812254 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587c3 expref: 13 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.544308:0:6512:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c308adb0/0xe2b7cc26e6812254 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587c3 expref: 13 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222199.544322:0:6512:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08412adf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6512:1868795081816448:192.168.203.27@tcp:105: 00000100:00100000:3.0:1782222199.544415:0:6512:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08485ec480 going to sleep for 11 seconds 00010000:00010000:2.0:1782222199.545635:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac77c6d5/0xe2b7cc26e681224d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587bc expref: 13 pid: 8442 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222199.545812:0:14437:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14437:1868795081816320:192.168.203.27@tcp:104: 00010000:00010000:2.0:1782222199.545922:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c308adb0/0xe2b7cc26e6812254 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587c3 expref: 12 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.545937:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fcb9400, rc 0) 00000100:00100000:3.0:1782222199.546984:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074767b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77bf2c2c-f408-43f9-ae59-449550631d05+12:12479:x1868795060789120:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 10167us (10448us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222199.546996:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 72 00000100:00100000:3.0:1782222199.549728:0:6512:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08412adf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6512:1868795081816448:192.168.203.27@tcp:105: 00010000:00010000:3.0:1782222199.549879:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782222199.550007:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77bf2c2c-f408-43f9-ae59-449550631d05+11:2390:x1868795060789248:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 5883us (8729us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222199.550018:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 99 00000100:00100000:0.0:1782222199.558189:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222199.558344:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060789376 00000100:00100000:3.0:1782222199.558353:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060789376 00002000:00100000:3.0:1782222199.558572:0:8446:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff8f0747cfed80 x1868795060789376/t0(0) o4->77bf2c2c-f408-43f9-ae59-449550631d05@192.168.203.27@tcp:165/0 lens 504/0 e 0 to 0 dl 1782222210 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782222199.558583:0:8446:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f0747cfed80 with x1868795060789376 ext(0->12) 00002000:00010000:3.0:1782222199.558589:0:8446:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f0747cfed80 00000100:00100000:3.0:1782222199.558632:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 6 00000100:00100000:3.0:1782222199.558643:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77bf2c2c-f408-43f9-ae59-449550631d05+11:2388:x1868795060789376:12345-192.168.203.27@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1782222199.560132:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:77bf2c2c-f408-43f9-ae59-449550631d05+13:2388:x1868795060789376:12345-192.168.203.27@tcp:4:lhsmtool_posix.0 Request processed in 1476us (1937us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1782222199.560145:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 6 00002000:00100000:3.0:1782222199.560154:0:8446:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff8f0747cfed80 x1868795060789376/t4294967321(0) o4->77bf2c2c-f408-43f9-ae59-449550631d05@192.168.203.27@tcp:165/0 lens 504/448 e 0 to 0 dl 1782222210 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782222199.560164:0:8446:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f0747cfed80 with x1868795060789376 ext(0->12) 00002000:00010000:3.0:1782222199.560170:0:8446:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f0747cfed80 00000100:00100000:3.0:1782222199.567508:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222199.570276:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060789504 00000100:00100000:2.0:1782222199.570292:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060789504 00000100:00100000:2.0:1782222199.570370:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 244 00000100:00100000:2.0:1782222199.570380:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+73:12479:x1868795060789504:12345-192.168.203.27@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1782222199.574519:0:6505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:2.0:1782222199.574540:0:6505:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:2.0:1782222199.574580:0:6505:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:2.0:1782222199.574603:0:6505:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f086b778540 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1782222199.574616:0:6505:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8f085fc81500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f086b7783c0 00000020:00080000:2.0:1782222199.574619:0:6505:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8f085fc81900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f0747c72a00 00000004:00080000:2.0:1782222199.574643:0:6505:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:2.0:1782222199.574669:0:6505:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f08490a2e40 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1782222199.574673:0:6505:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8f087ff4cf00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f086b63ec00 00000020:00080000:2.0:1782222199.574676:0:6505:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8f087ff4c700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f0747416600 00000020:00080000:1.0:1782222199.574847:0:6558:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:2.0:1782222199.574851:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+27:12479:x1868795060789504:12345-192.168.203.27@tcp:44:lhsmtool_posix.0 Request processed in 4466us (7347us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222199.574864:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 244 00000020:00080000:1.0:1782222199.574948:0:6558:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1782222199.574974:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081816576:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782222199.575067:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222199.575105:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081816576 00000100:00100000:2.0:1782222199.575114:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081816576 00000100:00100000:1.0:1782222199.575477:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782222199.575493:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747781f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3653:x1868795081816576:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782222199.575526:0:8442:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:1.0:1782222199.575565:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a3a8d75, atime: 0x6a3a8d75, ctime: 0x6a3a8d75, blocks: 0x8 00010000:00010000:1.0:1782222199.575583:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac77c6d5/0xe2b7cc26e681225b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.575603:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=398s v=(0 0) 00010000:00010000:1.0:1782222199.575608:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222199.575615:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac77c6d5/0xe2b7cc26e681225b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.575635:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac77c6d5/0xe2b7cc26e681225b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.575647:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac77c6d5/0xe2b7cc26e681225b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.575669:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac77c6d5/0xe2b7cc26e681225b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.575693:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782222199.575857:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747781f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3653:x1868795081816576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 368us (792us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1782222199.575866:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00010000:1.0:1782222199.575895:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782222199.575903:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac77c6d5/0xe2b7cc26e681225b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.575925:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744d600 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:1.0:1782222199.575930:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac77c6d5/0xe2b7cc26e681225b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.575940:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac77c6d5/0xe2b7cc26e681225b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.575961:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac77c6d5/0xe2b7cc26e681225b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.575969:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac77c6d5/0xe2b7cc26e681225b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.575994:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222199.576002:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222199.576004:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782222199.576045:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f0747780e00/2, rc 0, transno 4294967311 00000100:00100000:1.0:1782222199.576053:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081816576:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782222199.578105:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782222199.578127:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081816832:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1782222199.578190:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222199.578260:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782222199.578268:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081816704:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782222199.578293:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222199.578370:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081816832 00000100:00100000:2.0:1782222199.578377:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081816832 00000100:00100000:2.0:1782222199.578423:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081816704 00000100:00100000:2.0:1782222199.578426:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081816704 00000100:00100000:2.0:1782222199.578448:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782222199.578456:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3656:x1868795081816832:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1782222199.578590:0:8443:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1782222199.578594:0:8443:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1782222198 00002000:00010000:2.0:1782222199.578596:0:8443:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1782222199.578598:0:8443:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1782222198 -> 1782222198 00002000:00010000:2.0:1782222199.578600:0:8443:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1782222199.578642:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3656:x1868795081816832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 186us (451us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1782222199.578649:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782222199.578666:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1782222199.578672:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3653:x1868795081816704:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782222199.578685:0:8443:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:2.0:1782222199.578700:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000845cdfa1/0xe2b7cc26e6812262 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.578719:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb9f395d/0xe2b7cc26e681200f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755871b expref: 12 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.578728:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1782222199.578732:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782222199.578736:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000845cdfa1/0xe2b7cc26e6812262 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.578785:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eb9f395d/0xe2b7cc26e681200f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755871b expref: 12 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.578800:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eb9f395d/0xe2b7cc26e681200f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755871b expref: 12 pid: 8443 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222199.578812:0:8443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074767b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8443:1868795081816960:192.168.203.27@tcp:104: 00010000:00010000:3.0:1782222199.581589:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e6811f59 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.581606:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e6811f59 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.581613:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e6811f59 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.581634:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746431e00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222199.581639:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e6811f59 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.581647:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e6811f59 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.581663:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f0842e7f800) 00010000:00010000:3.0:1782222199.581666:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222199.581671:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e6811f59 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.581677:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431e00/0xe2b7cc26e6811f59 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.581710:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8800/0xe2b7cc26e6812001 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.581717:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8800/0xe2b7cc26e6812001 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.581723:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8800/0xe2b7cc26e6812001 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.581728:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb8800 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222199.581731:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8800/0xe2b7cc26e6812001 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.581736:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8800/0xe2b7cc26e6812001 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.581767:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f0849b72200) 00010000:00010000:3.0:1782222199.581770:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222199.581774:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8800/0xe2b7cc26e6812001 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.581779:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8800/0xe2b7cc26e6812001 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.581799:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e681207f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.581805:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e681207f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.581811:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e681207f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.581816:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744ce00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222199.581818:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e681207f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.581825:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e681207f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.581832:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f0843b9b300) 00010000:00010000:3.0:1782222199.581834:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222199.581837:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e681207f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.581843:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e681207f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.581868:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e68120a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.581873:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e68120a2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.581879:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e68120a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.581884:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83000 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222199.581887:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e68120a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.581892:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e68120a2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.581901:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f0843b9b300) 00010000:00010000:3.0:1782222199.581903:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222199.581906:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e68120a2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.581911:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e68120a2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.581925:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6812174 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.581932:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6812174 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.581938:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6812174 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.581948:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744c200 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222199.581952:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6812174 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.581958:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6812174 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.581966:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:3.0:1782222199.581968:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222199.581971:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6812174 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.581977:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e6812174 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.581988:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e6812231 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.581994:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e6812231 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.582000:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e6812231 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.582005:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83800 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222199.582008:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e6812231 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.582014:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e6812231 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.582029:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f0843b9b100) 00010000:00010000:3.0:1782222199.582032:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782222199.582034:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e6812231 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.582040:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e6812231 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782222199.582141:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f0747cfd180/2, rc 0, transno 4294967322 00000100:00100000:3.0:1782222199.582150:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081816832:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1782222199.583799:0:8443:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875d4ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1782222199.587878:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222199.589303:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060789632 00000100:00100000:0.0:1782222199.589318:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060789632 00000100:00100000:0.0:1782222199.589399:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 76 00000100:00100000:0.0:1782222199.589411:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77bf2c2c-f408-43f9-ae59-449550631d05+13:2390:x1868795060789632:12345-192.168.203.27@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1782222199.592564:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222199.592633:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060789760 00000100:00100000:3.0:1782222199.592641:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060789760 00010000:00010000:3.0:1782222199.592677:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eb9f395d/0xe2b7cc26e681200f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755871b expref: 14 pid: 8443 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222199.592726:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 100 00000100:00100000:3.0:1782222199.592736:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747679180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+14:2390:x1868795060789760:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782222199.592750:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222199.592764:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eb9f395d/0xe2b7cc26e681200f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755871b expref: 14 pid: 8443 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.592779:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eb9f395d/0xe2b7cc26e681200f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755871b expref: 14 pid: 8443 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.592804:0:6513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782222199.592808:0:6513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782222199.592821:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000845cdfa1/0xe2b7cc26e6812262 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.592832:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000845cdfa1/0xe2b7cc26e6812262 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.592853:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782222199.592915:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747679180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+14:2390:x1868795060789760:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 179us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222199.592922:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 100 00010000:00010000:1.0:1782222199.594013:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb9f395d/0xe2b7cc26e681200f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755871b expref: 13 pid: 8443 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222199.594032:0:8443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074767b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8443:1868795081816960:192.168.203.27@tcp:104: 00010000:00010000:1.0:1782222199.594058:0:8443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000845cdfa1/0xe2b7cc26e6812262 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.594070:0:8443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000845cdfa1/0xe2b7cc26e6812262 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.594077:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000845cdfa1/0xe2b7cc26e6812262 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.594088:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000845cdfa1/0xe2b7cc26e6812262 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.594109:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000845cdfa1/0xe2b7cc26e6812262 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.594132:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782222199.594146:0:7468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782222199.594153:0:7468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000845cdfa1/0xe2b7cc26e6812262 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.594161:0:7468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83c00 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:3.0:1782222199.594165:0:7468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000845cdfa1/0xe2b7cc26e6812262 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.594174:0:7468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000845cdfa1/0xe2b7cc26e6812262 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.594189:0:7468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000845cdfa1/0xe2b7cc26e6812262 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.594195:0:7468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000845cdfa1/0xe2b7cc26e6812262 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.594227:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222199.594229:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222199.594230:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782222199.594494:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3653:x1868795081816704:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15820us (16198us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1782222199.594509:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:0.0:1782222199.594731:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f0747cfea00/2, rc 0, transno 4294967323 00000100:00100000:0.0:1782222199.594738:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081816704:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1782222199.595525:0:8436:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:1.0:1782222199.595536:0:8436:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:0.0:1782222199.595689:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77bf2c2c-f408-43f9-ae59-449550631d05+7:2390:x1868795060789632:12345-192.168.203.27@tcp:16:lhsmtool_posix.0 Request processed in 6278us (7819us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222199.595707:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 76 00000100:00100000:2.0:1782222199.606190:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222199.606448:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060790016 00000100:00100000:0.0:1782222199.606459:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060790016 00000100:00100000:0.0:1782222199.606517:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 245 00000100:00100000:0.0:1782222199.606527:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074767a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+21:12479:x1868795060790016:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782222199.606594:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222199.606622:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e6812246 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587b5 expref: 21 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.606640:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f0843b9b100) 00010000:00010000:0.0:1782222199.606644:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782222199.606674:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812269 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.606686:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812269 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.606694:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812269 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782222199.606831:0:8465:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000080285f16 reply state 000000005ebca970 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812269 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.606845:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812269 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.606851:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f0843b9b100) 00010000:00010000:0.0:1782222199.606854:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782222199.606857:0:8465:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782222199.607278:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074767a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+22:12479:x1868795060790016:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 Request processed in 750us (1094us total) trans 4294967509 rc 0/0 00000100:00100000:0.0:1782222199.607287:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 245 00000100:00100000:1.0:1782222199.611812:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222199.611895:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060790144 00000100:00100000:3.0:1782222199.611916:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060790144 00000100:00100000:3.0:1782222199.611975:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 77 00000100:00100000:3.0:1782222199.612098:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77bf2c2c-f408-43f9-ae59-449550631d05+7:2389:x1868795060790144:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1782222199.612264:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1782222199.612267:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1782222198 -> 1782222198 00002000:00010000:3.0:1782222199.612273:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1782222197 00002000:00010000:3.0:1782222199.612275:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1782222198 -> 1782222198 00002000:00010000:3.0:1782222199.612278:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1782222199.612633:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:77bf2c2c-f408-43f9-ae59-449550631d05+8:2389:x1868795060790144:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 Request processed in 539us (829us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1782222199.612642:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 77 00000100:00100000:3.0:1782222199.615477:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222199.615566:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060790400 00000100:00100000:1.0:1782222199.615576:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060790400 00000100:00100000:1.0:1782222199.615639:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 246 00000100:00100000:1.0:1782222199.615650:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+22:12479:x1868795060790400:12345-192.168.203.27@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1782222199.615720:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812270 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.615737:0:13817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e681222a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587a7 expref: 22 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.615747:0:13817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812270 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.615787:0:13817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e681222a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587a7 expref: 22 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.615800:0:13817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e681222a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587a7 expref: 22 pid: 13817 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222199.615813:0:13817:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747782a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13817:1868795081817088:192.168.203.27@tcp:104: 00000100:00100000:1.0:1782222199.615892:0:13817:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b778b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782222199.621508:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222199.621710:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060790528 00000100:00100000:0.0:1782222199.621719:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060790528 00010000:00010000:0.0:1782222199.621767:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e681222a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587a7 expref: 23 pid: 13817 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222199.621823:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 101 00000100:00100000:0.0:1782222199.621833:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747679c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77bf2c2c-f408-43f9-ae59-449550631d05+23:2390:x1868795060790528:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782222199.621848:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222199.621855:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e681222a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587a7 expref: 23 pid: 13817 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.621868:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e681222a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587a7 expref: 23 pid: 13817 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.621891:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f0843b9b100) 00010000:00010000:0.0:1782222199.621896:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812270 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.621914:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812270 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.621922:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812270 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.621942:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782222199.622006:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747679c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77bf2c2c-f408-43f9-ae59-449550631d05+23:2390:x1868795060790528:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 173us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222199.622014:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 101 00010000:00010000:1.0:1782222199.622585:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744de00/0xe2b7cc26e681222a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587a7 expref: 22 pid: 13817 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222199.622615:0:13817:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747782a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13817:1868795081817088:192.168.203.27@tcp:104: 00010000:00010000:1.0:1782222199.622636:0:13817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812270 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.622645:0:13817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812270 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.622651:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812270 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.622685:0:13817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812270 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.622692:0:13817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812270 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.622710:0:13817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812270 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.622715:0:13817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744ca00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222199.622720:0:13817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812270 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.622727:0:13817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812270 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.622738:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f0843b9b100) 00010000:00010000:1.0:1782222199.622741:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1782222199.622744:0:13817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812270 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.622768:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812270 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222199.622827:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+21:12479:x1868795060790400:12345-192.168.203.27@tcp:55:lhsmtool_posix.0 Request processed in 7178us (7357us total) trans 0 rc -22/-22 00000100:00100000:1.0:1782222199.622835:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 246 00000100:00100000:2.0:1782222199.627142:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222199.627443:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060790656 00000100:00100000:0.0:1782222199.627453:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060790656 00000100:00100000:0.0:1782222199.627509:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 78 00000100:00100000:0.0:1782222199.627519:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+8:2390:x1868795060790656:12345-192.168.203.27@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1782222199.627576:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cebe4ef7/0xe2b7cc26e6812277 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.627596:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c308adb0/0xe2b7cc26e6812254 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587c3 expref: 8 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.627605:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782222199.627609:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782222199.627613:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cebe4ef7/0xe2b7cc26e6812277 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.627646:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c308adb0/0xe2b7cc26e6812254 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587c3 expref: 8 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.627659:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c308adb0/0xe2b7cc26e6812254 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587c3 expref: 8 pid: 14437 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222199.627672:0:8442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cfc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8442:1868795081817216:192.168.203.27@tcp:104: 00000100:00100000:0.0:1782222199.627771:0:8442:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08490a20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782222199.629950:0:8442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cfc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8442:1868795081817216:192.168.203.27@tcp:104: 00010000:00010000:2.0:1782222199.629977:0:8442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cebe4ef7/0xe2b7cc26e6812277 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222199.633579:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222199.633670:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060790784 00000100:00100000:3.0:1782222199.633680:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060790784 00010000:00010000:3.0:1782222199.633718:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c308adb0/0xe2b7cc26e6812254 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587c3 expref: 9 pid: 14437 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222199.633766:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 102 00000100:00100000:3.0:1782222199.633777:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074767b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+9:2389:x1868795060790784:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782222199.633790:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222199.633811:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c308adb0/0xe2b7cc26e6812254 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587c3 expref: 9 pid: 14437 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.633839:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c308adb0/0xe2b7cc26e6812254 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587c3 expref: 9 pid: 14437 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.633862:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c308adb0/0xe2b7cc26e6812254 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587c3 expref: 9 pid: 14437 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.633879:0:6513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782222199.633883:0:6513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782222199.633889:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cebe4ef7/0xe2b7cc26e6812277 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.633899:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cebe4ef7/0xe2b7cc26e6812277 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.633949:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782222199.634020:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074767b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+8:2389:x1868795060790784:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 243us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222199.634028:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 102 00010000:00010000:0.0:1782222199.634900:0:8442:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cebe4ef7/0xe2b7cc26e6812277 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.634923:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cebe4ef7/0xe2b7cc26e6812277 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.634946:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cebe4ef7/0xe2b7cc26e6812277 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.634965:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cebe4ef7/0xe2b7cc26e6812277 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.634971:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cebe4ef7/0xe2b7cc26e6812277 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.634978:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb9200 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:0.0:1782222199.634982:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cebe4ef7/0xe2b7cc26e6812277 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.635002:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cebe4ef7/0xe2b7cc26e6812277 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.635016:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cebe4ef7/0xe2b7cc26e6812277 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.635022:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cebe4ef7/0xe2b7cc26e6812277 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222199.635367:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+7:2390:x1868795060790656:12345-192.168.203.27@tcp:1:lhsmtool_posix.0 Request processed in 7846us (8231us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222199.635376:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 78 00000100:00100000:2.0:1782222199.645707:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222199.649808:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060791040 00000100:00100000:0.0:1782222199.649823:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060791040 00000100:00100000:0.0:1782222199.649966:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 247 00000100:00100000:0.0:1782222199.650002:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074767b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+21:12479:x1868795060791040:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1782222199.650082:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e681227e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.650098:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e681216d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755876f expref: 21 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.650119:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e681227e lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.650155:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e681216d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755876f expref: 21 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.650168:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e681216d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755876f expref: 21 pid: 6527 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222199.650182:0:6526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cfce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6526:1868795081817344:192.168.203.27@tcp:104: 00000100:00100000:0.0:1782222199.650287:0:6526:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08490a20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782222199.655767:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222199.655859:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060791168 00000100:00100000:3.0:1782222199.655869:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060791168 00010000:00010000:3.0:1782222199.655922:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e681216d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755876f expref: 22 pid: 6527 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222199.655967:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 103 00000100:00100000:3.0:1782222199.655976:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77bf2c2c-f408-43f9-ae59-449550631d05+22:2390:x1868795060791168:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782222199.656022:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222199.656030:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e681216d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755876f expref: 22 pid: 6527 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.656043:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e681216d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755876f expref: 22 pid: 6527 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.656067:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:3.0:1782222199.656073:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e68121cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558792 expref: 22 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.656083:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e681227e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.656090:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e681227e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.656099:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e681227e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.656116:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782222199.656165:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77bf2c2c-f408-43f9-ae59-449550631d05+22:2390:x1868795060791168:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 190us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222199.656173:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 103 00010000:00010000:1.0:1782222199.656797:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e681216d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755876f expref: 21 pid: 6527 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222199.656817:0:6526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cfce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6526:1868795081817344:192.168.203.27@tcp:104: 00010000:00010000:1.0:1782222199.656838:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e681227e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.656847:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e681227e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.656852:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e681227e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.657024:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812285 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.657036:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e6812238 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587ae expref: 21 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.657043:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812285 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.657070:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e6812238 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587ae expref: 21 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.657094:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e6812238 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587ae expref: 21 pid: 8465 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222199.657108:0:6526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747782a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6526:1868795081817472:192.168.203.27@tcp:104: 00000100:00100000:1.0:1782222199.657226:0:6526:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b778d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782222199.663832:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222199.663937:0:6526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747782a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6526:1868795081817472:192.168.203.27@tcp:104: 00010000:00010000:1.0:1782222199.663966:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812285 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222199.664136:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060791296 00000100:00100000:3.0:1782222199.664144:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060791296 00010000:00010000:3.0:1782222199.664180:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e6812238 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587ae expref: 22 pid: 8465 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222199.664273:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 104 00000100:00100000:3.0:1782222199.664283:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+22:2390:x1868795060791296:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782222199.664298:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222199.664305:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e6812238 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587ae expref: 22 pid: 8465 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.664317:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e6812238 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587ae expref: 22 pid: 8465 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.664338:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e6812238 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587ae expref: 22 pid: 8465 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.664354:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f0843b9b100) 00010000:00010000:3.0:1782222199.664359:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812285 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.664369:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812285 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.664376:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812285 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.664399:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782222199.664447:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+21:2390:x1868795060791296:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 166us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222199.664454:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 104 00010000:00010000:1.0:1782222199.664529:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812285 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.664536:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812285 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782222199.664641:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1782222199.664753:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:1.0:1782222199.664797:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1782222199.664869:0:6526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747782a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6526:1868795081817600:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1782222199.665103:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222199.665140:0:6526:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b778300 going to sleep for 11 seconds 00000100:00100000:3.0:1782222199.665279:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081817600 00000100:00100000:3.0:1782222199.665294:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081817600 00000100:00100000:3.0:1782222199.665337:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1782222199.665345:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6526:x1868795081817600:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1782222199.665417:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6526:x1868795081817600:12345-0@lo:1000:mdt00_000.0 Request processed in 73us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222199.665425:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1782222199.667621:0:6526:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:1.0:1782222199.667635:0:6526:0:(osp_trans.c:1042:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:1.0:1782222199.667655:0:6526:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f0747cfd180, transno 4294967322 00000100:00100000:1.0:1782222199.667671:0:6526:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff8f0747cfea00 x1868795081816704/t4294967323(4294967323) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1782222215 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222199.667684:0:6526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747782a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6526:1868795081817600:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1782222199.667888:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:1.0:1782222199.667975:0:6526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747782a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6526:1868795081817728:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1782222199.668175:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222199.668219:0:6526:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b778840 going to sleep for 11 seconds 00000100:00100000:2.0:1782222199.668373:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081817728 00000100:00100000:2.0:1782222199.668381:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081817728 00000100:00100000:2.0:1782222199.668428:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1782222199.668437:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6526:x1868795081817728:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782222199.672293:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6526:x1868795081817728:12345-0@lo:1000:mdt00_000.0 Request processed in 3846us (4107us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1782222199.672327:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1782222199.672522:0:6526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747782a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6526:1868795081817728:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1782222199.672577:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812285 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.672588:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812285 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.672595:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812285 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.672601:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744ca00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222199.672606:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812285 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.672613:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812285 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.672627:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f0843b9b100) 00010000:00010000:1.0:1782222199.672630:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782222199.672634:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812285 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.672641:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ca00/0xe2b7cc26e6812285 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.672666:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e68121c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.672679:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e68121c8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.672686:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e68121c8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.672691:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb8c00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222199.672694:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e68121c8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.672767:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e68121c8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.672776:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:1.0:1782222199.672779:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782222199.672786:0:6526:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e68121cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558792 expref: 24 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.672798:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e68121cf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558792 expref: 24 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.672807:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e68121cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558792 expref: 24 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.672845:0:6526:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e68121cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558792 expref: 24 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222199.672859:0:6526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747783100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6526:1868795081817856:192.168.203.27@tcp:105: 00000100:00100000:1.0:1782222199.673318:0:6526:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746166cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782222199.688687:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222199.691033:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060791424 00000100:00100000:2.0:1782222199.691047:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060791424 00000100:00100000:2.0:1782222199.691117:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 61 00000100:00100000:2.0:1782222199.691126:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+25:12478:x1868795060791424:12345-192.168.203.27@tcp:49:lfs.0 00000100:00100000:2.0:1782222199.691280:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+25:12478:x1868795060791424:12345-192.168.203.27@tcp:49:lfs.0 Request processed in 153us (2601us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222199.691287:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 61 00000100:00100000:1.0:1782222199.695248:0:6526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747783100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6526:1868795081817856:192.168.203.27@tcp:105: 00010000:00010000:1.0:1782222199.695282:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e68121c8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.695293:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8c00/0xe2b7cc26e68121c8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.695429:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e681228c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.695444:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e681228c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.695456:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e681228c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.695485:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e681228c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.695491:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e681228c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.695497:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e681228c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.695503:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb9800 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222199.695507:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e681228c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.695514:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e681228c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.695526:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:0.0:1782222199.695528:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782222199.695532:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e681228c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.695537:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e681228c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.695547:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e681227e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.695553:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e681227e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.695558:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e681227e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.695572:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb9200 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222199.695575:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e681227e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.695581:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e681227e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.695589:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:0.0:1782222199.695591:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782222199.695594:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e681227e lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222199.695599:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9200/0xe2b7cc26e681227e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222199.695780:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074767b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+24:12479:x1868795060791040:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 Request processed in 45781us (50081us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1782222199.695791:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 247 00000020:00080000:0.0:1782222199.695797:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1782222199.696018:0:13806:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782222199.696023:0:13806:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782222199.696563:0:13806:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1782222199.696573:0:13806:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782222199.700000:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222199.700128:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060791680 00000100:00100000:1.0:1782222199.700138:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060791680 00000100:00100000:1.0:1782222199.700209:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 248 00000100:00100000:1.0:1782222199.700219:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+24:12478:x1868795060791680:12345-192.168.203.27@tcp:58:lfs.0 00000040:00080000:1.0:1782222199.700421:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1782222199.700502:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+24:12478:x1868795060791680:12345-192.168.203.27@tcp:58:lfs.0 Request processed in 283us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222199.700510:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 248 00000100:00100000:3.0:1782222199.716823:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222199.716934:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060791936 00000100:00100000:2.0:1782222199.716944:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060791936 00000100:00100000:2.0:1782222199.717010:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 62 00000100:00100000:2.0:1782222199.717019:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087d4b8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+24:12479:x1868795060791936:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1782222199.717332:0:6530:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1782222199.717367:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:2.0:1782222199.717399:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6812293 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.717415:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6812293 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.717424:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6812293 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.717433:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6812293 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.717438:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6812293 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.717475:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6812293 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222199.717492:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782222199.717579:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087d4b8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+26:12479:x1868795060791936:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 Request processed in 559us (764us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1782222199.717588:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 62 00000020:00080000:2.0:1782222199.717593:0:6530:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782222199.717836:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782222199.717844:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6812293 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.717851:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83e00 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:3.0:1782222199.717855:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6812293 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.717863:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6812293 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.717878:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f0843b9b100) 00010000:00010000:3.0:1782222199.717881:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782222199.717884:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6812293 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.717890:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e6812293 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.717901:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222199.717903:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222199.717905:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222199.733889:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222199.734104:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060792064 00000100:00100000:1.0:1782222199.734114:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060792064 00000100:00100000:1.0:1782222199.734175:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 249 00000100:00100000:1.0:1782222199.734186:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+26:12481:x1868795060792064:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:1.0:1782222199.734210:0:13817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222199.734230:0:13817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e681229a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75587ca expref: -99 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.734357:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68122a1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.734371:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68122a1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.734381:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68122a1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.734395:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e68122a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.734403:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e68122a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.734409:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e68122a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.734484:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e68122af lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.734495:0:13817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e68121ba lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755878b expref: 27 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.734503:0:13817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e68122af lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.734536:0:13817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e68121ba lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755878b expref: 27 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.734560:0:13817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e68121ba lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755878b expref: 27 pid: 6527 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222199.734573:0:13817:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747783100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13817:1868795081817984:192.168.203.27@tcp:104: 00000100:00100000:1.0:1782222199.734660:0:13817:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b778840 going to sleep for 11 seconds 00000100:00100000:1.0:1782222199.738220:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222199.738572:0:13817:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747783100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13817:1868795081817984:192.168.203.27@tcp:104: 00010000:00010000:3.0:1782222199.738611:0:13817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e68122af lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222199.739871:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060792320 00000100:00100000:2.0:1782222199.739886:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060792320 00000100:00100000:2.0:1782222199.739967:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 63 00000100:00100000:2.0:1782222199.739977:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+28:6159:x1868795060792320:12345-192.168.203.27@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1782222199.740286:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+29:6159:x1868795060792320:12345-192.168.203.27@tcp:35:ldlm_bl.0 Request processed in 308us (2075us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1782222199.740294:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 63 00000100:00100000:0.0:1782222199.743882:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222199.744096:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060792448 00000100:00100000:3.0:1782222199.744106:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060792448 00010000:00010000:3.0:1782222199.744150:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e68121ba lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755878b expref: 29 pid: 6527 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222199.744231:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 105 00000100:00100000:3.0:1782222199.744270:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08413a3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77bf2c2c-f408-43f9-ae59-449550631d05+29:2390:x1868795060792448:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782222199.744285:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222199.744292:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e68121ba lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755878b expref: 29 pid: 6527 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.744306:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e68121ba lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755878b expref: 29 pid: 6527 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.744330:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c800/0xe2b7cc26e68121ba lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755878b expref: 29 pid: 6527 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.744345:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:3.0:1782222199.744350:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e68122af lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.744359:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e68122af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.744366:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e68122af lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222199.744412:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782222199.744466:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08413a3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77bf2c2c-f408-43f9-ae59-449550631d05+28:2390:x1868795060792448:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 198us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222199.744473:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 105 00010000:00010000:1.0:1782222199.744558:0:13817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e68122af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.744567:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e68122af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782222199.744616:0:13817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1782222199.744620:0:13817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782222199.744639:0:13817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e68122af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.744650:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e68122af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.744659:0:13817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68122a1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.744665:0:13817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68122a1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.744672:0:13817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68122a1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.744677:0:13817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744d400 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222199.744689:0:13817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68122a1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.744709:0:13817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68122a1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.744719:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:1.0:1782222199.744722:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222199.744725:0:13817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68122a1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.744730:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d400/0xe2b7cc26e68122a1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.744741:0:13817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e68122a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.744747:0:13817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e68122a8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.744752:0:13817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e68122a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.744765:0:13817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744d600 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222199.744768:0:13817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e68122a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.744774:0:13817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e68122a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.744780:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f0842e7fc00) 00010000:00010000:1.0:1782222199.744782:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222199.744795:0:13817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e68122a8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.744801:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d600/0xe2b7cc26e68122a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.744836:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c000/0xe2b7cc26e681229a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587ca expref: 28 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.744849:0:13817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e68122af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587ca expref: 27 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222199.744856:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:1.0:1782222199.744858:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782222199.744860:0:13817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744c200, rc 0) 00000100:00100000:1.0:1782222199.744887:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+27:12481:x1868795060792064:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 10703us (11007us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222199.744893:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 249 00010000:00010000:0.0:1782222200.362545:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782222200.458256:0:14771:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782222200.458266:0:14771:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782222200.458300:0:14771:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1782222200.458306:0:14771:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1782222200.748839:0:13806:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782222200.748849:0:13806:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782222200.748871:0:13806:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1782222200.748879:0:13806:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782222200.749030:0:13806:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08412ac000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1868795081818112:192.168.203.27@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782222200.749117:0:13806:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f085122b540 going to sleep for 11 seconds 00000100:00100000:3.0:1782222200.751445:0:13806:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08412ac000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1868795081818112:192.168.203.27@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782222200.753867:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222200.753963:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060792576 00000100:00100000:0.0:1782222200.753972:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060792576 00000100:00100000:0.0:1782222200.754048:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 250 00000100:00100000:0.0:1782222200.754059:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747679180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+27:12493:x1868795060792576:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782222200.754095:0:6526:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782222200.754204:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747679180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+27:12493:x1868795060792576:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 Request processed in 146us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222200.754224:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 250 00000100:00080000:1.0:1782222200.754603:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782222200.766381:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222200.766498:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060792832 00000100:00100000:2.0:1782222200.766508:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060792832 00000100:00100000:2.0:1782222200.766572:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 251 00000100:00100000:2.0:1782222200.766583:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+27:12493:x1868795060792832:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782222200.766605:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222200.766623:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e68122b6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75587d1 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222200.766727:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e68122bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222200.766770:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e68122bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222200.766781:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e68122bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782222200.766793:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1782222200.766892:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83800/0xe2b7cc26e68122b6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587d1 expref: 30 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222200.766911:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e68122bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587d1 expref: 29 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222200.766920:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:2.0:1782222200.766922:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782222200.766926:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb83000, rc 0) 00000100:00100000:2.0:1782222200.766993:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+29:12493:x1868795060792832:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 411us (619us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1782222200.767000:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 251 00000100:00100000:3.0:1782222200.774745:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222200.774943:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060793088 00000100:00100000:1.0:1782222200.774955:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060793088 00000100:00100000:1.0:1782222200.775029:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 252 00000100:00100000:1.0:1782222200.775040:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+29:12493:x1868795060793088:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1782222200.775140:0:13817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e68122cb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222200.775157:0:13817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e68122cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222200.775168:0:13817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e68122cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222200.776057:0:13817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e68122cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222200.776067:0:13817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e68122cb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222200.776074:0:13817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e68122cb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222200.776080:0:13817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744ce00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222200.776085:0:13817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e68122cb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222200.776093:0:13817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e68122cb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222200.776516:0:13817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:1.0:1782222200.776520:0:13817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782222200.776524:0:13817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e68122cb lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222200.776529:0:13817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744ce00/0xe2b7cc26e68122cb lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222200.776728:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+30:12493:x1868795060793088:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 Request processed in 1687us (1988us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1782222200.776735:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 252 00000040:00080000:3.0:1782222200.776869:0:13806:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782222200.776874:0:13806:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782222200.777414:0:13806:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1782222200.777423:0:13806:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782222200.778738:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222200.779385:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060793216 00000100:00100000:2.0:1782222200.779395:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060793216 00000100:00100000:2.0:1782222200.779524:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 20 00000100:00100000:2.0:1782222200.779535:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+30:2390:x1868795060793216:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782222200.779550:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782222200.779587:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e68122bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587d1 expref: 30 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222200.779604:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:2.0:1782222200.779608:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782222200.779678:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77bf2c2c-f408-43f9-ae59-449550631d05+29:2390:x1868795060793216:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 144us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222200.779687:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 20 00000100:00100000:3.0:1782222200.779793:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222200.782561:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060793472 00000100:00100000:3.0:1782222200.782577:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060793472 00000100:00100000:3.0:1782222200.782642:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 64 00000100:00100000:3.0:1782222200.782652:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+29:12493:x1868795060793472:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1782222200.782943:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+30:12493:x1868795060793472:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 Request processed in 291us (3149us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1782222200.782955:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 64 00000001:00080000:3.0:1782222200.824584:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:3.0:1782222200.824604:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00010000:00010000:3.0:1782222201.387525:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782222201.450905:0:13809:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1782222201.834585:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081818240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782222201.834660:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1782222201.834841:0:13806:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782222201.834847:0:13806:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782222201.834868:0:13806:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1782222201.834875:0:13806:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782222201.835052:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081818240 00000100:00100000:2.0:1782222201.835060:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081818240 00000100:00100000:2.0:1782222201.835127:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1782222201.835138:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081818240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782222201.835166:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782222201.835213:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081818240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222201.835220:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1782222201.835281:0:3656:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1782222201.835287:0:3656:0:(osp_trans.c:1042:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:2.0:1782222201.835310:0:3656:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f0847006a00, transno 4294967308 00000004:00080000:2.0:1782222201.835319:0:3656:0:(osp_trans.c:1042:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:2.0:1782222201.835330:0:3656:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f0747780e00, transno 4294967311 00000100:00100000:2.0:1782222201.835342:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081818240:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1782222201.835521:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782222201.835681:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747679c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081818368:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782222201.835715:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222201.835803:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081818368 00000100:00100000:1.0:1782222201.835819:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081818368 00000100:00100000:1.0:1782222201.835865:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1782222201.835872:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081818368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782222201.835885:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782222201.835922:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081818368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222201.835928:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1782222201.835961:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747679c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081818368:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1782222201.836110:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:1.0:1782222202.281136:0:14822:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782222202.281146:0:14822:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782222202.281180:0:14822:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1782222202.281186:0:14822:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1782222202.419149:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222202.438263:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222202.438517:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060793728 00000100:00100000:2.0:1782222202.438529:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060793728 00000100:00080000:1.0:1782222202.438574:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782222202.438595:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 253 00000100:00100000:2.0:1782222202.438875:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+30:12513:x1868795060793728:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1782222202.438910:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222202.438930:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e68122d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75587d8 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222202.439035:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e68122d9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222202.439050:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e68122d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222202.439062:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e68122d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782222202.439074:0:8465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1782222202.439174:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e68122d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587d8 expref: 33 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222202.439190:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e68122d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587d8 expref: 32 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222202.439199:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:2.0:1782222202.439202:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1782222202.439205:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb83e00, rc 0) 00000100:00100000:2.0:1782222202.439293:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+32:12513:x1868795060793728:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 687us (1058us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1782222202.439300:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 253 00000100:00100000:1.0:1782222202.454379:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222202.454786:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060793856 00000100:00100000:0.0:1782222202.454796:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060793856 00000100:00100000:0.0:1782222202.454857:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 254 00000100:00100000:0.0:1782222202.454868:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+32:12513:x1868795060793856:12345-192.168.203.27@tcp:54:lfs.0 00010000:00010000:0.0:1782222202.454930:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e68122e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222202.454948:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e68122e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222202.454960:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e68122e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222202.454993:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e68122e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222202.454999:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e68122e7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222202.455006:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e68122e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222202.455011:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb9a00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222202.455016:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e68122e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222202.455030:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e68122e7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222202.455043:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:0.0:1782222202.455046:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782222202.455050:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e68122e7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222202.455057:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e68122e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222202.455122:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+32:12513:x1868795060793856:12345-192.168.203.27@tcp:54:lfs.0 Request processed in 256us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222202.455129:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 254 00000100:00100000:3.0:1782222202.533680:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222202.534299:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060793984 00000100:00100000:0.0:1782222202.534310:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060793984 00000100:00100000:0.0:1782222202.534378:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 79 00000100:00100000:0.0:1782222202.534389:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77bf2c2c-f408-43f9-ae59-449550631d05+7:2389:x1868795060793984:12345-192.168.203.27@tcp:101:cat.0 00010000:00010000:0.0:1782222202.534409:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222202.534438:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc425e23/0xe2b7cc26e68122ee lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75587df expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782222202.534464:0:14437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a3a8d76, atime: 0x6a3a8d75, ctime: 0x6a3a8d76, blocks: 0x8 00010000:00010000:0.0:1782222202.534485:0:14437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=401s v=(0 0) 00010000:00010000:0.0:1782222202.534490:0:14437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782222202.534499:0:14437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc425e23/0xe2b7cc26e68122ee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587df expref: 8 pid: 14437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222202.534537:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bc425e23/0xe2b7cc26e68122ee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587df expref: 8 pid: 14437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222202.534550:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fcb9a00, rc 0) 00000100:00100000:0.0:1782222202.534615:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:77bf2c2c-f408-43f9-ae59-449550631d05+8:2389:x1868795060793984:12345-192.168.203.27@tcp:101:cat.0 Request processed in 228us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222202.534622:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 79 00000100:00080000:1.0:1782222202.534703:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782222202.539210:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222202.539347:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060794112 00000100:00100000:3.0:1782222202.539357:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060794112 00002000:00100000:3.0:1782222202.539408:0:8447:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff8f0747cfd500 x1868795060794112/t0(0) o3->77bf2c2c-f408-43f9-ae59-449550631d05@192.168.203.27@tcp:168/0 lens 488/0 e 0 to 0 dl 1782222213 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782222202.539420:0:8447:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f0747cfd500 with x1868795060794112 ext(0->4095) 00002000:00010000:3.0:1782222202.539426:0:8447:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f0747cfd500 00000100:00100000:3.0:1782222202.539460:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 7 00000100:00100000:3.0:1782222202.539470:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77bf2c2c-f408-43f9-ae59-449550631d05+8:2390:x1868795060794112:12345-192.168.203.27@tcp:3:cat.0 00000100:00100000:3.0:1782222202.539646:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:77bf2c2c-f408-43f9-ae59-449550631d05+8:2390:x1868795060794112:12345-192.168.203.27@tcp:3:cat.0 Request processed in 176us (443us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1782222202.539654:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 7 00002000:00100000:3.0:1782222202.539660:0:8447:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff8f0747cfd500 x1868795060794112/t0(0) o3->77bf2c2c-f408-43f9-ae59-449550631d05@192.168.203.27@tcp:168/0 lens 488/4536 e 0 to 0 dl 1782222213 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782222202.539669:0:8447:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8f0747cfd500 with x1868795060794112 ext(0->4095) 00002000:00010000:3.0:1782222202.539687:0:8447:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f0747cfd500 00000100:00100000:1.0:1782222202.858519:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782222202.858544:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081818496:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782222202.858617:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222202.858880:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081818496 00000100:00100000:0.0:1782222202.858887:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081818496 00000100:00100000:0.0:1782222202.858938:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1782222202.858948:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081818496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782222202.858984:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1782222202.859053:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081818496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222202.859061:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1782222202.859492:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081818624:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782222202.859525:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222202.859630:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081818624 00000100:00100000:3.0:1782222202.859636:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081818624 00000100:00100000:3.0:1782222202.859670:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1782222202.859678:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081818624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782222202.859698:0:7480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1782222202.859751:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081818624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222202.859758:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1782222202.859864:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081818624:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782222202.859944:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081818496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782222203.371277:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782222203.371301:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081818752:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782222203.371366:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222203.371485:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081818752 00000100:00100000:2.0:1782222203.371504:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081818752 00000100:00100000:2.0:1782222203.371572:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1782222203.371582:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081818752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782222203.371613:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782222203.371672:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081818752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222203.371680:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1782222203.371725:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081818752:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1782222203.371785:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782222203.374793:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081818880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782222203.374858:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222203.374946:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081818880 00000100:00100000:1.0:1782222203.374953:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081818880 00000100:00100000:1.0:1782222203.375005:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1782222203.375013:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074767b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3653:x1868795081818880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782222203.375034:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00080000:0.0:1782222203.378303:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782222203.380001:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074767b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3653:x1868795081818880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4982us (5136us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222203.380014:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1782222203.380518:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081818880:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782222203.434620:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222203.826090:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222203.826138:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222203.826163:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222203.826189:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222203.826209:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222203.826226:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222203.826273:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222203.826303:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060794624 00000100:00100000:2.0:1782222203.826312:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060794624 00000100:00100000:2.0:1782222203.826356:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060794752 00000100:00100000:2.0:1782222203.826359:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060794752 00000100:00100000:2.0:1782222203.826390:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 174 00000100:00100000:2.0:1782222203.826400:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77bf2c2c-f408-43f9-ae59-449550631d05+8:2390:x1868795060794624:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222203.826469:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77bf2c2c-f408-43f9-ae59-449550631d05+8:2390:x1868795060794624:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 70us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222203.826494:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 174 00000100:00100000:2.0:1782222203.826511:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 175 00000100:00100000:2.0:1782222203.826517:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060794752:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222203.826541:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060794752:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 25us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222203.826547:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 175 00000100:00100000:2.0:1782222203.826564:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060794368 00000100:00100000:2.0:1782222203.826567:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060794368 00000100:00100000:2.0:1782222203.826590:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060794880 00000100:00100000:2.0:1782222203.826593:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060794880 00000100:00100000:2.0:1782222203.826605:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060794496 00000100:00100000:2.0:1782222203.826607:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060794496 00000100:00100000:2.0:1782222203.826618:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060795008 00000100:00100000:2.0:1782222203.826620:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060795008 00000100:00100000:2.0:1782222203.826632:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 361 00000100:00100000:2.0:1782222203.826638:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+32:2390:x1868795060794368:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222203.826664:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+32:2390:x1868795060794368:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 26us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222203.826670:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 361 00000100:00100000:2.0:1782222203.826681:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 362 00000100:00100000:2.0:1782222203.826686:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2390:x1868795060794880:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222203.826705:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2390:x1868795060794880:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 20us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222203.826711:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 362 00000100:00100000:2.0:1782222203.826719:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 363 00000100:00100000:2.0:1782222203.826748:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060794496:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222203.826771:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060794496:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 25us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222203.826777:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 363 00000100:00100000:2.0:1782222203.826789:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 364 00000100:00100000:2.0:1782222203.826795:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2390:x1868795060795008:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222203.826817:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2390:x1868795060795008:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 22us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222203.826823:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 364 00000100:00100000:2.0:1782222203.826840:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060794240 00000100:00100000:2.0:1782222203.826843:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060794240 00000100:00100000:2.0:1782222203.826873:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 398 00000100:00100000:2.0:1782222203.826892:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2390:x1868795060794240:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222203.826917:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2390:x1868795060794240:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 38us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222203.826923:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 398 00000100:00080000:2.0:1782222203.826963:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782222203.826967:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782222203.826970:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782222204.396839:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081819264:0@lo:400:kworker.0 00000100:00100000:3.0:1782222204.396908:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222204.396966:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1868795081819776:0@lo:400:kworker.0 00000100:00100000:3.0:1782222204.396992:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222204.397010:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08504c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1868795081820288:0@lo:400:kworker.0 00000100:00100000:3.0:1782222204.397031:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222204.397051:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1782222204.397057:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1868795081819136:0@lo:400:kworker.0 00000100:00100000:3.0:1782222204.397077:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222204.397090:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1868795081819648:0@lo:400:kworker.0 00000100:00100000:3.0:1782222204.397112:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222204.397126:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08504c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1868795081820160:0@lo:400:kworker.0 00000100:00100000:3.0:1782222204.397145:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222204.397172:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081819264 00000100:00100000:3.0:1782222204.397180:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081819264 00000100:00100000:3.0:1782222204.397225:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1782222204.397255:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081819264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222204.397336:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081819264:12345-0@lo:400:kworker.0 Request processed in 103us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222204.397343:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1782222204.397366:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081819776 00000100:00100000:3.0:1782222204.397370:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081819776 00000100:00100000:3.0:1782222204.397397:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081820288 00000100:00100000:3.0:1782222204.397399:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081820288 00000100:00100000:3.0:1782222204.397412:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081819136 00000100:00100000:3.0:1782222204.397414:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081819136 00000100:00100000:3.0:1782222204.397425:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081819648 00000100:00100000:3.0:1782222204.397428:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081819648 00000100:00100000:3.0:1782222204.397438:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081820160 00000100:00100000:3.0:1782222204.397440:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081820160 00000100:00100000:3.0:1782222204.397451:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1782222204.397457:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1868795081819776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222204.397487:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1868795081819776:12345-0@lo:400:kworker.0 Request processed in 30us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222204.397494:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1782222204.397505:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1782222204.397510:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b784e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1868795081820288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222204.397534:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b784e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1868795081820288:12345-0@lo:400:kworker.0 Request processed in 24us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222204.397540:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1782222204.397551:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1782222204.397557:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1868795081819136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222204.397583:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1868795081819136:12345-0@lo:400:kworker.0 Request processed in 26us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222204.397597:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1782222204.397608:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1782222204.397613:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1868795081819648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222204.397643:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1868795081819648:12345-0@lo:400:kworker.0 Request processed in 29us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222204.397648:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1782222204.397657:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1782222204.397663:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b785c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1868795081820160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222204.397688:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b785c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1868795081820160:12345-0@lo:400:kworker.0 Request processed in 25us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222204.397693:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1782222204.397740:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1868795081819136:0@lo:400:kworker.0 00000100:00100000:3.0:1782222204.397752:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1868795081819648:0@lo:400:kworker.0 00000100:00100000:3.0:1782222204.397760:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08504c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1868795081820160:0@lo:400:kworker.0 00000100:00100000:3.0:1782222204.397768:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081819264:0@lo:400:kworker.0 00010000:00080000:3.0:1782222204.397778:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f087fdb2680 x1868795081819776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222204.397788:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1868795081819776:0@lo:400:kworker.0 00010000:00080000:3.0:1782222204.397795:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f08504c8e00 x1868795081820288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222204.397803:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08504c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1868795081820288:0@lo:400:kworker.0 00000100:00100000:0.0:1782222204.398439:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3654:1868795081819008:0@lo:400:kworker.0 00000100:00100000:0.0:1782222204.398496:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222204.398541:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1868795081819520:0@lo:400:kworker.0 00000100:00100000:0.0:1782222204.398565:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222204.398592:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08504c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081820032:0@lo:400:kworker.0 00000100:00100000:0.0:1782222204.398614:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222204.398632:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08504cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081820544:0@lo:400:kworker.0 00000100:00100000:0.0:1782222204.398653:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222204.398672:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1782222204.398678:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081819392:0@lo:400:kworker.0 00000100:00100000:0.0:1782222204.398699:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222204.398713:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08504cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081819904:0@lo:400:kworker.0 00000100:00100000:0.0:1782222204.398741:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222204.398755:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08504cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081820416:0@lo:400:kworker.0 00000100:00100000:0.0:1782222204.398773:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222204.398800:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081819520 00000100:00100000:0.0:1782222204.398805:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081819520 00000100:00100000:0.0:1782222204.398833:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1782222204.398840:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087719bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1868795081819520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222204.398878:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087719bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1868795081819520:12345-0@lo:400:kworker.0 Request processed in 38us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222204.398884:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1782222204.398903:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081819392 00000100:00100000:0.0:1782222204.398906:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081819392 00000100:00100000:0.0:1782222204.398928:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1782222204.398935:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081819392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222204.398974:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081819392:12345-0@lo:400:kworker.0 Request processed in 39us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222204.398981:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1782222204.398996:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081820032 00000100:00100000:0.0:1782222204.399000:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081820032 00000100:00100000:0.0:1782222204.399017:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081820544 00000100:00100000:0.0:1782222204.399020:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081820544 00000100:00100000:0.0:1782222204.399033:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081819904 00000100:00100000:0.0:1782222204.399035:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081819904 00000100:00100000:0.0:1782222204.399044:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081820416 00000100:00100000:0.0:1782222204.399047:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081820416 00000100:00100000:0.0:1782222204.399059:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1782222204.399065:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877198a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3654:x1868795081820032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222204.399095:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877198a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3654:x1868795081820032:12345-0@lo:400:kworker.0 Request processed in 29us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222204.399101:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1782222204.399112:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1782222204.399118:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877198700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081820544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222204.399143:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877198700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081820544:12345-0@lo:400:kworker.0 Request processed in 25us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222204.399149:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1782222204.399159:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1782222204.399179:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081819904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222204.399204:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081819904:12345-0@lo:400:kworker.0 Request processed in 40us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222204.399210:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1782222204.399220:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1782222204.399269:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087719a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081820416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222204.399300:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087719a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081820416:12345-0@lo:400:kworker.0 Request processed in 68us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222204.399307:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1782222204.399341:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081819392:0@lo:400:kworker.0 00000100:00100000:0.0:1782222204.399353:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08504cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081819904:0@lo:400:kworker.0 00000100:00100000:0.0:1782222204.399362:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08504cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081820416:0@lo:400:kworker.0 00000100:00100000:0.0:1782222204.399372:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1868795081819520:0@lo:400:kworker.0 00000100:00100000:0.0:1782222204.399380:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08504c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081820032:0@lo:400:kworker.0 00000100:00100000:0.0:1782222204.399390:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08504cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081820544:0@lo:400:kworker.0 00000100:00080000:2.0:1782222204.399619:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782222204.399625:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782222204.399627:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782222204.399693:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081819008 00000100:00100000:3.0:1782222204.399704:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081819008 00000100:00100000:3.0:1782222204.399751:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1782222204.399759:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3654:x1868795081819008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222204.399805:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3654:x1868795081819008:12345-0@lo:400:kworker.0 Request processed in 47us (1308us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222204.399811:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1782222204.399917:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3654:1868795081819008:0@lo:400:kworker.0 00010000:00010000:1.0:1782222204.464325:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782222204.917615:0:8436:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:2.0:1782222204.917628:0:8436:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:0.0:1782222204.917708:0:6505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1782222204.917745:0:6505:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f086b778300 refcount 2 committed 0 result 0 batchid 8 00010000:00010000:2.0:1782222204.917746:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812269 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1782222204.917752:0:6505:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8f085fc81200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f086b778000 00000020:00080000:0.0:1782222204.917759:0:6505:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8f085fc81b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f08450cf200 00010000:00010000:2.0:1782222204.917778:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812269 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1782222204.917782:0:6505:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:2.0:1782222204.917788:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812269 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222204.917796:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb8400 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222204.917802:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812269 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222204.917823:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812269 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1782222204.917830:0:6558:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00010000:00010000:2.0:1782222204.917841:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f0843b9b100) 00010000:00010000:2.0:1782222204.917845:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782222204.917850:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812269 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222204.917857:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812269 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1782222204.917910:0:6558:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1782222205.482425:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222206.512892:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782222206.929972:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222206.930057:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060795136 00000100:00100000:0.0:1782222206.930067:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060795136 00000100:00100000:0.0:1782222206.930146:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 255 00000100:00100000:0.0:1782222206.930157:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+18:12167:x1868795060795136:12345-192.168.203.27@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1782222206.930494:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+18:12167:x1868795060795136:12345-192.168.203.27@tcp:60:lhsmtool_posix.0 Request processed in 338us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222206.930519:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 255 00000100:00080000:2.0:1782222206.931011:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782222206.946536:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222206.946621:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060795264 00000100:00100000:2.0:1782222206.946632:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060795264 00000100:00080000:0.0:1782222206.946740:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782222206.946787:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 256 00000100:00100000:3.0:1782222206.946800:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:12167:x1868795060795264:12345-192.168.203.27@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1782222206.946917:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:77bf2c2c-f408-43f9-ae59-449550631d05+5:12167:x1868795060795264:12345-192.168.203.27@tcp:60:lhsmtool_posix.0 Request processed in 120us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222206.947529:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 256 00000100:00100000:3.0:1782222206.948879:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222206.949757:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060795520 00000100:00100000:0.0:1782222206.949768:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060795520 00000100:00100000:0.0:1782222206.949829:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 65 00000100:00100000:0.0:1782222206.949842:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b784380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+18:12167:x1868795060795520:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1782222206.950168:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b784380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+19:12167:x1868795060795520:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 Request processed in 327us (1294us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1782222206.950183:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 65 00000100:00100000:2.0:1782222206.960462:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081820672:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782222206.960543:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222206.961106:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081820672 00000100:00100000:3.0:1782222206.961115:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081820672 00000100:00100000:3.0:1782222206.961195:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1782222206.961206:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081820672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782222206.961264:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782222206.961316:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081820672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222206.961324:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1782222206.961348:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081820800:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1782222206.961370:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782222206.961381:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222206.961845:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081820800 00000100:00100000:1.0:1782222206.961852:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081820800 00000100:00100000:1.0:1782222206.961895:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1782222206.961914:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b787480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081820800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782222206.961929:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782222206.961966:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b787480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081820800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222206.961973:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1782222206.962259:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081820672:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1782222206.962902:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782222206.963382:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081820800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782222207.192457:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222207.192802:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060795648 00000100:00100000:2.0:1782222207.192812:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060795648 00000100:00100000:2.0:1782222207.192901:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 257 00000100:00100000:2.0:1782222207.192911:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb78d98d-0650-4da4-8eeb-708f911905dd+5:12972:x1868795060795648:12345-192.168.203.27@tcp:101:lsof.0 00010000:00010000:2.0:1782222207.192932:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222207.192952:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e68122f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75587e6 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222207.193017:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e68122fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222207.193032:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e68122fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222207.193045:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e68122fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782222207.193089:0:8465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782222207.193093:0:8465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782222207.193112:0:8465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e68122fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222207.193136:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82600/0xe2b7cc26e68122f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587e6 expref: 7 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222207.193155:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e68122fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587e6 expref: 6 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222207.193162:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0849b70a00) 00010000:00010000:2.0:1782222207.193165:0:8465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782222207.193169:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb83200, rc 0) 00000100:00100000:2.0:1782222207.193284:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb78d98d-0650-4da4-8eeb-708f911905dd+6:12972:x1868795060795648:12345-192.168.203.27@tcp:101:lsof.0 Request processed in 374us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222207.193298:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 257 00000100:00080000:3.0:1782222207.193372:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782222207.530546:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222207.979576:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081820928:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782222207.979646:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222207.979734:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081820928 00000100:00100000:2.0:1782222207.979741:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081820928 00000100:00100000:2.0:1782222207.979790:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1782222207.979799:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081820928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782222207.979830:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1782222207.979884:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081820928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222207.979891:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1782222207.980657:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b785500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081821056:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782222207.980713:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222207.980897:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081821056 00000100:00100000:3.0:1782222207.980904:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081821056 00000100:00100000:3.0:1782222207.980948:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1782222207.980956:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081821056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782222207.980980:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1782222207.981023:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081821056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222207.981030:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1782222207.981069:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b785500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081821056:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782222207.981395:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081820928:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782222208.490557:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081821184:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782222208.490583:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081821312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782222208.490666:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222208.490712:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222208.490831:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081821184 00000100:00100000:3.0:1782222208.490832:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081821312 00000100:00100000:3.0:1782222208.490847:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081821312 00000100:00100000:1.0:1782222208.490848:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081821184 00000100:00100000:3.0:1782222208.492855:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1782222208.492875:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1782222208.492883:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877199880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081821312:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782222208.492895:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b785500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081821184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782222208.492938:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00002000:00000024:1.0:1782222208.492938:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1782222208.496472:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b785500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081821184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3573us (5797us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222208.496488:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:1.0:1782222208.496554:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782222208.496615:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081821184:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782222208.501441:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877199880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081821312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8557us (10715us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222208.501464:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1782222208.507611:0:3655:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:0.0:1782222208.507623:0:3655:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f0747cfea00, transno 4294967323 00000004:00080000:0.0:1782222208.507654:0:3655:0:(osp_trans.c:1042:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:0.0:1782222208.507714:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081821312:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782222208.554488:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222208.935325:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222208.935399:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222208.935421:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222208.935448:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222208.935477:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222208.935489:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222208.935503:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222208.935523:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060796288 00000100:00100000:3.0:1782222208.935532:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060796288 00000100:00100000:3.0:1782222208.935586:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060796160 00000100:00100000:3.0:1782222208.935588:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060796160 00000100:00100000:3.0:1782222208.935603:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 180 00000100:00100000:3.0:1782222208.935610:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b786d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+5:2387:x1868795060796288:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222208.935679:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b786d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+5:2387:x1868795060796288:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 68us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222208.935695:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 180 00000100:00100000:3.0:1782222208.935711:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 181 00000100:00100000:3.0:1782222208.935717:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b786a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+7:2387:x1868795060796160:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222208.935744:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b786a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+7:2387:x1868795060796160:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 27us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222208.935751:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 181 00000100:00100000:3.0:1782222208.935770:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060796032 00000100:00100000:3.0:1782222208.935773:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060796032 00000100:00100000:3.0:1782222208.935799:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060796544 00000100:00100000:3.0:1782222208.935802:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060796544 00000100:00100000:0.0:1782222208.936077:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060795904 00000100:00100000:0.0:1782222208.936082:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060795904 00000100:00100000:0.0:1782222208.936101:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060796416 00000100:00100000:0.0:1782222208.936103:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060796416 00000100:00100000:0.0:1782222208.936114:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 371 00000100:00100000:0.0:1782222208.936120:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b786300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+5:2387:x1868795060796032:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222208.936146:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b786300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+5:2387:x1868795060796032:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 27us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222208.936151:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 371 00000100:00100000:0.0:1782222208.936183:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 372 00000100:00100000:0.0:1782222208.936189:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b787800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2387:x1868795060796544:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222208.936211:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b787800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2387:x1868795060796544:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 22us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222208.936224:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 372 00000100:00100000:0.0:1782222208.936252:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 373 00000100:00100000:0.0:1782222208.936258:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+19:2387:x1868795060795904:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222208.936285:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:77bf2c2c-f408-43f9-ae59-449550631d05+19:2387:x1868795060795904:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 28us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222208.936291:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 373 00000100:00100000:0.0:1782222208.936303:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 374 00000100:00100000:0.0:1782222208.936308:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb78d98d-0650-4da4-8eeb-708f911905dd+6:2387:x1868795060796416:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222208.936338:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb78d98d-0650-4da4-8eeb-708f911905dd+6:2387:x1868795060796416:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 29us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222208.936344:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 374 00000100:00080000:0.0:1782222208.936379:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782222208.936383:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782222208.936385:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782222208.936387:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782222208.949006:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060795776 00000100:00100000:1.0:1782222208.949020:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060795776 00000100:00100000:1.0:1782222208.949084:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 400 00000100:00100000:1.0:1782222208.949109:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2387:x1868795060795776:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222208.949206:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2387:x1868795060795776:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 98us (13887us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222208.949214:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 400 00000100:00100000:1.0:1782222209.514597:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081821440:0@lo:400:kworker.0 00000100:00100000:3.0:1782222209.514651:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08504c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081821824:0@lo:400:kworker.0 00000100:00100000:2.0:1782222209.514780:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b785180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1868795081821568:0@lo:400:kworker.0 00000100:00100000:0.0:1782222209.514853:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08504cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081821696:0@lo:400:kworker.0 00000100:00100000:1.0:1782222209.516079:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222209.516166:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08504cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1868795081821952:0@lo:400:kworker.0 00000100:00100000:1.0:1782222209.516213:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222209.516249:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081822464:0@lo:400:kworker.0 00000100:00100000:1.0:1782222209.516275:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222209.516304:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081822976:0@lo:400:kworker.0 00000100:00100000:1.0:1782222209.516328:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222209.516368:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081821440 00000100:00100000:1.0:1782222209.516375:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081821440 00000100:00100000:1.0:1782222209.516421:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:1.0:1782222209.516430:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3653:x1868795081821440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222209.516484:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3653:x1868795081821440:12345-0@lo:400:kworker.0 Request processed in 54us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222209.516492:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:1.0:1782222209.516526:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081822464 00000100:00100000:1.0:1782222209.516530:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081822464 00000100:00100000:1.0:1782222209.516555:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081822976 00000100:00100000:1.0:1782222209.516558:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081822976 00000100:00100000:1.0:1782222209.516584:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1782222209.516590:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081822464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222209.516641:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081822464:12345-0@lo:400:kworker.0 Request processed in 50us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222209.516648:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1782222209.516674:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1782222209.516681:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081822976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222209.516728:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081822976:12345-0@lo:400:kworker.0 Request processed in 49us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222209.516734:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1782222209.521207:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081822976:0@lo:400:kworker.0 00000100:00100000:1.0:1782222209.521226:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081821440:0@lo:400:kworker.0 00000100:00100000:1.0:1782222209.521255:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081822464:0@lo:400:kworker.0 00000100:00100000:1.0:1782222209.521324:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081821952 00000100:00100000:1.0:1782222209.521330:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081821952 00000100:00100000:1.0:1782222209.521390:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1782222209.521398:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1868795081821952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222209.521486:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1868795081821952:12345-0@lo:400:kworker.0 Request processed in 86us (5270us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222209.521493:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1782222209.521537:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08504cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1868795081821952:0@lo:400:kworker.0 00000100:00100000:3.0:1782222209.521545:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1782222209.521578:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782222209.521607:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081821824 00000100:00100000:1.0:1782222209.521612:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081821824 00000100:00100000:1.0:1782222209.521642:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1782222209.521649:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081821824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222209.523577:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08504c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081822336:0@lo:400:kworker.0 00000100:00100000:2.0:1782222209.523939:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222209.523988:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08504cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1868795081822080:0@lo:400:kworker.0 00000100:00100000:2.0:1782222209.524026:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222209.524044:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1868795081822592:0@lo:400:kworker.0 00000100:00100000:2.0:1782222209.524065:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222209.524113:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081821568 00000100:00100000:2.0:1782222209.524120:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081821568 00000100:00100000:2.0:1782222209.524160:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081822080 00000100:00100000:2.0:1782222209.524164:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081822080 00000100:00100000:2.0:1782222209.524189:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081822592 00000100:00100000:2.0:1782222209.524192:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081822592 00000100:00100000:2.0:1782222209.524226:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1782222209.524249:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1868795081821568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222209.524303:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1868795081821568:12345-0@lo:400:kworker.0 Request processed in 69us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222209.524310:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1782222209.524325:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1782222209.524340:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1868795081822080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222209.524365:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1868795081822080:12345-0@lo:400:kworker.0 Request processed in 25us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222209.524371:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1782222209.524380:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1782222209.524385:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1868795081822592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222209.524408:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1868795081822592:12345-0@lo:400:kworker.0 Request processed in 22us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222209.524414:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1782222209.524449:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b785180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1868795081821568:0@lo:400:kworker.0 00000100:00100000:2.0:1782222209.524459:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08504cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1868795081822080:0@lo:400:kworker.0 00000100:00100000:2.0:1782222209.524468:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1868795081822592:0@lo:400:kworker.0 00000100:00080000:2.0:1782222209.524528:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782222209.529614:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222209.529681:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08504c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1868795081822208:0@lo:400:kworker.0 00000100:00100000:2.0:1782222209.531737:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081821696 00000100:00100000:2.0:1782222209.531749:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081821696 00000100:00100000:2.0:1782222209.531813:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1782222209.531822:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087719b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081821696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222209.534307:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087719b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081821696:12345-0@lo:400:kworker.0 Request processed in 2477us (4690us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222209.534335:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1782222209.535010:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222209.535063:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1868795081822720:0@lo:400:kworker.0 00000100:00100000:0.0:1782222209.535110:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222209.535145:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081822208 00000100:00100000:0.0:1782222209.535152:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081822208 00000100:00100000:0.0:1782222209.535197:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081822720 00000100:00100000:0.0:1782222209.535200:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081822720 00000100:00100000:0.0:1782222209.535225:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1782222209.535248:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087719b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1868795081822208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222209.535299:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087719b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1868795081822208:12345-0@lo:400:kworker.0 Request processed in 67us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222209.535304:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1782222209.535316:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1782222209.535321:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087719b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1868795081822720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222209.535345:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087719b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1868795081822720:12345-0@lo:400:kworker.0 Request processed in 24us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222209.535349:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00080000:0.0:1782222209.535363:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1782222209.535391:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f087fdb0000 x1868795081822720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222209.535404:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1868795081822720:0@lo:400:kworker.0 00000100:00100000:0.0:1782222209.535430:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08504cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081821696:0@lo:400:kworker.0 00010000:00080000:0.0:1782222209.535439:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f08504c8e00 x1868795081822208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222209.535447:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08504c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1868795081822208:0@lo:400:kworker.0 00000100:00100000:3.0:1782222209.536009:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222209.536073:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081822336 00000100:00100000:3.0:1782222209.536075:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087fdb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081822848:0@lo:400:kworker.0 00000100:00100000:2.0:1782222209.536093:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081822336 00000100:00100000:2.0:1782222209.536138:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1782222209.536154:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222209.536155:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081822336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222209.536231:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081822336:12345-0@lo:400:kworker.0 Request processed in 84us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222209.536289:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08504c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081822336:0@lo:400:kworker.0 00000100:00100000:1.0:1782222209.536327:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081821824:12345-0@lo:400:kworker.0 Request processed in 14674us (14787us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222209.536333:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08504c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081821824:0@lo:400:kworker.0 00000100:00100000:1.0:1782222209.536349:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1782222209.536382:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081822848 00000100:00100000:1.0:1782222209.536386:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081822848 00000100:00100000:1.0:1782222209.536436:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1782222209.536442:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081822848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222209.536479:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081822848:12345-0@lo:400:kworker.0 Request processed in 38us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222209.536485:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00080000:3.0:1782222209.538401:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782222209.538482:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087fdb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081822848:0@lo:400:kworker.0 00000100:00100000:2.0:1782222209.540210:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00010000:00010000:1.0:1782222209.579192:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222210.602809:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782222211.053766:0:13806:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782222211.053781:0:13806:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782222211.053926:0:13806:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1782222211.053937:0:13806:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1782222211.067651:0:6505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:3.0:1782222211.067682:0:6505:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1782222211.068013:0:6558:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1782222211.068029:0:6558:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:02000400:2.0:1782222211.550715:0:15019:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 09:43:28 (1782222208) 00010000:00010000:3.0:1782222211.635616:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782222211.695845:0:13809:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1782222212.074560:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081823104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782222212.074630:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222212.074725:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081823104 00000100:00100000:0.0:1782222212.074733:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081823104 00000100:00100000:0.0:1782222212.074802:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1782222212.074810:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081823104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782222212.074838:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1782222212.074912:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782222212.076132:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081823232:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782222212.076201:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222212.079074:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081823104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4257us (4436us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222212.079088:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1782222212.085354:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081823232 00000100:00100000:0.0:1782222212.085369:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081823232 00000100:00080000:0.0:1782222212.085403:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782222212.085453:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1782222212.085463:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081823232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782222212.085489:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782222212.085568:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081823232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (9366us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222212.085576:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1782222212.085625:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081823232:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782222212.087033:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081823104:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782222212.650427:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782222213.099041:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782222213.099063:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081823360:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782222213.099142:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222213.099205:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081823360 00000100:00100000:1.0:1782222213.099212:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081823360 00000100:00100000:1.0:1782222213.099295:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1782222213.099303:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081823360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782222213.099336:0:7480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1782222213.099379:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081823360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222213.099401:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1782222213.099454:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081823488:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782222213.099481:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222213.099514:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081823488 00000100:00100000:1.0:1782222213.099518:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081823488 00000100:00100000:1.0:1782222213.099540:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1782222213.099547:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081823488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782222213.099567:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1782222213.099599:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081823488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222213.099605:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1782222213.099639:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081823488:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782222213.099677:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081823360:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782222213.612374:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081823616:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782222213.612635:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222213.612722:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081823616 00000100:00100000:1.0:1782222213.612729:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081823616 00000100:00100000:1.0:1782222213.612792:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1782222213.612802:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081823616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782222213.612836:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1782222213.612879:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081823616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222213.612886:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:1.0:1782222213.612907:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782222213.612957:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081823616:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782222213.614915:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081823744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782222213.614978:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222213.615062:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081823744 00000100:00100000:0.0:1782222213.615070:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081823744 00000100:00100000:0.0:1782222213.615121:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1782222213.615129:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081823744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782222213.615150:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00080000:1.0:1782222213.615216:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782222213.625558:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081823744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10422us (10573us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222213.625574:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1782222213.627549:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081823744:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782222213.675280:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222214.061313:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222214.061375:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222214.061410:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222214.061435:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222214.061451:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222214.061467:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222214.061467:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060797184 00000100:00100000:1.0:1782222214.061478:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060797184 00000100:00100000:3.0:1782222214.061490:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222214.061521:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060797056 00000100:00100000:3.0:1782222214.061524:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060797056 00000100:00100000:1.0:1782222214.061532:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 186 00000100:00100000:1.0:1782222214.061541:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060797184:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222214.061546:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 187 00000100:00100000:3.0:1782222214.061552:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77bf2c2c-f408-43f9-ae59-449550631d05+7:2389:x1868795060797056:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222214.061616:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060797184:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 76us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222214.061624:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 186 00000100:00080000:1.0:1782222214.061646:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782222214.061660:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782222214.061662:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060796672 00000100:00100000:0.0:1782222214.061667:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060796672 00000100:00100000:1.0:1782222214.061687:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060796800 00000100:00100000:1.0:1782222214.061690:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060796800 00000100:00100000:0.0:1782222214.061701:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 402 00000100:00100000:0.0:1782222214.061712:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2390:x1868795060796672:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222214.061716:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060796928 00000100:00100000:1.0:1782222214.061718:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060796928 00000100:00100000:1.0:1782222214.061730:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060797440 00000100:00100000:1.0:1782222214.061732:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060797440 00000100:00100000:1.0:1782222214.061748:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060797312 00000100:00100000:1.0:1782222214.061751:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060797312 00000100:00100000:1.0:1782222214.061764:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 381 00000100:00100000:1.0:1782222214.061770:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+18:2389:x1868795060796800:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222214.061784:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 382 00000100:00100000:2.0:1782222214.061793:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060796928:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222214.062205:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77bf2c2c-f408-43f9-ae59-449550631d05+7:2389:x1868795060797056:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 651us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222214.062213:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 187 00000100:00100000:3.0:1782222214.062271:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 383 00000100:00100000:3.0:1782222214.062279:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2390:x1868795060797440:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222214.062305:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2390:x1868795060797440:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 28us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222214.062310:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 383 00000100:00100000:3.0:1782222214.062325:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 384 00000100:00100000:3.0:1782222214.062331:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+6:2389:x1868795060797312:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222214.062354:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb78d98d-0650-4da4-8eeb-708f911905dd+6:2389:x1868795060797312:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 23us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222214.062359:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 384 00000100:00100000:0.0:1782222214.064401:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2390:x1868795060796672:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 2681us (3012us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222214.064416:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 402 00000100:00080000:0.0:1782222214.069739:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782222214.069751:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782222214.069917:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+5:2390:x1868795060796928:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 8116us (8496us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222214.069929:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 382 00000100:00100000:1.0:1782222214.071781:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:77bf2c2c-f408-43f9-ae59-449550631d05+18:2389:x1868795060796800:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 10000us (10468us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222214.071795:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 381 00000100:00100000:3.0:1782222214.634686:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081824256:0@lo:400:kworker.0 00000100:00100000:3.0:1782222214.634769:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222214.634828:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081824768:0@lo:400:kworker.0 00000100:00100000:3.0:1782222214.634855:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222214.634876:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081825280:0@lo:400:kworker.0 00000100:00100000:3.0:1782222214.634897:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222214.634917:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1782222214.634924:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087719ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081823872:0@lo:400:kworker.0 00000100:00100000:3.0:1782222214.634951:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222214.634971:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087719aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1868795081824384:0@lo:400:kworker.0 00000100:00100000:3.0:1782222214.635010:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222214.635030:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081824896:0@lo:400:kworker.0 00000100:00100000:3.0:1782222214.635728:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222214.635775:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081824384 00000100:00100000:3.0:1782222214.635783:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081824384 00000100:00100000:3.0:1782222214.635833:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1782222214.635843:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1868795081824384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222214.635903:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1868795081824384:12345-0@lo:400:kworker.0 Request processed in 61us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222214.635910:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1782222214.635956:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087719aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1868795081824384:0@lo:400:kworker.0 00000100:00100000:1.0:1782222214.636226:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081825408:0@lo:400:kworker.0 00000100:00100000:1.0:1782222214.636286:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222214.636327:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877198380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081824128:0@lo:400:kworker.0 00000100:00100000:1.0:1782222214.636355:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222214.636374:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1868795081824640:0@lo:400:kworker.0 00000100:00100000:1.0:1782222214.636393:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222214.636408:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1868795081825152:0@lo:400:kworker.0 00000100:00100000:1.0:1782222214.636429:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222214.636445:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1782222214.636451:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f087719a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1868795081824000:0@lo:400:kworker.0 00000100:00100000:1.0:1782222214.636473:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222214.636488:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1868795081824512:0@lo:400:kworker.0 00000100:00100000:1.0:1782222214.636508:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222214.636936:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081824768 00000100:00100000:2.0:1782222214.636942:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081824768 00000100:00100000:2.0:1782222214.637030:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081825280 00000100:00100000:2.0:1782222214.637034:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081825280 00000100:00100000:2.0:1782222214.637057:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081824896 00000100:00100000:2.0:1782222214.637060:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081824896 00000100:00100000:2.0:1782222214.637071:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081825408 00000100:00100000:2.0:1782222214.637073:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081825408 00000100:00100000:2.0:1782222214.637088:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1782222214.637104:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081824768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222214.637216:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081824640 00000100:00100000:3.0:1782222214.637222:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081824640 00000100:00100000:3.0:1782222214.637264:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081825152 00000100:00100000:3.0:1782222214.637268:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081825152 00000100:00100000:3.0:1782222214.637281:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081824000 00000100:00100000:3.0:1782222214.637283:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081824000 00000100:00100000:3.0:1782222214.637293:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081824512 00000100:00100000:3.0:1782222214.637295:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081824512 00000100:00100000:3.0:1782222214.637308:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1782222214.637315:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1868795081824640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222214.637543:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081824768:12345-0@lo:400:kworker.0 Request processed in 439us (2686us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222214.637552:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1782222214.637761:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1782222214.637772:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081825280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222214.637814:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081825280:12345-0@lo:400:kworker.0 Request processed in 45us (2915us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222214.637820:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1782222214.637835:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1782222214.637841:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081824896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222214.637873:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081824896:12345-0@lo:400:kworker.0 Request processed in 33us (2821us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222214.637880:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1782222214.637891:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1782222214.637897:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081825408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222214.637933:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081825408:12345-0@lo:400:kworker.0 Request processed in 36us (1646us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222214.637939:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00080000:0.0:1782222214.637955:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782222214.637959:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782222214.637961:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782222214.637987:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081825408:0@lo:400:kworker.0 00000100:00100000:0.0:1782222214.638038:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081824256 00000100:00100000:0.0:1782222214.638043:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081824256 00000100:00100000:0.0:1782222214.638069:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081824128 00000100:00100000:0.0:1782222214.638072:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081824128 00000100:00100000:0.0:1782222214.638084:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1782222214.638090:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081824256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222214.638125:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081824256:12345-0@lo:400:kworker.0 Request processed in 35us (3357us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222214.638131:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1782222214.638142:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1782222214.638148:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081824128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222214.638175:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081824128:12345-0@lo:400:kworker.0 Request processed in 27us (1819us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222214.638180:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1782222214.638198:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081823872 00000100:00100000:0.0:1782222214.638201:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081823872 00000100:00100000:0.0:1782222214.638225:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:0.0:1782222214.638231:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3655:x1868795081823872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222214.638285:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3655:x1868795081823872:12345-0@lo:400:kworker.0 Request processed in 53us (3332us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222214.638291:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:0.0:1782222214.638346:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1782222214.638354:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1868795081825152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222214.638385:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1868795081825152:12345-0@lo:400:kworker.0 Request processed in 33us (1956us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222214.638392:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1782222214.638415:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1782222214.638421:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1868795081824000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222214.638451:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1868795081824000:12345-0@lo:400:kworker.0 Request processed in 30us (1978us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222214.638457:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1782222214.638469:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1782222214.638475:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1868795081824512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222214.638500:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1868795081824512:12345-0@lo:400:kworker.0 Request processed in 26us (1991us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222214.638506:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1782222214.638583:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087719ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081823872:0@lo:400:kworker.0 00000100:00100000:0.0:1782222214.638596:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081824896:0@lo:400:kworker.0 00000100:00100000:0.0:1782222214.638605:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081824256:0@lo:400:kworker.0 00000100:00100000:0.0:1782222214.638615:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081824768:0@lo:400:kworker.0 00000100:00100000:0.0:1782222214.638625:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081825280:0@lo:400:kworker.0 00000100:00100000:1.0:1782222214.647397:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1868795081824512:0@lo:400:kworker.0 00000100:00100000:1.0:1782222214.647416:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1868795081825024:0@lo:400:kworker.0 00000100:00100000:1.0:1782222214.647475:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222214.647505:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877198380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081824128:0@lo:400:kworker.0 00010000:00080000:1.0:1782222214.647531:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0849b15180 x1868795081825152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222214.647543:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1868795081825152:0@lo:400:kworker.0 00000100:00100000:1.0:1782222214.647570:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f087719a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1868795081824000:0@lo:400:kworker.0 00000100:00100000:3.0:1782222214.648292:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1868795081824640:12345-0@lo:400:kworker.0 Request processed in 10973us (11893us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222214.648305:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1782222214.648338:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081825024 00000100:00100000:3.0:1782222214.648345:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081825024 00000100:00100000:3.0:1782222214.648412:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1782222214.648421:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1868795081825024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222214.648481:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1868795081825024:12345-0@lo:400:kworker.0 Request processed in 60us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222214.648487:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00080000:2.0:1782222214.648682:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782222214.648889:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1868795081825024:0@lo:400:kworker.0 00010000:00080000:1.0:1782222214.648902:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0877199c00 x1868795081824640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222214.648913:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1868795081824640:0@lo:400:kworker.0 00010000:00010000:3.0:1782222214.698476:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222215.622310:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222215.623018:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060797696 00000100:00100000:1.0:1782222215.623029:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060797696 00000100:00100000:1.0:1782222215.623093:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 66 00000100:00100000:1.0:1782222215.623102:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+18:13195:x1868795060797696:12345-192.168.203.27@tcp:35:umount.0 00000100:00100000:1.0:1782222215.623395:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+19:13195:x1868795060797696:12345-192.168.203.27@tcp:35:umount.0 Request processed in 293us (1098us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1782222215.623403:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 66 00000100:00100000:3.0:1782222215.627977:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222215.631004:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060797952 00000100:00100000:1.0:1782222215.631018:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060797952 00000100:00100000:1.0:1782222215.631095:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 67 00000100:00100000:1.0:1782222215.631105:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+19:13195:x1868795060797952:12345-192.168.203.27@tcp:35:umount.0 00000100:00100000:1.0:1782222215.631754:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+20:13195:x1868795060797952:12345-192.168.203.27@tcp:35:umount.0 Request processed in 648us (3784us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1782222215.631764:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 67 00000100:00100000:0.0:1782222215.636708:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222215.636883:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060798208 00000100:00100000:3.0:1782222215.636892:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060798208 00000100:00100000:3.0:1782222215.637000:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 68 00000100:00100000:3.0:1782222215.637011:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087d4b9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+20:13195:x1868795060798208:12345-192.168.203.27@tcp:35:umount.0 00000100:00100000:3.0:1782222215.637272:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087d4b9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:77bf2c2c-f408-43f9-ae59-449550631d05+21:13195:x1868795060798208:12345-192.168.203.27@tcp:35:umount.0 Request processed in 262us (572us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1782222215.637281:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 68 00000100:00100000:0.0:1782222215.643053:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222215.643272:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060798464 00000100:00100000:1.0:1782222215.643283:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060798464 00000100:00100000:1.0:1782222215.643418:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 69 00000100:00100000:1.0:1782222215.643511:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+21:13195:x1868795060798464:12345-192.168.203.27@tcp:35:umount.0 00000100:00100000:1.0:1782222215.643875:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:77bf2c2c-f408-43f9-ae59-449550631d05+22:13195:x1868795060798464:12345-192.168.203.27@tcp:35:umount.0 Request processed in 446us (829us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1782222215.643884:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 69 00000100:00100000:0.0:1782222215.652420:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222215.652457:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222215.652499:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222215.652538:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222215.652571:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060798976 00000100:00100000:0.0:1782222215.652579:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060798976 00000100:00100000:0.0:1782222215.652654:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 80 00000100:00100000:0.0:1782222215.652665:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77bf2c2c-f408-43f9-ae59-449550631d05+5:2386:x1868795060798976:12345-192.168.203.27@tcp:9:umount.0 00000020:00000080:0.0:1782222215.652697:0:8887:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e68115f1 00000100:00080000:0.0:1782222215.652705:0:8887:0:(import.c:65:import_set_state_nolock()) ffff8f07475f3000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782222215.652748:0:8887:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1782222215.653050:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060798720 00000100:00100000:2.0:1782222215.653055:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060798720 00000100:00100000:2.0:1782222215.653090:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060798592 00000100:00100000:2.0:1782222215.653094:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060798592 00000100:00100000:2.0:1782222215.653107:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060798848 00000100:00100000:2.0:1782222215.653110:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060798848 00000100:00100000:2.0:1782222215.653124:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 21 00000100:00100000:2.0:1782222215.653132:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2ca5b6e-1b2d-4770-b014-03af882e6158+15:2390:x1868795060798720:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782222215.653144:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782222215.653157:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 22 00010000:00010000:2.0:1782222215.653165:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f087fb83600/0xe2b7cc26e6811216 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75582fa expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222215.653173:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2ca5b6e-1b2d-4770-b014-03af882e6158+15:2390:x1868795060798592:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782222215.653184:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782222215.653186:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222215.653205:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0875802400/0xe2b7cc26e68112d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558339 expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222215.653218:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782222215.653272:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2390:x1868795060798720:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 139us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222215.653280:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 21 00000100:00100000:1.0:1782222215.653288:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2ca5b6e-1b2d-4770-b014-03af882e6158+13:2390:x1868795060798592:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 119us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222215.653298:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 22 00000100:00100000:0.0:1782222215.653498:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:77bf2c2c-f408-43f9-ae59-449550631d05+2:2386:x1868795060798976:12345-192.168.203.27@tcp:9:umount.0 Request processed in 834us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222215.653506:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 80 00010000:00010000:0.0:1782222215.653526:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222215.657188:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 23 00000100:00100000:2.0:1782222215.657217:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2ca5b6e-1b2d-4770-b014-03af882e6158+11:2390:x1868795060798848:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782222215.657259:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782222215.657285:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0840031e00/0xe2b7cc26e68114ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558412 expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222215.657303:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782222215.658909:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:2390:x1868795060798848:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 172us (4873us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222215.658927:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 23 00000100:00100000:0.0:1782222215.673575:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222215.673690:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060799360 00000100:00100000:3.0:1782222215.673703:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060799360 00000100:00100000:3.0:1782222215.673777:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 81 00000100:00100000:3.0:1782222215.673798:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77bf2c2c-f408-43f9-ae59-449550631d05+7:2386:x1868795060799360:12345-192.168.203.27@tcp:9:umount.0 00000020:00000080:3.0:1782222215.673845:0:8443:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6811867 00000020:00010000:3.0:1782222215.673857:0:8443:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8f0747d8d000: total 0 00000100:00080000:3.0:1782222215.673980:0:8443:0:(import.c:65:import_set_state_nolock()) ffff8f0747d89000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782222215.674048:0:8443:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000020:00010000:1.0:1782222215.674075:0:7468:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8f0747d8d000: total 0 00010000:00010000:1.0:1782222215.674171:0:7468:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8f0747d8d000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1782222215.674295:0:7468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc425e23/0xe2b7cc26e68122ee lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587df expref: 5 pid: 14437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222215.674333:0:7468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c361e703/0xe2b7cc26e6811c1f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585fc expref: 4 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222215.674349:0:7468:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8f0747d8d000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1782222215.674365:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222215.674367:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222215.674369:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222215.686417:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:77bf2c2c-f408-43f9-ae59-449550631d05+2:2386:x1868795060799360:12345-192.168.203.27@tcp:9:umount.0 Request processed in 12618us (12844us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222215.686434:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 81 00000100:00100000:2.0:1782222215.716847:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222215.717135:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060800384 00000100:00100000:0.0:1782222215.717148:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060800384 00000100:00100000:0.0:1782222215.717336:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 258 00000100:00100000:0.0:1782222215.717349:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+22:2386:x1868795060800384:12345-192.168.203.27@tcp:39:umount.0 00000020:00000080:0.0:1782222215.717400:0:6528:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6811224 00000020:00010000:0.0:1782222215.717422:0:6528:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8f0881595000: total 0 00000100:00080000:0.0:1782222215.717428:0:6528:0:(import.c:65:import_set_state_nolock()) ffff8f07415bf800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782222215.717679:0:6528:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:1.0:1782222215.717758:0:6515:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8f0881595000: total 0 00010000:00010000:1.0:1782222215.717846:0:6515:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8f0881595000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1782222215.717893:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0851377f00) 00010000:00010000:1.0:1782222215.717899:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1782222215.717911:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6811c0a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585f5 expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222215.717919:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:77bf2c2c-f408-43f9-ae59-449550631d05+21:2386:x1868795060800384:12345-192.168.203.27@tcp:39:umount.0 Request processed in 569us (1083us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1782222215.717932:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 258 00010000:00010000:1.0:1782222215.718032:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f0849b72000) 00010000:00010000:1.0:1782222215.718036:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782222215.718057:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746431000/0xe2b7cc26e68118c2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558515 expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222215.718075:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f087f8f2900) 00010000:00010000:1.0:1782222215.718079:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222215.718083:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3e00/0xe2b7cc26e681156c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558427 expref: 18 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222215.718107:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0851377f00) 00010000:00010000:1.0:1782222215.718111:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782222215.718117:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9e00/0xe2b7cc26e6811be0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585e7 expref: 17 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222215.718137:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:1.0:1782222215.718140:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782222215.718145:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82800/0xe2b7cc26e68121cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558792 expref: 16 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222215.718162:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:1.0:1782222215.718166:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782222215.718170:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0746430a00/0xe2b7cc26e6811ca4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755861f expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222215.718182:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:1.0:1782222215.718185:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782222215.718188:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c200/0xe2b7cc26e68122af lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587ca expref: 14 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222215.718201:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f0851377f00) 00010000:00010000:1.0:1782222215.718769:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782222215.718779:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744c400/0xe2b7cc26e6811b00 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75585af expref: 13 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222215.718806:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f0747402900) 00010000:00010000:1.0:1782222215.718809:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782222215.718813:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d200/0xe2b7cc26e6811550 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558420 expref: 12 pid: 13817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222215.718831:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f087f8f1a00) 00010000:00010000:1.0:1782222215.718834:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782222215.718838:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744da00/0xe2b7cc26e6811f91 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75586f8 expref: 11 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222215.718853:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0849b70a00) 00010000:00010000:1.0:1782222215.718856:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782222215.718860:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82a00/0xe2b7cc26e6811c88 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558618 expref: 10 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222215.718873:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:1.0:1782222215.718875:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1782222215.718879:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83e00/0xe2b7cc26e68122d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587d8 expref: 9 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222215.718893:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f0849b72000) 00010000:00010000:1.0:1782222215.718895:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782222215.718899:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f074744d000/0xe2b7cc26e68115c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755843c expref: 8 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222215.719003:0:6515:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8f0881595000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1782222215.719029:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222215.719032:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222215.719034:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222215.723847:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222215.737139:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222215.742749:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060800512 00000100:00100000:3.0:1782222215.742772:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060800512 00000100:00100000:3.0:1782222215.742939:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 259 00000100:00100000:3.0:1782222215.742953:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+5:2386:x1868795060800512:12345-192.168.203.27@tcp:39:umount.0 00000020:00000080:3.0:1782222215.743009:0:6527:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e681122b 00000100:00080000:3.0:1782222215.743032:0:6527:0:(import.c:65:import_set_state_nolock()) ffff8f07472a6000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782222215.743082:0:6527:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1782222215.743156:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222215.743395:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:77bf2c2c-f408-43f9-ae59-449550631d05+3:2386:x1868795060800512:12345-192.168.203.27@tcp:39:umount.0 Request processed in 435us (6265us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1782222215.743406:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 259 00010000:00010000:1.0:1782222216.746931:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222217.196180:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081825536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782222217.196324:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222217.196841:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081825536 00000100:00100000:1.0:1782222217.196853:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081825536 00000100:00100000:1.0:1782222217.196946:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1782222217.196964:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081825536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782222217.197007:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782222217.197073:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081825536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222217.197080:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1782222217.197135:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081825536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782222217.197316:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081825664:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782222217.197360:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222217.197408:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081825664 00000100:00100000:2.0:1782222217.197413:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081825664 00000100:00100000:2.0:1782222217.197446:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1782222217.197454:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081825664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782222217.197467:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782222217.197502:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081825664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222217.197510:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1782222217.197553:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081825664:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1782222217.203911:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782222217.770646:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222218.218844:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081825920:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782222218.218963:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222218.219066:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782222218.219074:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081825792:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782222218.219125:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222218.219168:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081825920 00000100:00100000:0.0:1782222218.219178:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081825920 00000100:00100000:0.0:1782222218.219265:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081825792 00000100:00100000:0.0:1782222218.219269:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081825792 00000100:00100000:0.0:1782222218.219289:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1782222218.219299:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081825920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782222218.219348:0:7480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1782222218.219427:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081825920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 127us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222218.219487:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081825920:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782222218.219612:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1782222218.219646:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1782222218.219654:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081825792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782222218.219689:0:7480:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1782222218.219735:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081825792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222218.219741:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1782222218.219962:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081825792:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782222218.731076:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782222218.731101:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081826176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782222218.731127:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782222218.731160:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081826048:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782222218.731174:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222218.731273:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222218.739102:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081826176 00000100:00100000:0.0:1782222218.739118:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081826176 00000100:00100000:0.0:1782222218.741169:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081826048 00000100:00100000:0.0:1782222218.741181:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081826048 00000100:00100000:2.0:1782222218.741269:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1782222218.741285:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081826176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782222218.741326:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782222218.741421:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081826176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (10248us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222218.741429:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1782222218.741503:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081826176:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782222218.742001:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782222218.743275:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1782222218.743291:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081826048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782222218.743313:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1782222218.743388:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081826048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (12116us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222218.743462:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081826048:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782222218.743682:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00010000:00010000:1.0:1782222218.795569:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222218.941111:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222218.941166:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222218.941301:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060800768 00000100:00100000:3.0:1782222218.941318:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060800768 00000100:00100000:3.0:1782222218.941413:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060800640 00000100:00100000:3.0:1782222218.941417:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060800640 00000100:00100000:0.0:1782222218.947952:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 24 00000100:00100000:0.0:1782222218.947978:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2ca5b6e-1b2d-4770-b014-03af882e6158+11:2387:x1868795060800768:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782222218.948000:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222218.948022:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f087fb82c00/0xe2b7cc26e68114e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755840b expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222218.948038:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782222218.948102:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2ca5b6e-1b2d-4770-b014-03af882e6158+10:2387:x1868795060800768:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 138us (7001us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222218.948110:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 24 00000100:00100000:0.0:1782222218.948135:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 25 00000100:00100000:0.0:1782222218.948141:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2ca5b6e-1b2d-4770-b014-03af882e6158+9:2387:x1868795060800640:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782222218.948149:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222218.948157:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f074744d800/0xe2b7cc26e6811327 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755834e expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222218.948166:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782222218.948181:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2ca5b6e-1b2d-4770-b014-03af882e6158+8:2387:x1868795060800640:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 40us (7015us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222218.948187:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 25 00000100:00100000:1.0:1782222218.951980:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222218.952130:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060800896 00000100:00100000:3.0:1782222218.952145:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060800896 00000100:00100000:3.0:1782222218.952260:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 26 00000100:00100000:3.0:1782222218.952274:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0842b71050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2ca5b6e-1b2d-4770-b014-03af882e6158+8:2388:x1868795060800896:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782222218.952296:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222218.952324:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f074744cc00/0xe2b7cc26e681132e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755837f expref: 8 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222218.952346:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782222218.952542:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0842b71050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2ca5b6e-1b2d-4770-b014-03af882e6158+7:2388:x1868795060800896:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 270us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222218.952568:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 26 00000100:00100000:3.0:1782222218.956227:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222218.956317:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060801152 00000100:00100000:3.0:1782222218.956330:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060801152 00000100:00080000:2.0:1782222218.963247:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782222218.963304:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 260 00000100:00100000:2.0:1782222218.963326:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb78d98d-0650-4da4-8eeb-708f911905dd+6:2386:x1868795060801152:12345-192.168.203.27@tcp:39:umount.0 00000020:00000080:2.0:1782222218.963370:0:13817:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e681133c 00000020:00010000:2.0:1782222218.963381:0:13817:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8f074769b800: total 0 00000100:00080000:2.0:1782222218.963386:0:13817:0:(import.c:65:import_set_state_nolock()) ffff8f074769d800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782222218.963416:0:13817:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:2.0:1782222218.963580:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2386:x1868795060801152:12345-192.168.203.27@tcp:39:umount.0 Request processed in 265us (7367us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1782222218.963589:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 260 00000020:00010000:1.0:1782222218.977532:0:6515:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8f074769b800: total 0 00010000:00010000:1.0:1782222218.977546:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222218.977646:0:6515:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8f074769b800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1782222218.977700:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0849b70a00) 00010000:00010000:1.0:1782222218.977705:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782222218.979022:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e68122fc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587e6 expref: 4 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222218.979068:0:6515:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8f074769b800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1782222218.979123:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222218.979125:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222218.979127:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222218.987438:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222218.987591:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060801280 00000100:00100000:0.0:1782222218.987608:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060801280 00000100:00080000:2.0:1782222218.987694:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782222218.987730:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 261 00000100:00100000:0.0:1782222218.987744:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb78d98d-0650-4da4-8eeb-708f911905dd+5:2386:x1868795060801280:12345-192.168.203.27@tcp:39:umount.0 00000020:00000080:0.0:1782222218.987814:0:6528:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6811343 00000100:00080000:0.0:1782222218.987826:0:6528:0:(import.c:65:import_set_state_nolock()) ffff8f0747698800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1782222218.987898:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1782222218.987918:0:6528:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1782222218.988207:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb78d98d-0650-4da4-8eeb-708f911905dd+3:2386:x1868795060801280:12345-192.168.203.27@tcp:39:umount.0 Request processed in 462us (774us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1782222218.988220:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 261 00000100:00100000:2.0:1782222219.067435:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222219.067603:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060801536 00000100:00100000:0.0:1782222219.067624:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060801536 00000100:00100000:0.0:1782222219.067744:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 404 00000100:00100000:0.0:1782222219.067756:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+7:2386:x1868795060801536:12345-192.168.203.27@tcp:251:umount.0 00000020:00000080:0.0:1782222219.067817:0:6521:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6811201 00000020:00010000:0.0:1782222219.067825:0:6521:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8f0875d51000: total 0 00000100:00080000:0.0:1782222219.067831:0:6521:0:(import.c:65:import_set_state_nolock()) ffff8f0875d56000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1782222219.067916:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2ca5b6e-1b2d-4770-b014-03af882e6158+3:2386:x1868795060801536:12345-192.168.203.27@tcp:251:umount.0 Request processed in 162us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222219.067924:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 404 00000020:00010000:3.0:1782222219.067991:0:7468:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8f0875d51000: total 0 00010000:00010000:3.0:1782222219.068046:0:7468:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8f0875d51000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1782222219.068083:0:7468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0875803c00/0xe2b7cc26e68112da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558340 expref: 2 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222219.068099:0:7468:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8f0875d51000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1782222219.068110:0:7468:0:(genops.c:906:class_export_put()) final put ffff8f0875d51000/a2ca5b6e-1b2d-4770-b014-03af882e6158 00010000:00010000:3.0:1782222219.068125:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222219.068128:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222219.068129:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782222219.073119:0:15024:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0875d51000/a2ca5b6e-1b2d-4770-b014-03af882e6158 for MGS 00000020:00000080:1.0:1782222219.083097:0:15024:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f0875d56000 for MGS 00000100:00100000:0.0:1782222219.755524:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081826560:0@lo:400:kworker.0 00000100:00100000:0.0:1782222219.755595:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222219.755709:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081826304:0@lo:400:kworker.0 00000100:00100000:1.0:1782222219.755756:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222219.755795:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782222219.755801:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1868795081826432:0@lo:400:kworker.0 00000100:00100000:1.0:1782222219.755829:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222219.755873:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081826304 00000100:00100000:1.0:1782222219.755881:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081826304 00000100:00100000:1.0:1782222219.755924:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:1.0:1782222219.755932:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3655:x1868795081826304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222219.755982:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3655:x1868795081826304:12345-0@lo:400:kworker.0 Request processed in 49us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222219.755989:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:1.0:1782222219.756024:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081826432 00000100:00100000:1.0:1782222219.756027:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081826432 00000100:00100000:1.0:1782222219.756058:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1782222219.756064:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1868795081826432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222219.756097:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1868795081826432:12345-0@lo:400:kworker.0 Request processed in 33us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222219.756103:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1782222219.756141:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1868795081826432:0@lo:400:kworker.0 00000100:00100000:1.0:1782222219.756151:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081826304:0@lo:400:kworker.0 00000100:00100000:3.0:1782222219.756506:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081826688:0@lo:400:kworker.0 00000100:00100000:3.0:1782222219.756540:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222219.757125:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081826560 00000100:00100000:1.0:1782222219.757132:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081826560 00000100:00100000:1.0:1782222219.757182:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081826688 00000100:00100000:1.0:1782222219.757186:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081826688 00000100:00100000:1.0:1782222219.757203:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1782222219.757211:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081826560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222219.757310:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1782222219.757321:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081826688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222219.757363:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081826688:12345-0@lo:400:kworker.0 Request processed in 44us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222219.757370:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1782222219.757406:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081826688:0@lo:400:kworker.0 00000100:00100000:2.0:1782222219.760138:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1868795081826944:0@lo:400:kworker.0 00000100:00100000:3.0:1782222219.761271:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1868795081826816:0@lo:400:kworker.0 00000100:00100000:3.0:1782222219.761327:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222219.761361:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081827328:0@lo:400:kworker.0 00000100:00100000:3.0:1782222219.761402:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222219.761420:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081827840:0@lo:400:kworker.0 00000100:00100000:3.0:1782222219.761437:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222219.761476:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081826816 00000100:00100000:3.0:1782222219.761481:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081826816 00000100:00100000:3.0:1782222219.761522:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1782222219.761529:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08485a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1868795081826816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222219.761572:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08485a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1868795081826816:12345-0@lo:400:kworker.0 Request processed in 44us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222219.761579:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1782222219.761598:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081827328 00000100:00100000:3.0:1782222219.761601:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081827328 00000100:00100000:3.0:1782222219.761636:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081827840 00000100:00100000:3.0:1782222219.761639:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081827840 00000100:00100000:3.0:1782222219.761660:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1782222219.761667:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08412af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081827328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222219.761696:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08412af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081827328:12345-0@lo:400:kworker.0 Request processed in 30us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222219.761703:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1782222219.761715:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1782222219.761721:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fdb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081827840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222219.761749:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fdb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081827840:12345-0@lo:400:kworker.0 Request processed in 28us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222219.761755:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1782222219.761799:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1868795081826816:0@lo:400:kworker.0 00000100:00100000:3.0:1782222219.761809:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081827328:0@lo:400:kworker.0 00000100:00100000:3.0:1782222219.761826:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081827840:0@lo:400:kworker.0 00000100:00100000:3.0:1782222219.761874:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081827200:0@lo:400:kworker.0 00000100:00100000:3.0:1782222219.761901:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222219.761920:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081827712:0@lo:400:kworker.0 00000100:00100000:3.0:1782222219.761938:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222219.761955:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1782222219.761960:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1868795081827072:0@lo:400:kworker.0 00000100:00100000:3.0:1782222219.761980:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222219.761997:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1868795081827584:0@lo:400:kworker.0 00000100:00100000:3.0:1782222219.762017:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222219.762048:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081827200 00000100:00100000:3.0:1782222219.762052:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081827200 00000100:00100000:3.0:1782222219.762071:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081827712 00000100:00100000:3.0:1782222219.762074:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081827712 00000100:00100000:3.0:1782222219.762093:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1782222219.762099:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877199c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081827200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222219.762133:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877199c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081827200:12345-0@lo:400:kworker.0 Request processed in 34us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222219.762140:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1782222219.762152:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1782222219.762158:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087719a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081827712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222219.762187:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087719a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081827712:12345-0@lo:400:kworker.0 Request processed in 29us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222219.762194:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1782222219.762220:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081827200:0@lo:400:kworker.0 00000100:00100000:3.0:1782222219.762267:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081827712:0@lo:400:kworker.0 00000100:00080000:3.0:1782222219.762298:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782222219.762314:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081827072 00000100:00100000:3.0:1782222219.762318:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081827072 00000100:00080000:3.0:1782222219.762331:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782222219.762353:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081827584 00000100:00100000:3.0:1782222219.762356:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081827584 00000100:00100000:3.0:1782222219.762380:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1782222219.762385:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1868795081827072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222219.762423:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1868795081827072:12345-0@lo:400:kworker.0 Request processed in 38us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222219.762429:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1782222219.762439:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1782222219.762444:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1868795081827584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222219.762467:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1868795081827584:12345-0@lo:400:kworker.0 Request processed in 23us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222219.762472:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00080000:3.0:1782222219.762484:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1782222219.762502:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074561c380 x1868795081827072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222219.762513:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1868795081827072:0@lo:400:kworker.0 00010000:00080000:3.0:1782222219.762523:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074561fb80 x1868795081827584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222219.762531:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1868795081827584:0@lo:400:kworker.0 00000100:00100000:2.0:1782222219.762743:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222219.762763:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1868795081827456:0@lo:400:kworker.0 00000100:00100000:2.0:1782222219.762799:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222219.762826:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081826944 00000100:00100000:2.0:1782222219.762830:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081826944 00000100:00100000:2.0:1782222219.762856:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081827456 00000100:00100000:2.0:1782222219.762859:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081827456 00000100:00100000:2.0:1782222219.762878:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1782222219.762883:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1868795081826944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222219.762918:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1868795081826944:12345-0@lo:400:kworker.0 Request processed in 35us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222219.762924:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1782222219.762936:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1782222219.762942:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1868795081827456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222219.762965:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1868795081827456:12345-0@lo:400:kworker.0 Request processed in 24us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222219.762970:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00080000:2.0:1782222219.762981:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782222219.762998:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1868795081826944:0@lo:400:kworker.0 00000100:00100000:2.0:1782222219.763006:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1868795081827456:0@lo:400:kworker.0 00000100:00100000:1.0:1782222219.763133:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081826560:12345-0@lo:400:kworker.0 Request processed in 5922us (7538us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222219.763143:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1782222219.765469:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081826560:0@lo:400:kworker.0 00010000:00010000:1.0:1782222219.832123:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1782222220.795744:0:9523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 77bf2c2c-f408-43f9-ae59-449550631d05 00000020:00000080:0.0:1782222220.795758:0:9523:0:(genops.c:906:class_export_put()) final put ffff8f07475f2000/77bf2c2c-f408-43f9-ae59-449550631d05 00000020:00000080:1.0:1782222220.796314:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff8f07475f2000/77bf2c2c-f408-43f9-ae59-449550631d05 for lustre-OST0001 00000020:00000080:1.0:1782222220.796382:0:491:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f07475f3000 for lustre-OST0001 00000001:00100000:0.0:1782222220.797818:0:6505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of eb78d98d-0650-4da4-8eeb-708f911905dd 00000001:00080000:0.0:1782222220.797839:0:6505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:0.0:1782222220.797846:0:6505:0:(genops.c:906:class_export_put()) final put ffff8f074769b800/eb78d98d-0650-4da4-8eeb-708f911905dd 00000001:00100000:0.0:1782222220.797868:0:6505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 77bf2c2c-f408-43f9-ae59-449550631d05 00000001:00080000:0.0:1782222220.797874:0:6505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:0.0:1782222220.797885:0:6505:0:(genops.c:906:class_export_put()) final put ffff8f0881595000/77bf2c2c-f408-43f9-ae59-449550631d05 00000020:00000080:3.0:1782222220.797927:0:15024:0:(genops.c:865:class_export_destroy()) destroying export ffff8f074769b800/eb78d98d-0650-4da4-8eeb-708f911905dd for lustre-MDT0000 00000020:00000080:3.0:1782222220.797998:0:15024:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0881595000/77bf2c2c-f408-43f9-ae59-449550631d05 for lustre-MDT0000 00000020:00000080:3.0:1782222220.798027:0:15024:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f074769d800 for lustre-MDT0000 00000020:00000080:3.0:1782222220.798032:0:15024:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f07415bf800 for lustre-MDT0000 00010000:00010000:2.0:1782222220.842408:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1782222220.934976:0:15217:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1782222220.957622:0:15217:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1782222220.957677:0:15217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0841459400/0xe2b7cc26e68112a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68112b0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222220.957692:0:15217:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0841459400/0xe2b7cc26e68112a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e68112b0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222220.957700:0:15217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0841459400/0xe2b7cc26e68112a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2b7cc26e68112b0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222220.957721:0:15217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.127@tcp lock: ffff8f0841459400/0xe2b7cc26e68112a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2b7cc26e68112b0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222220.957741:0:15217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1782222220.957747:0:15217:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1782222220.957773:0:15217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1782222220.957777:0:15217:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1782222220.957784:0:15217:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1782222220.957809:0:15217:0:(import.c:65:import_set_state_nolock()) ffff8f0875aa0800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1782222220.957861:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3652:1868795081827968:0@lo:39:umount.0 00000100:00100000:0.0:1782222220.957931:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222220.958012:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081827968 00000100:00100000:1.0:1782222220.958020:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081827968 00000100:00100000:1.0:1782222220.958072:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1782222220.958081:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1868795081827968:12345-0@lo:39:umount.0 00000020:00000080:1.0:1782222220.958107:0:13817:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6810e18 00000100:00080000:1.0:1782222220.958115:0:13817:0:(import.c:65:import_set_state_nolock()) ffff8f0875aa6800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1782222220.958312:0:7468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782222220.958319:0:7468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f0841459400/0xe2b7cc26e68112a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2b7cc26e68112b0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222220.958327:0:7468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0841459400 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:3.0:1782222220.958331:0:7468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f0841459400/0xe2b7cc26e68112a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2b7cc26e68112b0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222220.958340:0:7468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f0841459400/0xe2b7cc26e68112a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2b7cc26e68112b0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782222220.958347:0:7468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f0841459400/0xe2b7cc26e68112a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2b7cc26e68112b0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782222220.958352:0:7468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1782222220.958355:0:7468:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1782222220.958357:0:7468:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1782222220.958380:0:7468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f0841459400/0xe2b7cc26e68112a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2b7cc26e68112b0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222220.958386:0:7468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782222220.958404:0:7468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f0841459400/0xe2b7cc26e68112a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2b7cc26e68112b0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222220.958411:0:7468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f0841459400/0xe2b7cc26e68112a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2b7cc26e68112b0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222220.958421:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222220.958430:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222220.958432:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222220.958444:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0877199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081828096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782222220.959930:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222220.960002:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081828096 00000100:00100000:3.0:1782222220.960009:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081828096 00000100:00100000:3.0:1782222220.960202:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782222220.960212:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877198e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3656:x1868795081828096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782222220.960226:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222220.960284:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0875803a00/0xe2b7cc26e68112b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2b7cc26e68112a9 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222220.960298:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782222220.960342:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877198e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:3656:x1868795081828096:12345-0@lo:103:ldlm_bl.0 Request processed in 132us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222220.960349:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782222220.960395:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0877199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3656:1868795081828096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782222220.961125:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3652:x1868795081827968:12345-0@lo:39:umount.0 Request processed in 3042us (3191us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222220.961136:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:1.0:1782222220.961147:0:13817:0:(genops.c:906:class_export_put()) final put ffff8f0875aa7800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1782222220.961223:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782222220.961338:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f0875aa0800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1782222220.961349:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3652:1868795081827968:0@lo:39:umount.0 00000100:00080000:1.0:1782222220.961461:0:15217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782222220.961466:0:15217:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1782222220.961532:0:15217:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1782222220.962594:0:15217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0840030200/0xe2b7cc26e68112b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68112be expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222220.962634:0:15217:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0840030200/0xe2b7cc26e68112b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e68112be expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222220.962641:0:15217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0840030200/0xe2b7cc26e68112b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2b7cc26e68112be expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222220.962648:0:15217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.127@tcp lock: ffff8f0840030200/0xe2b7cc26e68112b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2b7cc26e68112be expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222220.962668:0:15217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782222220.962675:0:15217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875803600/0xe2b7cc26e68111bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68111c2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222220.962682:0:15217:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875803600/0xe2b7cc26e68111bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e68111c2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222220.962688:0:15217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875803600/0xe2b7cc26e68111bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2b7cc26e68111c2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222220.962694:0:15217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.127@tcp lock: ffff8f0875803600/0xe2b7cc26e68111bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2b7cc26e68111c2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222220.962707:0:15217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1782222220.962714:0:15217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f08413d3400/0xe2b7cc26e681151f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811526 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222220.962720:0:15217:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f08413d3400/0xe2b7cc26e681151f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6811526 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222220.962736:0:15217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f08413d3400/0xe2b7cc26e681151f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2b7cc26e6811526 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222220.962742:0:15217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.127@tcp lock: ffff8f08413d3400/0xe2b7cc26e681151f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2b7cc26e6811526 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222220.962758:0:15217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1782222220.962771:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782222220.962778:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f0840030200/0xe2b7cc26e68112b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2b7cc26e68112be expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222220.962785:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0840030200 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:1.0:1782222220.962788:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f0840030200/0xe2b7cc26e68112b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2b7cc26e68112be expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222220.962803:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f0840030200/0xe2b7cc26e68112b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2b7cc26e68112be expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782222220.962812:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f0840030200/0xe2b7cc26e68112b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2b7cc26e68112be expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782222220.962818:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1782222220.962821:0:6515:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1782222220.962849:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f0840030200/0xe2b7cc26e68112b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2b7cc26e68112be expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222220.962855:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782222220.962874:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f0840030200/0xe2b7cc26e68112b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2b7cc26e68112be expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222220.962890:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f0840030200/0xe2b7cc26e68112b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2b7cc26e68112be expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222220.962903:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782222220.962905:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f0875803600/0xe2b7cc26e68111bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2b7cc26e68111c2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222220.962910:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0875803600 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:1.0:1782222220.962913:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f0875803600/0xe2b7cc26e68111bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2b7cc26e68111c2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222220.962919:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f0875803600/0xe2b7cc26e68111bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2b7cc26e68111c2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782222220.962925:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f0875803600/0xe2b7cc26e68111bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2b7cc26e68111c2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782222220.962929:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1782222220.962932:0:6515:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1782222220.962934:0:6515:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1782222220.962947:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f0875803600/0xe2b7cc26e68111bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2b7cc26e68111c2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222220.962952:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782222220.962957:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f0875803600/0xe2b7cc26e68111bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2b7cc26e68111c2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222220.962963:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f0875803600/0xe2b7cc26e68111bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2b7cc26e68111c2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222220.962980:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782222220.962984:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f08413d3400/0xe2b7cc26e681151f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2b7cc26e6811526 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222220.962989:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08413d3400 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:1.0:1782222220.962992:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f08413d3400/0xe2b7cc26e681151f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2b7cc26e6811526 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222220.962999:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f08413d3400/0xe2b7cc26e681151f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2b7cc26e6811526 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782222220.963005:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f08413d3400/0xe2b7cc26e681151f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2b7cc26e6811526 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782222220.963009:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1782222220.963011:0:6515:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1782222220.963013:0:6515:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1782222220.963027:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f08413d3400/0xe2b7cc26e681151f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2b7cc26e6811526 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222220.963032:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782222220.963044:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f08413d3400/0xe2b7cc26e681151f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2b7cc26e6811526 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222220.963051:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f08413d3400/0xe2b7cc26e681151f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2b7cc26e6811526 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222220.963061:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222220.963062:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222220.963070:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222220.963083:0:15217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f086732ec00/0xe2b7cc26e6810d77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810d7e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222220.963091:0:15217:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f086732ec00/0xe2b7cc26e6810d77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6810d7e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222220.963098:0:15217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f086732ec00/0xe2b7cc26e6810d77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2b7cc26e6810d7e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222220.963105:0:15217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.127@tcp lock: ffff8f086732ec00/0xe2b7cc26e6810d77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2b7cc26e6810d7e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222220.963116:0:15217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1782222220.963118:0:15217:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1782222220.963121:0:15217:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1782222220.963146:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782222220.963150:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f086732ec00/0xe2b7cc26e6810d77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2b7cc26e6810d7e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222220.963157:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f086732ec00 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:1.0:1782222220.963160:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f086732ec00/0xe2b7cc26e6810d77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2b7cc26e6810d7e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222220.963166:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f086732ec00/0xe2b7cc26e6810d77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2b7cc26e6810d7e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782222220.963172:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f086732ec00/0xe2b7cc26e6810d77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2b7cc26e6810d7e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782222220.963177:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1782222220.963185:0:6515:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1782222220.963187:0:6515:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1782222220.963201:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f086732ec00/0xe2b7cc26e6810d77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2b7cc26e6810d7e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222220.963206:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782222220.963213:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f086732ec00/0xe2b7cc26e6810d77 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2b7cc26e6810d7e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222220.963219:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f086732ec00/0xe2b7cc26e6810d77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2b7cc26e6810d7e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222220.963228:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222220.963230:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222220.963231:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222220.963360:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222220.963376:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081828224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782222220.963435:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222220.963620:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782222220.963627:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081828352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782222220.963652:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222220.963685:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081828224 00000100:00100000:0.0:1782222220.963692:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081828224 00000100:00100000:0.0:1782222220.963728:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081828352 00000100:00100000:0.0:1782222220.963731:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081828352 00000100:00100000:0.0:1782222220.963749:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782222220.963756:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+24:3653:x1868795081828224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782222220.963767:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222220.963781:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0841459a00/0xe2b7cc26e68112be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2b7cc26e68112b7 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222220.963792:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782222220.963824:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+23:3653:x1868795081828224:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222220.963831:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782222220.963846:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782222220.963852:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:3653:x1868795081828352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782222220.963860:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222220.963868:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0875802e00/0xe2b7cc26e68111c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2b7cc26e68111bb expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222220.963877:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782222220.963908:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:3653:x1868795081828352:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222220.963915:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782222220.963947:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081828352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782222220.963957:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081828224:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1782222220.964088:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0875aa7800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:01000004:1.0:1782222220.964183:0:15217:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1782222220.964187:0:15217:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1782222220.964192:0:15217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782222220.964197:0:15217:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/11 00000020:00080000:1.0:1782222220.964201:0:15217:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8f07466f6000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1782222220.964207:0:15217:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8f0745636000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1782222220.964211:0:15217:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8f087e831000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1782222220.964215:0:15217:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8f0875d54000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:1.0:1782222220.964219:0:15217:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff8f0878058000) has exports, disconnecting them 00000020:00080000:1.0:1782222220.964224:0:15217:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8f07466f6000), last request at 1782222219 00000020:00000080:1.0:1782222220.964229:0:15217:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6811128 00000100:00080000:1.0:1782222220.964264:0:15217:0:(import.c:65:import_set_state_nolock()) ffff8f07466f7800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1782222220.964297:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081828480:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782222220.964300:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1782222220.964310:0:15217:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f07466f6000): rc 0 00000020:00000080:1.0:1782222220.964318:0:15217:0:(genops.c:906:class_export_put()) final put ffff8f07466f6000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1782222220.964327:0:15217:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8f0745636000), last request at 1782222219 00000020:00000080:1.0:1782222220.964331:0:15217:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6811002 00000100:00080000:1.0:1782222220.964337:0:15217:0:(import.c:65:import_set_state_nolock()) ffff8f0875d51800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1782222220.964338:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1782222220.964349:0:15217:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f0745636000): rc 0 00000020:00000080:1.0:1782222220.964350:0:15217:0:(genops.c:906:class_export_put()) final put ffff8f0745636000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1782222220.964355:0:15217:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8f087e831000), last request at 1782221972 00000020:00000080:1.0:1782222220.964358:0:15217:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6810f3e 00000100:00080000:1.0:1782222220.964361:0:15217:0:(import.c:65:import_set_state_nolock()) ffff8f087e835000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1782222220.964362:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782222220.964367:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081828608:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782222220.964371:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1782222220.964377:0:15217:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f087e831000): rc 0 00000020:00000080:1.0:1782222220.964379:0:15217:0:(genops.c:906:class_export_put()) final put ffff8f087e831000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1782222220.964383:0:15217:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8f0875d54000), last request at 1782221972 00000100:00100000:3.0:1782222220.964386:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1782222220.964386:0:15217:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6810eff 00000100:00080000:1.0:1782222220.964389:0:15217:0:(import.c:65:import_set_state_nolock()) ffff8f087e832800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1782222220.964397:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1782222220.964403:0:15217:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00100000:3.0:1782222220.964408:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081828480 00000100:00100000:3.0:1782222220.964411:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081828480 00000100:00100000:3.0:1782222220.964432:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081828608 00000100:00100000:3.0:1782222220.964435:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081828608 00000020:00080000:1.0:1782222220.964561:0:15217:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f0875d54000): rc 0 00000004:00000080:1.0:1782222220.964567:0:15217:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa0b98184bae0 00000100:00080000:1.0:1782222220.964585:0:15217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1782222220.964588:0:15217:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:3.0:1782222220.964653:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782222220.964660:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877199f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+22:3655:x1868795081828480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782222220.964674:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222220.964747:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f08413d3c00/0xe2b7cc26e6811526 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2b7cc26e681151f expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222220.964760:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782222220.964788:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877199f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+21:3655:x1868795081828480:12345-0@lo:103:ldlm_bl.0 Request processed in 129us (449us total) trans 0 rc 0/0 00000100:00080000:1.0:1782222220.965375:0:15217:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1782222220.965396:0:15217:0:(import.c:65:import_set_state_nolock()) ffff8f0875f10800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1782222220.965740:0:15217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1782222220.965743:0:15217:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:1.0:1782222220.965793:0:15217:0:(osp_dev.c:1636:osp_import_event()) got inactive 00000100:00080000:1.0:1782222220.965852:0:15217:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1782222220.965864:0:15217:0:(import.c:65:import_set_state_nolock()) ffff8f07463b2000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1782222220.965870:0:15217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1782222220.965880:0:15217:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:1.0:1782222220.965890:0:15217:0:(osp_dev.c:1636:osp_import_event()) got inactive 00000100:00080000:1.0:1782222220.965953:0:15217:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1782222220.965963:0:15217:0:(import.c:65:import_set_state_nolock()) ffff8f07472a1000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1782222220.965989:0:15217:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8f0878058000) has no exports 00010000:00010000:0.0:1782222220.966197:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222220.966213:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08504c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081828736:0@lo:39:umount.0 00010000:00010000:1.0:1782222220.966303:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222220.966631:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782222220.966639:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782222220.966650:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087719ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+20:3655:x1868795081828608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782222220.966664:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222220.966686:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f086732f800/0xe2b7cc26e6810d7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2b7cc26e6810d77 expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222220.966700:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782222220.966749:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087719ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+19:3655:x1868795081828608:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (2360us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222220.966755:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782222220.966774:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081828608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782222220.966784:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222220.966786:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081828480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782222220.966849:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08504c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081828864:0@lo:9:umount.0 00000100:00100000:1.0:1782222220.966871:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222220.966885:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08504c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081828992:0@lo:9:umount.0 00000100:00100000:1.0:1782222220.966900:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222220.966936:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081828864 00000100:00100000:3.0:1782222220.966941:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081828864 00000020:00000080:1.0:1782222220.966950:0:491:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f0875aa6800 for lustre-MDT0000 00000020:00000080:1.0:1782222220.966957:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff8f07466f6000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1782222220.966981:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0745636000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1782222220.967000:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff8f087e831000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1782222220.967017:0:491:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f07466f7800 for lustre-MDT0000 00000020:00000080:1.0:1782222220.967020:0:491:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f0875d51800 for lustre-MDT0000 00000100:00100000:3.0:1782222220.967026:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081828992 00000100:00100000:3.0:1782222220.967029:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081828992 00000020:00000080:1.0:1782222220.967031:0:491:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f087e835000 for lustre-MDT0000 00000100:00100000:3.0:1782222220.967047:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1782222220.967051:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1782222220.967053:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3652:x1868795081828864:12345-0@lo:9:umount.0 00000100:00100000:1.0:1782222220.967057:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1868795081828992:12345-0@lo:9:umount.0 00000020:00000080:3.0:1782222220.967073:0:14437:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e68110aa 00000020:00000080:1.0:1782222220.967073:0:8442:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e68111f3 00000100:00080000:3.0:1782222220.967079:0:14437:0:(import.c:65:import_set_state_nolock()) ffff8f0745637000 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1782222220.967079:0:8442:0:(import.c:65:import_set_state_nolock()) ffff8f0843caf800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782222220.967119:0:14437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000001:00000004:1.0:1782222220.967119:0:8442:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1782222220.967220:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3652:x1868795081828864:12345-0@lo:9:umount.0 Request processed in 166us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222220.967227:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1782222220.967272:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782222220.967282:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782222220.968130:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3652:x1868795081828992:12345-0@lo:9:umount.0 Request processed in 1069us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222220.968140:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1782222220.968218:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081828736 00000100:00100000:0.0:1782222220.968225:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081828736 00010000:00010000:1.0:1782222220.968281:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222220.968390:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1782222220.968398:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1868795081828736:12345-0@lo:39:umount.0 00000020:00000080:0.0:1782222220.968420:0:6532:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6810f4c 00000100:00080000:0.0:1782222220.968426:0:6532:0:(import.c:65:import_set_state_nolock()) ffff8f087fc77000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782222220.968444:0:6532:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1782222220.968636:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3652:x1868795081828736:12345-0@lo:39:umount.0 Request processed in 239us (1851us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1782222220.968643:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00010000:00010000:0.0:1782222220.969086:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782222220.970075:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f0875f10800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1782222220.970088:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08504c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081828736:0@lo:39:umount.0 00000100:00080000:3.0:1782222220.970105:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f07463b2000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1782222220.970127:0:3652:0:(osp_dev.c:1620:osp_import_event()) got disconnected 00000004:00080000:3.0:1782222220.970128:0:3652:0:(osp_dev.c:1636:osp_import_event()) got inactive 00000100:00100000:3.0:1782222220.970132:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08504c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081828864:0@lo:9:umount.0 00000100:00080000:3.0:1782222220.970147:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f07472a1000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1782222220.970156:0:3652:0:(osp_dev.c:1620:osp_import_event()) got disconnected 00000004:00080000:3.0:1782222220.970158:0:3652:0:(osp_dev.c:1636:osp_import_event()) got inactive 00000100:00100000:3.0:1782222220.970161:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08504c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081828992:0@lo:9:umount.0 00000001:00100000:2.0:1782222220.971321:0:7458:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1782222220.971333:0:7458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:2.0:1782222220.971338:0:7458:0:(genops.c:906:class_export_put()) final put ffff8f087fc70000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1782222220.971357:0:7458:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of eb78d98d-0650-4da4-8eeb-708f911905dd 00000001:00080000:2.0:1782222220.971364:0:7458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:2.0:1782222220.971366:0:7458:0:(genops.c:906:class_export_put()) final put ffff8f074769e800/eb78d98d-0650-4da4-8eeb-708f911905dd 00000001:00100000:2.0:1782222220.971372:0:7458:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 77bf2c2c-f408-43f9-ae59-449550631d05 00000001:00080000:2.0:1782222220.971376:0:7458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:2.0:1782222220.971378:0:7458:0:(genops.c:906:class_export_put()) final put ffff8f07472a4800/77bf2c2c-f408-43f9-ae59-449550631d05 00000020:00000080:1.0:1782222220.971436:0:15024:0:(genops.c:865:class_export_destroy()) destroying export ffff8f087fc70000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1782222220.971595:0:15024:0:(genops.c:865:class_export_destroy()) destroying export ffff8f074769e800/eb78d98d-0650-4da4-8eeb-708f911905dd for lustre-MDT0001 00000020:00000080:1.0:1782222220.971643:0:15024:0:(genops.c:865:class_export_destroy()) destroying export ffff8f07472a4800/77bf2c2c-f408-43f9-ae59-449550631d05 for lustre-MDT0001 00000020:00000080:1.0:1782222220.971666:0:15024:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f087fc77000 for lustre-MDT0001 00000020:00000080:1.0:1782222220.971672:0:15024:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f0747698800 for lustre-MDT0001 00000020:00000080:1.0:1782222220.971676:0:15024:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f07472a6000 for lustre-MDT0001 00000001:00100000:3.0:1782222220.971936:0:8436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1782222220.971941:0:8436:0:(genops.c:906:class_export_put()) final put ffff8f0745634800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1782222220.971962:0:8436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 77bf2c2c-f408-43f9-ae59-449550631d05 00000020:00000080:3.0:1782222220.971965:0:8436:0:(genops.c:906:class_export_put()) final put ffff8f0747d8d000/77bf2c2c-f408-43f9-ae59-449550631d05 00000020:00000080:2.0:1782222220.972037:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0745634800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1782222220.972071:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0747d8d000/77bf2c2c-f408-43f9-ae59-449550631d05 for lustre-OST0000 00000020:00000080:2.0:1782222220.972085:0:491:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f0745637000 for lustre-OST0000 00000020:00000080:2.0:1782222220.972088:0:491:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f0747d89000 for lustre-OST0000 00000020:00080000:2.0:1782222220.993416:0:15217:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8f0878058000) has no exports 00000020:00000080:2.0:1782222221.074053:0:15217:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6810dd2 00000020:00000080:2.0:1782222221.074069:0:15217:0:(genops.c:906:class_export_put()) final put ffff8f0849bcd000/lustre-QMT0000_UUID 00000020:01000000:2.0:1782222221.074150:0:15217:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1782222221.074528:0:15217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782222221.074538:0:15217:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1782222221.074543:0:15217:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff8f08492019c0) has no exports 00000020:00000080:1.0:1782222221.078555:0:15024:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0849bcd000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1782222221.078698:0:15217:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6810dcb 00000020:00000080:3.0:1782222221.078708:0:15217:0:(genops.c:906:class_export_put()) final put ffff8f0875a8f800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1782222221.078773:0:15217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782222221.078785:0:15217:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1782222221.078789:0:15217:0:(genops.c:906:class_export_put()) final put ffff8f0875a88000/lustre-QMT0000_UUID 00000020:00000080:3.0:1782222221.078791:0:15217:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0875a88000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1782222221.078800:0:15217:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1782222221.079020:0:15024:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0875a8f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1782222221.866474:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782222221.933342:0:13809:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1782222222.316916:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081829120:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782222222.316987:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222222.317253:0:10157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081829120 00000100:00100000:2.0:1782222222.317262:0:10157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081829120 00000100:00100000:2.0:1782222222.317334:0:10157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1782222222.317344:0:10157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081829120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782222222.317374:0:10157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782222222.317421:0:10157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081829120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222222.317428:0:10157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:0.0:1782222222.317488:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782222222.317533:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081829120:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1782222222.890465:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222223.338752:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782222223.340169:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08504c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081829248:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782222223.340254:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222223.341723:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081829248 00000100:00100000:2.0:1782222223.341735:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081829248 00000100:00100000:2.0:1782222223.341783:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1782222223.341792:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3653:x1868795081829248:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1782222223.341801:0:7480:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1782222223.341997:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3653:x1868795081829248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 204us (1741us total) trans 0 rc -107/-107 00000100:00100000:2.0:1782222223.342005:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:02020000:0.0:1782222223.342076:0:3653:0:(client.c:1491:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1782222223.358331:0:3653:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1782222223.358339:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8f08513bb000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1782222223.358344:0:3653:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1782222223.381598:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8f08513bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782222223.381611:0:3653:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 171 00000100:00080000:0.0:1782222223.381622:0:3653:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8f08513bb000 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:0.0:1782222223.381701:0:3653:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0849b17b80 x1868795081829376/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782222223.381907:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1868795081829376:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1782222223.381974:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222223.382510:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081829376 00000100:00100000:0.0:1782222223.382518:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081829376 00000100:00100000:0.0:1782222223.382551:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1782222223.382558:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087719aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3652:x1868795081829376:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1782222223.382575:0:6532:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1782222223.392769:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087719aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3652:x1868795081829376:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 10202us (10786us total) trans 0 rc -19/-19 00000100:00100000:1.0:1782222223.392782:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00080000:3.0:1782222223.393011:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f08513bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782222223.393018:0:3652:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1782222223.393022:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1868795081829376:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1782222223.850544:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f08504c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081829504:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782222223.850663:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222223.850895:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081829504 00000100:00100000:0.0:1782222223.850903:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081829504 00000100:00100000:0.0:1782222223.850981:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1782222223.850992:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081829504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782222223.851025:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1782222223.851080:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081829504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222223.851088:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1782222223.851349:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08504c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081829504:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1782222223.851419:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782222223.914817:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222224.874445:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:2.0:1782222224.874466:0:15024:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1782222224.874471:0:15024:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1782222224.874475:0:15024:0:(import.c:65:import_set_state_nolock()) ffff8f08513bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782222224.874483:0:15024:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 422 00000100:00080000:2.0:1782222224.874488:0:15024:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1782222224.874495:0:15024:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8f08513bb000 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:2.0:1782222224.874519:0:15024:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f074561d880 x1868795081829760/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782222224.874638:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1868795081829760:0@lo:38:kworker.0 00000100:00100000:0.0:1782222224.874701:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222224.874783:0:7480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081829760 00000100:00100000:0.0:1782222224.874806:0:7480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081829760 00000100:00100000:0.0:1782222224.874842:0:7480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1782222224.874849:0:7480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3652:x1868795081829760:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1782222224.874865:0:7480:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1782222224.875882:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782222224.875902:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1868795081830144:0@lo:400:kworker.0 00000100:00100000:1.0:1782222224.875952:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222224.876020:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1868795081829888:0@lo:400:kworker.0 00000100:00100000:1.0:1782222224.876045:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222224.876080:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782222224.876087:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1868795081830016:0@lo:400:kworker.0 00000100:00100000:1.0:1782222224.876109:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222224.876131:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081830144 00000100:00100000:1.0:1782222224.876138:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081830144 00000100:00100000:1.0:1782222224.876182:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081829888 00000100:00100000:1.0:1782222224.876185:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081829888 00000100:00100000:1.0:1782222224.876198:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081830016 00000100:00100000:1.0:1782222224.876201:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081830016 00000100:00100000:1.0:1782222224.876214:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1782222224.876222:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08504c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1868795081830144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222224.876294:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08504c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1868795081830144:12345-0@lo:400:kworker.0 Request processed in 73us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222224.876301:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1782222224.876317:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1782222224.876321:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b784380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3653:x1868795081829888:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1782222224.876325:0:6527:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1782222224.876346:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b784380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3653:x1868795081829888:12345-0@lo:400:kworker.0 Request processed in 24us (301us total) trans 0 rc -107/-107 00000100:00100000:1.0:1782222224.876351:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1782222224.876360:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1782222224.876364:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b785180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3653:x1868795081830016:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1782222224.876368:0:6527:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1782222224.876386:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b785180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3653:x1868795081830016:12345-0@lo:400:kworker.0 Request processed in 20us (277us total) trans 0 rc -107/-107 00000100:00100000:1.0:1782222224.876390:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:1.0:1782222224.876411:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1782222224.876435:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074561ea00 x1868795081830144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222224.876454:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1868795081830144:0@lo:400:kworker.0 00000100:00080000:1.0:1782222224.876487:0:3653:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1782222224.876491:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8f0745631000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1782222224.876494:0:3653:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1782222224.879968:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081829632:0@lo:400:kworker.0 00000100:00100000:3.0:1782222224.880060:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222224.880190:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081829632 00000100:00100000:3.0:1782222224.880198:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081829632 00000100:00100000:3.0:1782222224.880267:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:3.0:1782222224.880277:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08513db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+19:3655:x1868795081829632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222224.880331:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08513db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12746f60-61b2-4e8e-97c6-1ec65f2f4df5+19:3655:x1868795081829632:12345-0@lo:400:kworker.0 Request processed in 56us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222224.880339:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:3.0:1782222224.880385:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081829632:0@lo:400:kworker.0 00000100:00100000:2.0:1782222224.880553:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081830272:0@lo:400:kworker.0 00000100:00100000:2.0:1782222224.880616:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222224.880650:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081830272 00000100:00100000:2.0:1782222224.880654:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081830272 00000100:00100000:2.0:1782222224.880685:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1782222224.880692:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0877152850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081830272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222224.880729:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0877152850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081830272:12345-0@lo:400:kworker.0 Request processed in 37us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222224.880735:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1782222224.880914:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081830272:0@lo:400:kworker.0 00000100:00100000:2.0:1782222224.880945:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782222224.880953:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1868795081830400:0@lo:400:kworker.0 00000100:00100000:2.0:1782222224.880980:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222224.881006:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081830400 00000100:00100000:2.0:1782222224.881010:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081830400 00000100:00100000:2.0:1782222224.881034:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1782222224.881039:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1868795081830400:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1782222224.881046:0:6527:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1782222224.881074:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1868795081830400:12345-0@lo:400:kworker.0 Request processed in 34us (93us total) trans 0 rc -107/-107 00000100:00100000:2.0:1782222224.881081:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:2.0:1782222224.881106:0:3654:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1782222224.881111:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8f0875aa2800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1782222224.881114:0:3654:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1782222224.881119:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8f0875aa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782222224.881122:0:3654:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 212 00000100:00080000:2.0:1782222224.881128:0:3654:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f0875aa2800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:2.0:1782222224.881153:0:3654:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f074561fb80 x1868795081830528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782222224.881178:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1868795081830400:0@lo:400:kworker.0 00000100:00100000:2.0:1782222224.881208:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1868795081830656:0@lo:400:kworker.0 00000100:00100000:2.0:1782222224.881253:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222224.881280:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081830656 00000100:00100000:2.0:1782222224.881284:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081830656 00000100:00100000:2.0:1782222224.881318:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:2.0:1782222224.881324:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1868795081830656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222224.881356:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1868795081830656:12345-0@lo:400:kworker.0 Request processed in 33us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222224.881362:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00080000:2.0:1782222224.881376:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1782222224.881391:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074561df80 x1868795081830656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222224.881401:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1868795081830656:0@lo:400:kworker.0 00000100:00100000:2.0:1782222224.881424:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782222224.881430:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081830784:0@lo:400:kworker.0 00000100:00100000:2.0:1782222224.881450:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222224.881470:0:8887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081830784 00000100:00100000:2.0:1782222224.881473:0:8887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081830784 00000100:00100000:2.0:1782222224.881496:0:8887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1782222224.881501:0:8887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081830784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222224.881530:0:8887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081830784:12345-0@lo:400:kworker.0 Request processed in 28us (79us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222224.881544:0:8887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:2.0:1782222224.881557:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782222224.881587:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081830784:0@lo:400:kworker.0 00000100:00100000:2.0:1782222224.881624:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1868795081830528:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1782222224.881646:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222224.881809:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081830528 00000100:00100000:3.0:1782222224.881813:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081830528 00000100:00100000:3.0:1782222224.881843:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1782222224.881849:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3652:x1868795081830528:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1782222224.881864:0:6528:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1782222224.881898:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3652:x1868795081830528:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 47us (249us total) trans 0 rc -19/-19 00000100:00100000:3.0:1782222224.881904:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:2.0:1782222224.882150:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f0875aa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782222224.882155:0:3652:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1782222224.882158:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1868795081830528:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1782222224.884944:0:7480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3652:x1868795081829760:12345-0@lo:38:kworker.0 Request processed in 10088us (10236us total) trans 0 rc -19/-19 00000100:00100000:0.0:1782222224.884958:0:7480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00080000:3.0:1782222224.885245:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f08513bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782222224.885251:0:3652:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1782222224.885255:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1868795081829760:0@lo:38:kworker.0 00000100:00080000:1.0:1782222224.898736:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8f0745631000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782222224.898750:0:3653:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 189 00000100:00080000:1.0:1782222224.898760:0:3653:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8f0745631000 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:1.0:1782222224.898830:0:3653:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f086b784700 x1868795081830912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782222224.898863:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1868795081830016:0@lo:400:kworker.0 00000100:00080000:1.0:1782222224.898896:0:3653:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1782222224.898900:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8f0848db2000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1782222224.898903:0:3653:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1782222224.898906:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8f0848db2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782222224.898910:0:3653:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 171 00000100:00080000:1.0:1782222224.898913:0:3653:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8f0848db2000 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:1.0:1782222224.898927:0:3653:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f086b786d80 x1868795081831040/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782222224.898936:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1868795081829888:0@lo:400:kworker.0 00000100:00100000:3.0:1782222224.899102:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3652:1868795081830912:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1782222224.899165:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222224.899217:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b786d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3652:1868795081831040:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1782222224.899260:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222224.899692:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081830912 00000100:00100000:1.0:1782222224.899700:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081830912 00000100:00100000:1.0:1782222224.899795:0:13817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081831040 00000100:00100000:1.0:1782222224.899799:0:13817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081831040 00000100:00100000:1.0:1782222224.899819:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1782222224.899825:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3652:x1868795081830912:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1782222224.899842:0:13817:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1782222224.899888:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3652:x1868795081830912:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 61us (722us total) trans 0 rc -19/-19 00000100:00100000:1.0:1782222224.899895:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1782222224.899914:0:13817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1782222224.899918:0:13817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3652:x1868795081831040:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1782222224.899925:0:13817:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1782222224.899947:0:13817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3652:x1868795081831040:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 27us (686us total) trans 0 rc -19/-19 00000100:00100000:1.0:1782222224.899952:0:13817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:3.0:1782222224.900089:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f0745631000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782222224.900095:0:3652:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1782222224.900098:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3652:1868795081830912:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1782222224.900107:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f0848db2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782222224.900110:0:3652:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1782222224.900113:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b786d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3652:1868795081831040:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:3.0:1782222224.938598:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222225.962932:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1782222226.933006:0:9523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1782222226.933016:0:9523:0:(genops.c:906:class_export_put()) final put ffff8f0843ca9800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1782222226.936985:0:6505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1782222226.936997:0:6505:0:(genops.c:906:class_export_put()) final put ffff8f0875d54000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1782222226.938923:0:15024:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0843ca9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1782222226.939007:0:15024:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f0843caf800 for lustre-OST0001 00000020:00000080:3.0:1782222226.939262:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0875d54000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1782222226.940005:0:491:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f087e832800 for lustre-MDT0000 00010000:00010000:0.0:1782222226.986667:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1782222227.114375:0:15217:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8f07473f8660 - data ffff8f0745805870/ffff8f074642dc00 00000020:01000000:3.0:1782222227.114740:0:15217:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8f0875bda5a0 - data ffff8f0866d6d5e8/ffff8f0848d0cc00 00000001:00000004:3.0:1782222227.127659:0:15217:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:0.0:1782222227.200583:0:15217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1782222227.200592:0:15217:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1782222227.200608:0:15217:0:(client.c:3149:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8f08504c9c00 x1868795081828736/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1782222230 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222227.200635:0:15217:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1782222227.204901:0:15217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1782222227.204908:0:15217:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:0.0:1782222227.204927:0:15217:0:(osp_dev.c:1636:osp_import_event()) got inactive 00000100:00100000:0.0:1782222227.204930:0:15217:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1782222227.205631:0:8884:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1782222227.205638:0:8884:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1782222227.205649:0:8884:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1782222227.206716:0:15217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1782222227.206721:0:15217:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:0.0:1782222227.206738:0:15217:0:(osp_dev.c:1636:osp_import_event()) got inactive 00000100:00100000:0.0:1782222227.206740:0:15217:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1782222227.208285:0:9973:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1782222227.208294:0:9973:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1782222227.208305:0:9973:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1782222227.209903:0:15217:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6810d9a 00000020:00000080:0.0:1782222227.209916:0:15217:0:(genops.c:906:class_export_put()) final put ffff8f08513bc800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1782222227.210277:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff8f08513bc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1782222227.215999:0:15217:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6810daf 00000020:00000080:0.0:1782222227.216014:0:15217:0:(genops.c:906:class_export_put()) final put ffff8f0849bc8000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1782222227.216039:0:15217:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1782222227.216045:0:15217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782222227.216054:0:15217:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1782222227.216065:0:15217:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff8f08780599c0) has no exports 00000020:00000080:3.0:1782222227.216215:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0849bc8000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:0.0:1782222227.216517:0:15217:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1782222227.216527:0:15217:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e68111e5 00000020:00000080:0.0:1782222227.216531:0:15217:0:(genops.c:906:class_export_put()) final put ffff8f07472a3000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1782222227.216548:0:15217:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1782222227.216564:0:15217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782222227.216574:0:15217:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1782222227.216577:0:15217:0:(genops.c:1579:class_disconnect_exports()) OBD device 28 (ffff8f0747568000) has no exports 00000020:00000080:0.0:1782222227.216584:0:15217:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e68111de 00000020:00000080:0.0:1782222227.216588:0:15217:0:(genops.c:906:class_export_put()) final put ffff8f07472a0800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1782222227.216899:0:15217:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1782222227.216904:0:15217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1782222227.216908:0:15217:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:0.0:1782222227.216913:0:15217:0:(osp_dev.c:1636:osp_import_event()) got inactive 00000100:00100000:0.0:1782222227.216915:0:15217:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1782222227.216942:0:15217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782222227.216950:0:15217:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1782222227.216955:0:15217:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e68110a3 00000020:00000080:0.0:1782222227.216959:0:15217:0:(genops.c:906:class_export_put()) final put ffff8f07463b1000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1782222227.216963:0:15217:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1782222227.216966:0:15217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782222227.216970:0:15217:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1782222227.216972:0:15217:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff8f07460f0000) has no exports 00000020:00000080:0.0:1782222227.216976:0:15217:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e681109c 00000020:00000080:0.0:1782222227.216978:0:15217:0:(genops.c:906:class_export_put()) final put ffff8f07463b6800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1782222227.217113:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff8f07472a3000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1782222227.217123:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff8f07472a0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1782222227.217146:0:491:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f07472a1000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1782222227.217153:0:491:0:(genops.c:906:class_export_put()) final put ffff8f07466f1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1782222227.217155:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff8f07466f1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1782222227.217159:0:491:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1782222227.217266:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff8f07463b1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1782222227.217271:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff8f07463b6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1782222227.218637:0:15217:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1782222227.218644:0:15217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1782222227.218647:0:15217:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:0.0:1782222227.218653:0:15217:0:(osp_dev.c:1636:osp_import_event()) got inactive 00000100:00100000:0.0:1782222227.218655:0:15217:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1782222227.218698:0:15217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782222227.218821:0:491:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f07463b2000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1782222227.219024:0:15217:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1782222227.219107:0:15217:0:(genops.c:906:class_export_put()) final put ffff8f07463b7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1782222227.219111:0:15217:0:(genops.c:865:class_export_destroy()) destroying export ffff8f07463b7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1782222227.219116:0:15217:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1782222227.219342:0:15217:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1782222227.219350:0:15217:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6810ea4 00000020:00000080:0.0:1782222227.219357:0:15217:0:(genops.c:906:class_export_put()) final put ffff8f0875f14000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1782222227.219368:0:15217:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1782222227.219372:0:15217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782222227.219378:0:15217:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1782222227.219381:0:15217:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff8f086b78cd40) has no exports 00000020:00000080:0.0:1782222227.219388:0:15217:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6810e9d 00000020:00000080:0.0:1782222227.219392:0:15217:0:(genops.c:906:class_export_put()) final put ffff8f0875f16800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1782222227.219661:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0875f14000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1782222227.219669:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0875f16800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1782222227.224323:0:15217:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1782222227.224332:0:15217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1782222227.224337:0:15217:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1782222227.224345:0:15217:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1782222227.224396:0:15217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782222227.224407:0:15217:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782222227.224435:0:15217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782222227.224438:0:15217:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782222227.224443:0:15217:0:(genops.c:906:class_export_put()) final put ffff8f08513bc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1782222227.224448:0:15217:0:(genops.c:865:class_export_destroy()) destroying export ffff8f08513bc000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1782222227.224455:0:15217:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782222227.224580:0:15217:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6810db6 00000020:00000080:2.0:1782222227.224589:0:15217:0:(genops.c:906:class_export_put()) final put ffff8f0849bcb000/lustre-MDD0000_UUID 00000020:01000000:2.0:1782222227.224594:0:15217:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1782222227.224598:0:15217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782222227.224602:0:15217:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1782222227.224605:0:15217:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff8f087805b380) has no exports 00000020:00000080:2.0:1782222227.224625:0:15217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782222227.224628:0:15217:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1782222227.224632:0:15217:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6810dbd 00000020:00000080:2.0:1782222227.224635:0:15217:0:(genops.c:906:class_export_put()) final put ffff8f0849bca000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1782222227.224642:0:15217:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f08490d0000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1782222227.224646:0:15217:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8f08490d0000 3 00000020:01000004:2.0:1782222227.224648:0:15217:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f08490d0000 from lustre-MDT0000 00000020:00000080:2.0:1782222227.224663:0:15217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782222227.224666:0:15217:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1782222227.224668:0:15217:0:(genops.c:906:class_export_put()) final put ffff8f08513b8000/lustre-MDT0000_UUID 00000020:00000080:2.0:1782222227.224669:0:15217:0:(genops.c:865:class_export_destroy()) destroying export ffff8f08513b8000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1782222227.224675:0:15217:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1782222227.224702:0:15217:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1782222227.224717:0:15217:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1782222227.224719:0:15217:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1782222227.224722:0:15217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782222227.224725:0:15217:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1782222227.224731:0:15217:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff8f0851397800 12746f60-61b2-4e8e-97c6-1ec65f2f4df5 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1782222227.224736:0:15217:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff8f0849204d40) has exports, disconnecting them 00000020:00080000:2.0:1782222227.224741:0:15217:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8f0851397800), last request at 1782221952 00000020:00000080:2.0:1782222227.224755:0:15217:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6810d5b 00000020:00010000:2.0:1782222227.224760:0:15217:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8f0851397800: total 2 00000100:00080000:2.0:1782222227.224763:0:15217:0:(import.c:65:import_set_state_nolock()) ffff8f086b7e3800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1782222227.224775:0:15217:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f0851397800): rc 0 00000020:00080000:2.0:1782222227.224779:0:15217:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff8f0849204d40) has no exports 00000100:00100000:2.0:1782222227.224838:0:6520:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8f08526c3a00:6520] 1 exiting: rc = 0 00000020:00010000:3.0:1782222227.224998:0:6515:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8f0851397800: total 2 00010000:00010000:3.0:1782222227.225047:0:6515:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8f0851397800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1782222227.225080:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0841459600/0xe2b7cc26e6811286 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2b7cc26e681127f expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222227.225096:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0841459200/0xe2b7cc26e6811294 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2b7cc26e681128d expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222227.225107:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f087fb82200/0xe2b7cc26e68114fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2b7cc26e68114f5 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222227.225116:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0875802a00/0xe2b7cc26e68112a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2b7cc26e681129b expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222227.225137:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f087fb83400/0xe2b7cc26e681125c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2b7cc26e6811255 expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222227.225147:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f08427dec00/0xe2b7cc26e6810e81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2b7cc26e6810e7a expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222227.225161:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f087fb82400/0xe2b7cc26e681150a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2b7cc26e6811503 expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222227.225171:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f087fb82e00/0xe2b7cc26e6811518 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2b7cc26e6811511 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222227.225182:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0875802600/0xe2b7cc26e681117c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2b7cc26e6811175 expref: 6 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222227.225208:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f08427dfe00/0xe2b7cc26e6810e73 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2b7cc26e6810e6c expref: 5 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222227.225220:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0875803400/0xe2b7cc26e68112cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2b7cc26e68112c5 expref: 4 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222227.225231:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0841458400/0xe2b7cc26e681126a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2b7cc26e6811263 expref: 3 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222227.225267:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0841459c00/0xe2b7cc26e6811278 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2b7cc26e6811271 expref: 2 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222227.225278:0:6515:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8f0851397800, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1782222227.225292:0:6515:0:(genops.c:906:class_export_put()) final put ffff8f0851397800/12746f60-61b2-4e8e-97c6-1ec65f2f4df5 00010000:00010000:3.0:1782222227.225299:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222227.225300:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222227.225302:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222227.225331:0:6521:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8f08429c8600:6521] 2 exiting: rc = 0 00000100:00100000:3.0:1782222227.225399:0:6519:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8f08429c9800:6519] 0 exiting: rc = 1 00000020:00000080:3.0:1782222227.225433:0:491:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f0875f10800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1782222227.225438:0:491:0:(genops.c:906:class_export_put()) final put ffff8f0849b44000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1782222227.225440:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0849b44000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1782222227.225444:0:491:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1782222227.225481:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0849bcb000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1782222227.225485:0:491:0:(genops.c:906:class_export_put()) final put ffff8f08513b9000/lustre-MDD0000_UUID 00000020:00000080:3.0:1782222227.225487:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff8f08513b9000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1782222227.225490:0:491:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1782222227.225514:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0849bca000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1782222227.225525:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0851397800/12746f60-61b2-4e8e-97c6-1ec65f2f4df5 for MGS 00000020:00000080:3.0:1782222227.225552:0:491:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f086b7e3800 for MGS 00000100:00100000:2.0:1782222227.225717:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225725:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225732:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225738:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225743:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225749:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225754:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225759:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225764:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225770:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225775:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225781:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225787:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225793:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225799:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225805:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225811:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225817:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225822:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225828:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225833:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225838:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225844:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225850:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225856:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225862:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225868:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225873:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225878:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225883:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225890:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225895:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225900:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225906:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225911:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225925:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225931:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225937:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225942:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225947:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225952:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225958:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225964:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225969:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225974:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225979:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225984:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225989:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225994:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.225999:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.226004:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.226010:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.226016:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.226021:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.226037:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.226043:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.226048:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.226053:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.226058:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.226063:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.226068:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.226074:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.226079:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222227.226085:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1782222227.227583:0:15217:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8f07457d9180 - data ffff8f0866f3e948/ffff8f074642d400 00000020:01000000:2.0:1782222227.227715:0:15217:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8f08455df1e0 - data ffff8f0866c26af8/ffff8f086b7a1c00 00000020:00000080:2.0:1782222227.228454:0:15217:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6810d3f 00000020:00000080:2.0:1782222227.228467:0:15217:0:(genops.c:906:class_export_put()) final put ffff8f086b6c6000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1782222227.228486:0:15217:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f08490d0000 from MGS, refs=2 00000020:01000004:2.0:1782222227.228500:0:15217:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8f08490d0000 2 00000020:01000004:2.0:1782222227.228504:0:15217:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f08490d0000 from MGS 00000020:00000080:2.0:1782222227.228527:0:15217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782222227.228533:0:15217:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1782222227.228536:0:15217:0:(genops.c:906:class_export_put()) final put ffff8f086b6c1800/MGS 00000020:00000080:2.0:1782222227.228539:0:15217:0:(genops.c:865:class_export_destroy()) destroying export ffff8f086b6c1800/MGS for MGS 00000020:01000000:2.0:1782222227.228545:0:15217:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1782222227.228619:0:15217:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1782222227.228623:0:15217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782222227.228628:0:15217:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1782222227.228634:0:15217:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8f0875aa4000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1782222227.228641:0:15217:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff8f0849200000) has exports, disconnecting them 00000020:00080000:2.0:1782222227.228645:0:15217:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8f0875aa4000), last request at 1782221952 00000020:00000080:2.0:1782222227.228650:0:15217:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6810e0a 00000020:00080000:2.0:1782222227.228663:0:15217:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f0875aa4000): rc 0 00000020:00000080:2.0:1782222227.228666:0:15217:0:(genops.c:906:class_export_put()) final put ffff8f0875aa4000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1782222227.228925:0:15024:0:(genops.c:865:class_export_destroy()) destroying export ffff8f086b6c6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1782222227.228933:0:15024:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0875aa4000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1782222227.231343:0:15217:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1782222227.231351:0:15217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782222227.231355:0:15217:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1782222227.231362:0:15217:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1782222227.231390:0:15024:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f0875aa0800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1782222227.231527:0:15217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782222227.231536:0:15217:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1782222227.231552:0:15217:0:(genops.c:906:class_export_put()) final put ffff8f0875aa5000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1782222227.231565:0:15217:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0875aa5000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1782222227.231576:0:15217:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1782222227.231659:0:15217:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8f08490d0000 1 00000020:00000080:3.0:1782222227.231664:0:15217:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6810d31 00000020:00000080:3.0:1782222227.231670:0:15217:0:(genops.c:906:class_export_put()) final put ffff8f08490d4800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1782222227.231679:0:15217:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1782222227.231687:0:15024:0:(genops.c:865:class_export_destroy()) destroying export ffff8f08490d4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1782222227.231697:0:15217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782222227.231701:0:15217:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1782222227.231714:0:15217:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff8f0849203380) has no exports 00000020:00000080:3.0:1782222227.305398:0:15217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782222227.305412:0:15217:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1782222227.305419:0:15217:0:(genops.c:906:class_export_put()) final put ffff8f08490d5000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1782222227.305424:0:15217:0:(genops.c:865:class_export_destroy()) destroying export ffff8f08490d5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1782222227.305430:0:15217:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1782222227.305648:0:15217:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff8f08490d6000 00000020:02000400:3.0:1782222227.305719:0:15217:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:0.0:1782222227.434742:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081831168:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782222227.435387:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222227.435468:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081831168 00000100:00100000:0.0:1782222227.435476:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081831168 00000100:00100000:0.0:1782222227.435524:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1782222227.435531:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081831168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782222227.435570:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782222227.435612:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081831168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222227.435619:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:0.0:1782222227.435637:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782222227.435670:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081831168:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1782222228.011006:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222228.970518:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081831296:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782222228.970627:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222228.971566:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081831296 00000100:00100000:2.0:1782222228.971581:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081831296 00000100:00100000:2.0:1782222228.971732:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1782222228.971749:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081831296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782222228.972192:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00080000:1.0:1782222228.972303:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782222228.972519:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081831296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 772us (1889us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222228.972531:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1782222228.972538:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081831296:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1782222229.035589:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782222229.994570:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1782222229.994578:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1782222229.994582:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f08513bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782222229.994589:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 423 00000100:00080000:1.0:1782222229.994595:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1782222229.994602:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8f08513bb000 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:1.0:1782222229.994624:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f086b786d80 x1868795081831552/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782222229.994671:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1782222229.994676:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1782222229.994677:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f0848db2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782222229.994681:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 423 00000100:00080000:1.0:1782222229.994693:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1782222229.994697:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8f0848db2000 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:1.0:1782222229.994711:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f086b784700 x1868795081831680/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782222229.994719:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1782222229.994722:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1782222229.994724:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f0745631000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782222229.994727:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 423 00000100:00080000:1.0:1782222229.994729:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1782222229.994732:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8f0745631000 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:1.0:1782222229.994741:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0747cfe680 x1868795081831808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782222229.994768:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1782222229.994771:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1782222229.994772:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f0875aa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782222229.994775:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 423 00000100:00080000:1.0:1782222229.994778:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1782222229.994781:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f0875aa2800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:1.0:1782222229.994790:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0747cfca80 x1868795081832192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782222229.994957:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b786d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1868795081831552:0@lo:38:kworker.0 00000100:00100000:0.0:1782222229.995030:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222229.995088:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3652:1868795081831680:0@lo:38:kworker.0 00000100:00100000:0.0:1782222229.995124:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222229.995153:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3652:1868795081831808:0@lo:38:kworker.0 00000100:00100000:0.0:1782222229.995173:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222229.995193:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1868795081832192:0@lo:38:kworker.0 00000100:00100000:0.0:1782222229.995215:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222229.995269:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1868795081831936:0@lo:400:kworker.0 00000100:00100000:0.0:1782222229.995293:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222229.995311:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782222229.995316:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081832064:0@lo:400:kworker.0 00000100:00100000:0.0:1782222229.995337:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222229.995364:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081831680 00000100:00100000:0.0:1782222229.995371:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081831680 00000100:00100000:0.0:1782222229.995397:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081831808 00000100:00100000:0.0:1782222229.995400:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081831808 00000100:00100000:0.0:1782222229.995407:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081832192 00000100:00100000:0.0:1782222229.995410:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081832192 00000100:00100000:0.0:1782222229.995415:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081831936 00000100:00100000:0.0:1782222229.995417:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081831936 00000100:00100000:0.0:1782222229.995447:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1782222229.995456:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1868795081831936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222229.995505:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1868795081831936:12345-0@lo:400:kworker.0 Request processed in 50us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222229.995512:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1782222229.995527:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1782222229.995531:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3652:x1868795081831680:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1782222229.995561:0:6527:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1782222229.998939:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1868795081832320:0@lo:400:kworker.0 00000100:00100000:3.0:1782222229.999041:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222229.999096:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782222229.999105:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081831424:0@lo:400:kworker.0 00000400:00000100:3.0:1782222229.999128:0:3653:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1868795081831424 offset 0 length 224: 4 00000100:00100000:3.0:1782222229.999147:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747532680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081832448:0@lo:400:kworker.0 00000100:00100000:3.0:1782222229.999175:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222229.999294:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081832064 00000100:00100000:2.0:1782222229.999305:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081832064 00000100:00100000:2.0:1782222229.999359:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081832448 00000100:00100000:2.0:1782222229.999363:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081832448 00000100:00100000:2.0:1782222229.999395:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1782222229.999405:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081832064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222229.999477:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081832064:12345-0@lo:400:kworker.0 Request processed in 72us (4137us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222229.999485:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1782222229.999507:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1782222229.999513:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081832448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222229.999558:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081832448:12345-0@lo:400:kworker.0 Request processed in 46us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222229.999565:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1782222229.999607:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747532680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081832448:0@lo:400:kworker.0 00000100:00100000:1.0:1782222229.999952:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081831552 00000100:00100000:1.0:1782222229.999958:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081831552 00000100:00100000:1.0:1782222229.999995:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1782222230.000000:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1868795081831552:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1782222230.000019:0:6531:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1782222230.000067:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1868795081831552:12345-0@lo:38:kworker.0 Request processed in 66us (5047us total) trans 0 rc -19/-19 00000100:00100000:1.0:1782222230.000074:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1782222230.008573:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081832320 00000100:00100000:1.0:1782222230.008586:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081832320 00000100:00100000:1.0:1782222230.008642:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1782222230.008653:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1868795081832320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222230.008761:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1868795081832320:12345-0@lo:400:kworker.0 Request processed in 109us (9720us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222230.008769:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1782222230.008789:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1782222230.008793:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3652:x1868795081831808:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1782222230.008812:0:6526:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1782222230.008843:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3652:x1868795081831808:12345-0@lo:38:kworker.0 Request processed in 48us (13669us total) trans 0 rc -19/-19 00000100:00100000:1.0:1782222230.008849:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1782222230.008861:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1782222230.008865:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3652:x1868795081832192:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1782222230.008873:0:6526:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1782222230.008911:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3652:x1868795081832192:12345-0@lo:38:kworker.0 Request processed in 44us (13695us total) trans 0 rc -19/-19 00000100:00100000:1.0:1782222230.008917:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00010000:00080000:2.0:1782222230.009010:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8f0747cfea00 x1868795081832320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222230.009028:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1868795081832320:0@lo:400:kworker.0 00000100:00080000:0.0:1782222230.015873:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f08513bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782222230.015883:0:3652:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1782222230.015888:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b786d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1868795081831552:0@lo:38:kworker.0 00000100:00080000:0.0:1782222230.015902:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f0745631000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782222230.015906:0:3652:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1782222230.015908:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3652:1868795081831808:0@lo:38:kworker.0 00000100:00080000:0.0:1782222230.015918:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f0875aa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782222230.015921:0:3652:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1782222230.015923:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1868795081832192:0@lo:38:kworker.0 00000100:00080000:0.0:1782222230.015965:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782222230.015970:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782222230.015991:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081832064:0@lo:400:kworker.0 00010000:00080000:0.0:1782222230.016005:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8f0747cff480 x1868795081831936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222230.016014:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1868795081831936:0@lo:400:kworker.0 00000100:00100000:0.0:1782222230.016173:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3652:x1868795081831680:12345-0@lo:38:kworker.0 Request processed in 20639us (21048us total) trans 0 rc -19/-19 00000100:00100000:0.0:1782222230.016183:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00080000:2.0:1782222230.016802:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f0848db2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782222230.016810:0:3652:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1782222230.016814:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3652:1868795081831680:0@lo:38:kworker.0 00010000:00010000:3.0:1782222230.059193:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222231.083448:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782222231.146878:0:13809:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:0.0:1782222231.200980:0:15418:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1782222231.223374:0:15418:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1782222231.223624:0:15418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875802200/0xe2b7cc26e681128d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811294 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222231.223639:0:15418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875802200/0xe2b7cc26e681128d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6811294 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222231.223645:0:15418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875802200/0xe2b7cc26e681128d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2b7cc26e6811294 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222231.223651:0:15418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.127@tcp lock: ffff8f0875802200/0xe2b7cc26e681128d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2b7cc26e6811294 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222231.223672:0:15418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1782222231.223678:0:15418:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1782222231.223704:0:15418:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782222231.223709:0:15418:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1782222231.223714:0:15418:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1782222231.223719:0:15418:0:(import.c:65:import_set_state_nolock()) ffff8f0848db2000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1782222231.223723:0:15418:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782222231.223725:0:15418:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1782222231.223729:0:15418:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1782222231.226186:0:15418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0840030000/0xe2b7cc26e681129b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68112a2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222231.226221:0:15418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0840030000/0xe2b7cc26e681129b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e68112a2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222231.226228:0:15418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0840030000/0xe2b7cc26e681129b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2b7cc26e68112a2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222231.227219:0:7468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782222231.227229:0:7468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f0875802200/0xe2b7cc26e681128d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2b7cc26e6811294 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222231.227712:0:15418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.127@tcp lock: ffff8f0840030000/0xe2b7cc26e681129b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2b7cc26e68112a2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222231.227739:0:15418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782222231.227748:0:15418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875802800/0xe2b7cc26e6811175 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681117c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222231.227756:0:15418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875802800/0xe2b7cc26e6811175 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e681117c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222231.227762:0:15418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875802800/0xe2b7cc26e6811175 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2b7cc26e681117c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222231.227767:0:15418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.127@tcp lock: ffff8f0875802800/0xe2b7cc26e6811175 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2b7cc26e681117c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222231.227784:0:15418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1782222231.227791:0:15418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e6811511 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811518 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222231.227798:0:15418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e6811511 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6811518 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222231.227819:0:15418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e6811511 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2b7cc26e6811518 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222231.227826:0:15418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e6811511 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2b7cc26e6811518 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222231.227834:0:15418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1782222231.227840:0:15418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f086732e200/0xe2b7cc26e6810e7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6810e81 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222231.227845:0:15418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f086732e200/0xe2b7cc26e6810e7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6810e81 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222231.227851:0:15418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f086732e200/0xe2b7cc26e6810e7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2b7cc26e6810e81 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222231.227856:0:15418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.127@tcp lock: ffff8f086732e200/0xe2b7cc26e6810e7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2b7cc26e6810e81 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222231.227864:0:15418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1782222231.227867:0:15418:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1782222231.227901:0:15418:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1782222231.227905:0:15418:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1782222231.227909:0:15418:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782222231.227914:0:15418:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1782222231.227920:0:15418:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff8f07466f3800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1782222231.227925:0:15418:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff8f0875d53000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1782222231.227929:0:15418:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff8f087e843380) has exports, disconnecting them 00000020:00080000:1.0:1782222231.227938:0:15418:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8f07466f3800), last request at 1782222230 00000020:00000080:1.0:1782222231.227945:0:15418:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e681113d 00000100:00080000:1.0:1782222231.227961:0:15418:0:(import.c:65:import_set_state_nolock()) ffff8f07466f4000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1782222231.228002:0:15418:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f07466f3800): rc 0 00000020:00000080:1.0:1782222231.228005:0:15418:0:(genops.c:906:class_export_put()) final put ffff8f07466f3800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1782222231.228014:0:15418:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8f0875d53000), last request at 1782222229 00000020:00000080:1.0:1782222231.228017:0:15418:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6811017 00000100:00080000:1.0:1782222231.228022:0:15418:0:(import.c:65:import_set_state_nolock()) ffff8f07463b0800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1782222231.228079:0:15418:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f0875d53000): rc 0 00000020:00000080:1.0:1782222231.228082:0:15418:0:(genops.c:906:class_export_put()) final put ffff8f0875d53000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1782222231.228091:0:15418:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa0b981c63ae0 00000100:00080000:1.0:1782222231.228110:0:15418:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782222231.228119:0:15418:0:(client.c:3600:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8f08504c8e00 x1868795081829248/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1782222239 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222231.228132:0:15418:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:1.0:1782222231.229059:0:15418:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1782222231.229067:0:15418:0:(import.c:65:import_set_state_nolock()) ffff8f08513bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:3.0:1782222231.229152:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1782222231.229160:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f0840030000/0xe2b7cc26e681129b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2b7cc26e68112a2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222231.229218:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00080000:1.0:1782222231.230001:0:15418:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1782222231.230007:0:15418:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:1.0:1782222231.230023:0:15418:0:(osp_dev.c:1636:osp_import_event()) got inactive 00000100:00080000:1.0:1782222231.230092:0:15418:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1782222231.230115:0:15418:0:(import.c:65:import_set_state_nolock()) ffff8f0745633000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1782222231.230216:0:7468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0875802200 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:0.0:1782222231.230222:0:7468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f0875802200/0xe2b7cc26e681128d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2b7cc26e6811294 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222231.230257:0:7468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f0875802200/0xe2b7cc26e681128d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2b7cc26e6811294 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782222231.230264:0:7468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f0875802200/0xe2b7cc26e681128d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2b7cc26e6811294 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782222231.230270:0:7468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1782222231.230273:0:7468:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1782222231.230276:0:7468:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1782222231.230307:0:7468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f0875802200/0xe2b7cc26e681128d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2b7cc26e6811294 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222231.230313:0:7468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782222231.230330:0:7468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f0875802200/0xe2b7cc26e681128d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2b7cc26e6811294 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222231.230337:0:7468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f0875802200/0xe2b7cc26e681128d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2b7cc26e6811294 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222231.230351:0:7468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782222231.230370:0:7468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e6811511 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2b7cc26e6811518 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222231.230376:0:7468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0840030c00 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:0.0:1782222231.230379:0:7468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e6811511 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2b7cc26e6811518 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222231.230385:0:7468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e6811511 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2b7cc26e6811518 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782222231.230411:0:7468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e6811511 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2b7cc26e6811518 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782222231.230417:0:7468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1782222231.230419:0:7468:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1782222231.230421:0:7468:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1782222231.230434:0:7468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e6811511 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2b7cc26e6811518 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222231.230440:0:7468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782222231.230447:0:7468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e6811511 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2b7cc26e6811518 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222231.230453:0:7468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f0840030c00/0xe2b7cc26e6811511 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2b7cc26e6811518 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222231.230462:0:7468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782222231.230466:0:7468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f086732e200/0xe2b7cc26e6810e7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2b7cc26e6810e81 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222231.230471:0:7468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f086732e200 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:0.0:1782222231.230474:0:7468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f086732e200/0xe2b7cc26e6810e7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2b7cc26e6810e81 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222231.230481:0:7468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f086732e200/0xe2b7cc26e6810e7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2b7cc26e6810e81 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782222231.230487:0:7468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f086732e200/0xe2b7cc26e6810e7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2b7cc26e6810e81 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782222231.230502:0:7468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1782222231.230504:0:7468:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1782222231.230506:0:7468:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1782222231.230520:0:7468:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f086732e200/0xe2b7cc26e6810e7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2b7cc26e6810e81 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222231.231005:0:7468:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782222231.231023:0:7468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f086732e200/0xe2b7cc26e6810e7a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2b7cc26e6810e81 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222231.231029:0:7468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f086732e200/0xe2b7cc26e6810e7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2b7cc26e6810e81 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222231.231044:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222231.231045:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222231.231047:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222231.231069:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081832704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782222231.231135:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222231.231183:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782222231.231189:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081832832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782222231.231213:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222231.231265:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782222231.231274:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3654:1868795081832960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782222231.231297:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222231.231329:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081832704 00000100:00100000:0.0:1782222231.231336:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081832704 00000100:00100000:0.0:1782222231.231379:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081832832 00000100:00100000:0.0:1782222231.231382:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081832832 00000100:00100000:0.0:1782222231.231408:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081832960 00000100:00100000:0.0:1782222231.231411:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081832960 00000100:00100000:0.0:1782222231.231422:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782222231.231429:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3655:x1868795081832704:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1782222231.231434:0:9532:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782222231 with bad export cookie 16336750640757804379 00010000:00010000:2.0:1782222231.232966:0:15419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222231.232978:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f0875802800/0xe2b7cc26e6811175 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2b7cc26e681117c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222231.232988:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0875802800 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:2.0:1782222231.232991:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f0875802800/0xe2b7cc26e6811175 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2b7cc26e681117c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222231.233001:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f0875802800/0xe2b7cc26e6811175 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2b7cc26e681117c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782222231.233017:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f0875802800/0xe2b7cc26e6811175 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2b7cc26e681117c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782222231.233023:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1782222231.233026:0:6514:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1782222231.233029:0:6514:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1782222231.233058:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f0875802800/0xe2b7cc26e6811175 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2b7cc26e681117c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222231.233064:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782222231.233082:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f0875802800/0xe2b7cc26e6811175 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2b7cc26e681117c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222231.233088:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f0875802800/0xe2b7cc26e6811175 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2b7cc26e681117c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222231.233105:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222231.233106:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222231.233109:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222231.233113:0:15419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222231.233115:0:15419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222231.233341:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f08504c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081829248:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782222231.233369:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782222231.233381:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081833088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782222231.233438:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1782222231.233467:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f07466f3800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1782222231.233512:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0875d53000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1782222231.233543:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f07466f4000 for lustre-MDT0001 00000020:00000080:2.0:1782222231.233555:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f07463b0800 for lustre-MDT0001 00000100:00080000:1.0:1782222231.233941:0:15418:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1782222231.233946:0:15418:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:1.0:1782222231.233958:0:15418:0:(osp_dev.c:1636:osp_import_event()) got inactive 00000100:00080000:1.0:1782222231.234017:0:15418:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1782222231.234034:0:15418:0:(import.c:65:import_set_state_nolock()) ffff8f0875aa2000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1782222231.234060:0:15418:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff8f087e843380) has no exports 00000100:00100000:2.0:1782222231.234803:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1868795081832576:0@lo:9:umount.0 00000100:00100000:2.0:1782222231.234858:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222231.234885:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1868795081833216:0@lo:9:umount.0 00000100:00100000:2.0:1782222231.234907:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222231.234942:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081832576 00000100:00100000:2.0:1782222231.234948:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081832576 00000100:00100000:2.0:1782222231.234999:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081833216 00000100:00100000:2.0:1782222231.235002:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081833216 00010000:00010000:3.0:1782222231.236034:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0840030000 already unused, calling callback (ffffffffc138ac20) 00000100:00100000:2.0:1782222231.236034:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 10000000:00010000:3.0:1782222231.236041:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f0840030000/0xe2b7cc26e681129b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2b7cc26e68112a2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222231.236049:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1868795081832576:12345-0@lo:9:umount.0 00010000:00010000:3.0:1782222231.236054:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f0840030000/0xe2b7cc26e681129b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2b7cc26e68112a2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782222231.236060:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f0840030000/0xe2b7cc26e681129b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2b7cc26e68112a2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782222231.236065:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1782222231.236068:0:6515:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:3.0:1782222231.236070:0:6515:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00000020:00000080:2.0:1782222231.236076:0:8440:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6811064 00000100:00080000:2.0:1782222231.236085:0:8440:0:(import.c:65:import_set_state_nolock()) ffff8f0746085800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782222231.236135:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1782222231.236166:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1782222231.236174:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3652:x1868795081833216:12345-0@lo:9:umount.0 00000020:00000080:3.0:1782222231.236186:0:14437:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e68111a6 00000100:00080000:3.0:1782222231.236190:0:14437:0:(import.c:65:import_set_state_nolock()) ffff8f07463b2800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782222231.236218:0:14437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1782222231.236309:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3652:x1868795081832576:12345-0@lo:9:umount.0 Request processed in 264us (1450us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222231.236316:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1782222231.236324:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3652:x1868795081833216:12345-0@lo:9:umount.0 Request processed in 151us (1416us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222231.236330:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:3.0:1782222231.236343:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782222231.236363:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f0745633000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1782222231.236372:0:3652:0:(osp_dev.c:1620:osp_import_event()) got disconnected 00000004:00080000:2.0:1782222231.236374:0:3652:0:(osp_dev.c:1636:osp_import_event()) got inactive 00000100:00100000:2.0:1782222231.236377:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1868795081832576:0@lo:9:umount.0 00000100:00080000:2.0:1782222231.236388:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f0875aa2000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1782222231.236391:0:3652:0:(osp_dev.c:1620:osp_import_event()) got disconnected 00010000:00010000:3.0:1782222231.236441:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f0840030000/0xe2b7cc26e681129b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2b7cc26e68112a2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222231.236449:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782222231.236469:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f0840030000/0xe2b7cc26e681129b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2b7cc26e68112a2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222231.236476:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f0840030000/0xe2b7cc26e681129b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2b7cc26e68112a2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222231.236488:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222231.236489:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222231.236491:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222231.236796:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782222231.237003:0:3652:0:(osp_dev.c:1636:osp_import_event()) got inactive 00000100:00100000:2.0:1782222231.237011:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1868795081833216:0@lo:9:umount.0 00000100:00100000:1.0:1782222231.239437:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081833088 00000100:00100000:1.0:1782222231.239452:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081833088 00000100:00100000:1.0:1782222231.239493:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782222231.239501:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0842b73850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3655:x1868795081832832:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1782222231.239509:0:6512:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782222231 with bad export cookie 16336750640757804379 00000100:00100000:1.0:1782222231.239595:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0842b73850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3655:x1868795081832832:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (8380us total) trans 0 rc -107/-107 00000100:00100000:1.0:1782222231.239603:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782222231.239621:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782222231.239625:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b784700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3654:x1868795081832960:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1782222231.239629:0:6512:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782222231 with bad export cookie 16336750640757804379 00000100:00100000:1.0:1782222231.239655:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b784700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3654:x1868795081832960:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (8356us total) trans 0 rc -107/-107 00000100:00100000:1.0:1782222231.239660:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782222231.239670:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782222231.239675:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3653:x1868795081833088:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1782222231.239679:0:6512:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782222231 with bad export cookie 16336750640757804379 00000100:00100000:1.0:1782222231.239719:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3653:x1868795081833088:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (6281us total) trans 0 rc -107/-107 00000100:00100000:1.0:1782222231.239724:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1782222231.239768:0:3654:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.127@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1782222231.239773:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8f08672fa800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1782222231.239776:0:3654:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1782222231.239832:0:3653:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.127@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1782222231.244427:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782222231.244435:0:6522:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782222231.244445:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:1.0:1782222231.258960:0:3654:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.127@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1782222231.258966:0:3654:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1782222231.258993:0:3654:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f086b786a00 x1868795081831424/t0(0) o400->MGC192.168.203.127@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1782222245 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222231.259008:0:3654:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f07474d1f80 x1868795081832704/t0(0) o103->MGC192.168.203.127@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1782222247 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222231.259018:0:3654:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f07474d0000 x1868795081832832/t0(0) o103->MGC192.168.203.127@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1782222247 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222231.259025:0:3654:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f07474d2d80 x1868795081832960/t0(0) o103->MGC192.168.203.127@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1782222247 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222231.259034:0:3654:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f074561fb80 x1868795081833088/t0(0) o103->MGC192.168.203.127@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1782222247 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1782222231.259042:0:3654:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1782222231.259045:0:3654:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1782222231.259046:0:3654:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1782222231.259817:0:3653:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8f08672fa800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1782222231.259847:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081831424:0@lo:400:kworker.0 00000100:00100000:2.0:1782222231.259891:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3653:1868795081833088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782222231.260656:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:0:1868795081833344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782222231.260712:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081832832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782222231.260721:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3655:1868795081832704:0@lo:103:ldlm_bl.0 00000400:00000100:2.0:1782222231.260790:0:9532:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1868795081832704 offset 224 length 224: 4 00000100:00100000:2.0:1782222231.260810:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3655:x1868795081832704:12345-0@lo:103:ldlm_bl.0 Request processed in 29380us (29675us total) trans 0 rc -107/-107 00000100:00100000:2.0:1782222231.260821:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1782222231.260875:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8f08672fa800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782222231.260882:0:3654:0:(import.c:512:import_select_connection()) MGC192.168.203.127@tcp: connect to NID 0@lo last attempt 151 00000100:00080000:1.0:1782222231.260889:0:3654:0:(import.c:626:import_select_connection()) MGC192.168.203.127@tcp: import ffff8f08672fa800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:1.0:1782222231.260916:0:3654:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0747531f80 x1868795081833472/t0(0) o250->MGC192.168.203.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782222231.260947:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3654:1868795081832960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782222231.262942:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3652:1868795081833472:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:2.0:1782222231.262997:0:3652:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1868795081833472 offset 0 length 520: 4 00000020:00080000:1.0:1782222231.267469:0:15418:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff8f087e843380) has no exports 00000020:01000000:0.0:1782222231.325694:0:15418:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8f07470d0ea0 - data ffff8f07458c2e58/ffff8f074652a000 00000020:01000000:0.0:1782222231.325849:0:15418:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8f087fbfd0c0 - data ffff8f0866e451b0/ffff8f087f8fb000 00000001:00000004:0.0:1782222231.340389:0:15418:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:0.0:1782222231.389327:0:15418:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782222231.389336:0:15418:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1782222231.389344:0:15418:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1782222231.392173:0:15418:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1782222231.392180:0:15418:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:2.0:1782222231.392199:0:15418:0:(osp_dev.c:1636:osp_import_event()) got inactive 00000100:00100000:2.0:1782222231.392202:0:15418:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1782222231.393970:0:8877:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1782222231.393977:0:8877:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:0.0:1782222231.393989:0:8877:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1782222231.394769:0:15418:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1782222231.394775:0:15418:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:2.0:1782222231.394787:0:15418:0:(osp_dev.c:1636:osp_import_event()) got inactive 00000100:00100000:2.0:1782222231.394790:0:15418:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1782222231.395293:0:9965:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1782222231.395297:0:9965:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1782222231.395307:0:9965:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1782222231.410510:0:15418:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6810ec0 00000020:00000080:3.0:1782222231.410532:0:15418:0:(genops.c:906:class_export_put()) final put ffff8f087e836800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1782222231.411041:0:15024:0:(genops.c:865:class_export_destroy()) destroying export ffff8f087e836800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1782222231.413583:0:15418:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6810ed5 00000020:00000080:3.0:1782222231.413595:0:15418:0:(genops.c:906:class_export_put()) final put ffff8f087e837000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1782222231.413646:0:15418:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1782222231.413652:0:15418:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782222231.413660:0:15418:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1782222231.413664:0:15418:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8f086b7899c0) has no exports 00000004:01000000:3.0:1782222231.413869:0:15418:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1782222231.413885:0:15418:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e681119f 00000020:00000080:3.0:1782222231.413890:0:15418:0:(genops.c:906:class_export_put()) final put ffff8f07466f5000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1782222231.416731:0:15024:0:(genops.c:865:class_export_destroy()) destroying export ffff8f087e837000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1782222231.417963:0:15418:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1782222231.417977:0:15418:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782222231.417991:0:15418:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1782222231.417996:0:15418:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff8f087fe93380) has no exports 00000020:00000080:3.0:1782222231.418005:0:15418:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6811198 00000020:00000080:3.0:1782222231.418014:0:15418:0:(genops.c:906:class_export_put()) final put ffff8f07472a1800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1782222231.418250:0:15024:0:(genops.c:865:class_export_destroy()) destroying export ffff8f07466f5000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:3.0:1782222231.425733:0:15418:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1782222231.425741:0:15418:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1782222231.425745:0:15418:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:3.0:1782222231.425754:0:15418:0:(osp_dev.c:1636:osp_import_event()) got inactive 00000100:00100000:3.0:1782222231.425756:0:15418:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1782222231.425818:0:15418:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782222231.425832:0:15418:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1782222231.425841:0:15418:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e681105d 00000020:00000080:3.0:1782222231.425851:0:15418:0:(genops.c:906:class_export_put()) final put ffff8f0746086800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1782222231.425869:0:15418:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1782222231.425876:0:15418:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782222231.425881:0:15418:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1782222231.425884:0:15418:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff8f087fb94d40) has no exports 00000020:00000080:3.0:1782222231.425891:0:15418:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6811056 00000020:00000080:3.0:1782222231.425895:0:15418:0:(genops.c:906:class_export_put()) final put ffff8f0745632000/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1782222231.426260:0:15418:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1782222231.426263:0:15418:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1782222231.426266:0:15418:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:3.0:1782222231.426269:0:15418:0:(osp_dev.c:1636:osp_import_event()) got inactive 00000100:00100000:3.0:1782222231.426271:0:15418:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1782222231.426309:0:15418:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782222231.426315:0:15418:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1782222231.426338:0:15418:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1782222231.426344:0:15418:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6810ef8 00000020:00000080:3.0:1782222231.426359:0:15418:0:(genops.c:906:class_export_put()) final put ffff8f087e833000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1782222231.426363:0:15418:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1782222231.426367:0:15418:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782222231.426370:0:15418:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1782222231.426373:0:15418:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff8f087f93b380) has no exports 00000020:00000080:3.0:1782222231.426377:0:15418:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6810ef1 00000020:00000080:3.0:1782222231.426379:0:15418:0:(genops.c:906:class_export_put()) final put ffff8f08513ba000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1782222231.426656:0:15024:0:(genops.c:865:class_export_destroy()) destroying export ffff8f07472a1800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1782222231.426666:0:15024:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f0875aa2000 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1782222231.427889:0:15024:0:(genops.c:906:class_export_put()) final put ffff8f07472a3800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1782222231.427897:0:15024:0:(genops.c:865:class_export_destroy()) destroying export ffff8f07472a3800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1782222231.427906:0:15024:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1782222231.428001:0:15024:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0746086800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1782222231.428006:0:15024:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0745632000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1782222231.428011:0:15024:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f0745633000 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1782222231.428016:0:15024:0:(genops.c:906:class_export_put()) final put ffff8f0745637800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1782222231.428018:0:15024:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0745637800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1782222231.428022:0:15024:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1782222231.428046:0:15024:0:(genops.c:865:class_export_destroy()) destroying export ffff8f087e833000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1782222231.428051:0:15024:0:(genops.c:865:class_export_destroy()) destroying export ffff8f08513ba000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1782222231.428802:0:15418:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1782222231.428807:0:15418:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1782222231.428811:0:15418:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1782222231.428818:0:15418:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1782222231.428868:0:15418:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782222231.428879:0:15418:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1782222231.428904:0:15418:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782222231.428908:0:15418:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1782222231.428911:0:15418:0:(genops.c:906:class_export_put()) final put ffff8f0875f17800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1782222231.428914:0:15418:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0875f17800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1782222231.428918:0:15418:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1782222231.429484:0:15418:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6810edc 00000020:00000080:2.0:1782222231.429493:0:15418:0:(genops.c:906:class_export_put()) final put ffff8f087e834800/lustre-MDD0001_UUID 00000020:01000000:2.0:1782222231.429500:0:15418:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1782222231.429505:0:15418:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782222231.429510:0:15418:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1782222231.429514:0:15418:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff8f087e844d40) has no exports 00000020:00000080:2.0:1782222231.429544:0:15418:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782222231.429548:0:15418:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1782222231.429552:0:15418:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6810ee3 00000020:00000080:2.0:1782222231.429556:0:15418:0:(genops.c:906:class_export_put()) final put ffff8f087e830000/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1782222231.429573:0:15418:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f0849b46800 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1782222231.429577:0:15418:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8f0849b46800 2 00000020:01000004:2.0:1782222231.429580:0:15418:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f0849b46800 from lustre-MDT0001 00000020:00000080:2.0:1782222231.429598:0:15418:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782222231.429602:0:15418:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1782222231.429605:0:15418:0:(genops.c:906:class_export_put()) final put ffff8f087e836000/lustre-MDT0001_UUID 00000020:00000080:2.0:1782222231.429607:0:15418:0:(genops.c:865:class_export_destroy()) destroying export ffff8f087e836000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1782222231.429614:0:15418:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1782222231.429648:0:15418:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1782222231.429653:0:15418:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1782222231.429655:0:15418:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782222231.429658:0:15418:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1782222231.429664:0:15418:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8f0875c74800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1782222231.429669:0:15418:0:(genops.c:1574:class_disconnect_exports()) OBD device 15 (ffff8f087fb919c0) has exports, disconnecting them 00000020:00080000:2.0:1782222231.429741:0:15418:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8f0875c74800), last request at 1782221972 00000020:00000080:2.0:1782222231.429748:0:15418:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6810f37 00000020:00080000:2.0:1782222231.429761:0:15418:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f0875c74800): rc 0 00000020:00000080:2.0:1782222231.429765:0:15418:0:(genops.c:906:class_export_put()) final put ffff8f0875c74800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1782222231.430467:0:15024:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f08513bb000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1782222231.430476:0:15024:0:(genops.c:906:class_export_put()) final put ffff8f085294d800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1782222231.430478:0:15024:0:(genops.c:865:class_export_destroy()) destroying export ffff8f085294d800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1782222231.430489:0:15024:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1782222231.430614:0:15024:0:(genops.c:865:class_export_destroy()) destroying export ffff8f087e834800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1782222231.430618:0:15024:0:(genops.c:906:class_export_put()) final put ffff8f087e833800/lustre-MDD0001_UUID 00000020:00000080:0.0:1782222231.430620:0:15024:0:(genops.c:865:class_export_destroy()) destroying export ffff8f087e833800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1782222231.430624:0:15024:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1782222231.430803:0:15024:0:(genops.c:865:class_export_destroy()) destroying export ffff8f087e830000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1782222231.430808:0:15024:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0875c74800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1782222231.488349:0:15418:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1782222231.488358:0:15418:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1782222231.488363:0:15418:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1782222231.488370:0:15418:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1782222231.492006:0:15418:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782222231.492020:0:15418:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1782222231.492029:0:15418:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8f0849b46800 1 00000020:00000080:2.0:1782222231.492047:0:15418:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6810e34 00000020:00000080:2.0:1782222231.492059:0:15418:0:(genops.c:906:class_export_put()) final put ffff8f0875d57800/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1782222231.492066:0:15418:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1782222231.492074:0:15418:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782222231.492079:0:15418:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1782222231.492083:0:15418:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff8f086b78b380) has no exports 00000020:00000080:2.0:1782222231.505341:0:15024:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f0848db2000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1782222231.505355:0:15024:0:(genops.c:906:class_export_put()) final put ffff8f0875d52000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1782222231.505358:0:15024:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0875d52000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1782222231.505371:0:15024:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1782222231.506777:0:15024:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0875d57800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1782222231.644795:0:15418:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782222231.644809:0:15418:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1782222231.644814:0:15418:0:(genops.c:906:class_export_put()) final put ffff8f0849b47800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1782222231.644819:0:15418:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0849b47800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1782222231.644831:0:15418:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1782222231.644942:0:15418:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff8f0849b45800 00000020:01000000:2.0:1782222231.644962:0:15418:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1782222231.644967:0:15418:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782222231.644971:0:15418:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1782222231.644975:0:15418:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff8f086b788000) has no exports 00000100:00100000:0.0:1782222231.646445:0:8465:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8f07460d0c00:8465] 3 exiting: rc = 0 00000100:00100000:0.0:1782222231.646589:0:6528:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8f086b63cc00:6528] 2 exiting: rc = 0 00000100:00100000:0.0:1782222231.646668:0:6527:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8f0852511400:6527] 1 exiting: rc = 0 00000100:00100000:1.0:1782222231.647849:0:13817:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8f074764cc00:13817] 4 exiting: rc = 0 00000100:00100000:3.0:1782222231.650122:0:6526:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8f0852511800:6526] 0 exiting: rc = 1 00000100:00100000:0.0:1782222231.650275:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650284:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650290:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650295:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650301:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650307:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650313:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650319:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650326:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650333:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650339:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650344:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650349:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650354:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650360:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650366:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650382:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650390:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650396:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650401:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650406:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650412:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650419:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650425:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650431:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650436:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650442:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650447:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650452:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650473:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650478:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650484:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650490:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650496:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650501:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650508:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650513:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650518:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650534:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650540:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650561:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650568:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650573:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650578:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650583:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650589:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650594:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650600:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650606:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650611:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650618:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650624:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650629:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650634:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650640:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650645:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650651:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650657:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650663:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650671:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650677:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650684:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650690:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.650696:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782222231.662757:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8f08780fc400:6529] 0 exiting: rc = 1 00000100:00100000:3.0:1782222231.664383:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8f08780fc000:6530] 1 exiting: rc = 0 00000100:00100000:2.0:1782222231.664885:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.664895:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.664902:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.664911:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.664920:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.664928:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.664935:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.664941:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.664946:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.664952:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.664958:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.664964:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.664970:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.664975:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.664981:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.664986:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.664991:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665008:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665013:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665018:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665023:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665028:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665033:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665038:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665043:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665047:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665052:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665056:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665061:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665065:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665071:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665076:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665080:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665085:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665089:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665095:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665100:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665105:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665110:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665115:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665121:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665126:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665131:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665136:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665142:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665147:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665152:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665157:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665164:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665169:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665176:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665182:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665195:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665203:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665209:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665215:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665220:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665225:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665230:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665254:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665260:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665266:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665273:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665278:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.665752:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8f0847067e00:6531] 0 exiting: rc = 1 00000100:00100000:3.0:1782222231.675419:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8f0847066c00:6532] 1 exiting: rc = 0 00000100:00100000:3.0:1782222231.675552:0:7480:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8f0849b3a400:7480] 2 exiting: rc = 0 00000100:00100000:2.0:1782222231.675643:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675658:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675671:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675682:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675691:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675703:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675714:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675749:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675757:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675763:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675769:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675775:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675781:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675786:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675792:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675798:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675804:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675810:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675816:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675836:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675843:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675849:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675867:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675873:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675880:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675885:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675891:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675897:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675903:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675909:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675915:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675934:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675942:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675948:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675953:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675960:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675966:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675973:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675980:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675987:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675992:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.675998:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.676005:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.676024:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.676031:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.676036:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.676042:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.676048:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.676054:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.676061:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.676066:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.676073:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.676078:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.676084:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.676091:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.676111:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.676117:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.676129:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.676155:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.676161:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.676167:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.676173:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.676181:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.676189:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.693635:0:6534:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8f085016bc00:6534] 1 exiting: rc = 0 00000100:00100000:3.0:1782222231.693731:0:6533:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8f0851306e00:6533] 0 exiting: rc = 1 00000100:00100000:2.0:1782222231.695681:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695692:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695698:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695704:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695710:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695715:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695721:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695725:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695731:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695736:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695742:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695746:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695751:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695757:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695763:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695767:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695773:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695778:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695784:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695789:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695794:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695799:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695804:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695809:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695814:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695819:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695824:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695842:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695847:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695852:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695857:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695861:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695866:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695872:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695877:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695883:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695887:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695891:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695897:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695901:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695906:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695911:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695917:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695922:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695926:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695932:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695936:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695941:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695945:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695950:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695955:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695960:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695966:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695971:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695977:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695981:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695985:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695990:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695995:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.695999:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.696005:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.696010:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.696023:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.696027:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.696763:0:6535:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8f085016b200:6535] 0 exiting: rc = 1 00000100:00100000:3.0:1782222231.696850:0:6536:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8f085016a000:6536] 1 exiting: rc = 0 00000100:00100000:2.0:1782222231.696894:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.696904:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.696910:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.696915:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.696920:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.696925:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.696930:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.696935:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.696943:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.696948:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.696953:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.696957:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.696966:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.696971:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.696976:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.696981:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.696986:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.696990:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.696995:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697003:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697008:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697013:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697020:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697025:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697030:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697035:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697468:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697479:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697484:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697489:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697495:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697500:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697517:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697533:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697538:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697543:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697548:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697554:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697560:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697566:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697571:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697578:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697583:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697589:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697594:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697598:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697605:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697610:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697615:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697620:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697760:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697769:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697779:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697784:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697790:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697795:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697840:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697847:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.697852:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.698869:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.699103:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.699109:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.699114:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.699119:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.699674:0:6537:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8f0843c86800:6537] 0 exiting: rc = 1 00000100:00100000:3.0:1782222231.699682:0:8889:0:(service.c:3183:ptlrpc_main()) mdt_fld_0002: service thread [ffff8f0875e88200:8889] 2 exiting: rc = 0 00000100:00100000:0.0:1782222231.699961:0:6538:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8f0843c86600:6538] 1 exiting: rc = 0 00000100:00100000:2.0:1782222231.700150:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700161:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700176:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700181:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700187:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700192:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700197:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700202:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700207:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700211:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700216:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700221:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700227:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700251:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700257:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700262:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700267:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700272:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700277:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700283:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700288:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700293:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700298:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700303:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700308:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700313:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700318:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700323:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700328:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700333:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700338:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700343:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700348:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700353:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700359:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700365:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700370:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700383:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700388:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700393:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700398:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700404:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700411:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700417:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700422:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700428:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700433:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700438:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700443:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700449:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700454:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700459:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700465:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700470:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700475:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700480:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700485:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700491:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700496:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700502:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700507:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700512:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700517:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.700533:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222231.701130:0:6539:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8f0843c87a00:6539] 0 exiting: rc = 1 00000100:00100000:3.0:1782222231.703946:0:6540:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8f0843c87400:6540] 1 exiting: rc = 0 00000100:00100000:1.0:1782222231.706943:0:6541:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8f0843c87800:6541] 2 exiting: rc = 0 00000100:00100000:2.0:1782222231.707352:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707368:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707373:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707388:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707426:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707434:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707440:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707446:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707461:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707474:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707488:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707498:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707504:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707511:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707517:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707534:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707540:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707545:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707551:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707557:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707563:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707590:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707596:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707602:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707608:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707614:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707619:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707625:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707630:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707636:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707641:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707647:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707653:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707658:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707663:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707669:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707675:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707680:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707687:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707692:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707698:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707703:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707709:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707722:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707727:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707747:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707753:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707759:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707764:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707769:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707775:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707780:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707786:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707791:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707796:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707801:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707806:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707811:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707816:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707822:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707827:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707833:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707839:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222231.707854:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1782222231.725465:0:15418:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782222231.725479:0:15418:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1782222231.725484:0:15418:0:(genops.c:906:class_export_put()) final put ffff8f085fcf4800/MDS_uuid 00000020:00000080:3.0:1782222231.725489:0:15418:0:(genops.c:865:class_export_destroy()) destroying export ffff8f085fcf4800/MDS_uuid for MDS 00000020:01000000:3.0:1782222231.725497:0:15418:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1782222231.725642:0:15418:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1782222232.106412:0:15419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222233.130718:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222234.155892:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782222235.116505:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) 12746f60-61b2-4e8e-97c6-1ec65f2f4df5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1782222235.116520:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) 12746f60-61b2-4e8e-97c6-1ec65f2f4df5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782222235.116524:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1782222235.116528:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1782222235.116533:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f0745631000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782222235.116544:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 429 00000100:00080000:3.0:1782222235.116552:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1782222235.116577:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8f0745631000 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:3.0:1782222235.116628:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0747ef5f80 x1868795081833600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782222235.116702:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1782222235.116706:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1782222235.116708:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f0875aa2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782222235.116712:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 429 00000100:00080000:3.0:1782222235.116715:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1782222235.116720:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f0875aa2800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:3.0:1782222235.116732:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0747ef4a80 x1868795081833856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782222235.116793:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1868795081833728:0@lo:400:kworker.0 00000400:00000100:3.0:1782222235.116869:0:3656:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868795081833728 offset 0 length 224: 4 00000100:00100000:3.0:1782222235.116965:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1868795081833984:0@lo:400:kworker.0 00000400:00000100:3.0:1782222235.116988:0:3653:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868795081833984 offset 0 length 224: 4 00000100:00100000:1.0:1782222235.117086:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3652:1868795081833600:0@lo:38:kworker.0 00000400:00000100:1.0:1782222235.117114:0:3652:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868795081833600 offset 0 length 520: 4 00000100:00100000:1.0:1782222235.117129:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1868795081833856:0@lo:38:kworker.0 00000400:00000100:1.0:1782222235.117146:0:3652:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868795081833856 offset 0 length 520: 4 00010000:00010000:0.0:1782222235.182963:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782222236.138791:0:15024:0:(pinger.c:231:ptlrpc_pinger_process_import()) 12746f60-61b2-4e8e-97c6-1ec65f2f4df5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1782222236.138802:0:15024:0:(pinger.c:249:ptlrpc_pinger_process_import()) 12746f60-61b2-4e8e-97c6-1ec65f2f4df5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782222236.138805:0:15024:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1782222236.138809:0:15024:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782222236.138879:0:15024:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1782222236.138884:0:15024:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1782222236.138951:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b784000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1868795081834112:0@lo:400:kworker.0 00000400:00000100:0.0:1782222236.139026:0:3654:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868795081834112 offset 0 length 224: 4 00000100:00100000:0.0:1782222236.139116:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1868795081834240:0@lo:400:kworker.0 00000400:00000100:0.0:1782222236.139137:0:3655:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868795081834240 offset 0 length 224: 4 00010000:00010000:2.0:1782222236.205919:0:15419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1782222236.528631:0:15620:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1782222236.549396:0:15620:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1782222236.549472:0:15620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875802000/0xe2b7cc26e6811271 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811278 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222236.549502:0:15620:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875802000/0xe2b7cc26e6811271 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6811278 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222236.549510:0:15620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875802000/0xe2b7cc26e6811271 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2b7cc26e6811278 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222236.549540:0:15620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.127@tcp lock: ffff8f0875802000/0xe2b7cc26e6811271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2b7cc26e6811278 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222236.549572:0:15620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1782222236.549580:0:15620:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1782222236.549614:0:15620:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1782222236.549629:0:15620:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f0747ef5f80 x1868795081833600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1782222255 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222236.549651:0:15620:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1782222236.549658:0:15620:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1782222236.549666:0:15620:0:(import.c:65:import_set_state_nolock()) ffff8f0745631000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1782222236.549670:0:15620:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1782222236.549674:0:15620:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f0747ef5f80 x1868795081833600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1782222255 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222236.549681:0:15620:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1782222236.549685:0:15620:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00010000:00010000:1.0:1782222236.549752:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782222236.549761:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f0875802000/0xe2b7cc26e6811271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2b7cc26e6811278 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222236.549769:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0875802000 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:1.0:1782222236.549774:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f0875802000/0xe2b7cc26e6811271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2b7cc26e6811278 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222236.549784:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f0875802000/0xe2b7cc26e6811271 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2b7cc26e6811278 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782222236.549792:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f0875802000/0xe2b7cc26e6811271 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2b7cc26e6811278 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782222236.549798:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1782222236.549801:0:6514:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1782222236.549804:0:6514:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1782222236.549842:0:6514:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f08672fa800 00010000:00010000:1.0:1782222236.549846:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f0875802000/0xe2b7cc26e6811271 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2b7cc26e6811278 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222236.549853:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f0875802000/0xe2b7cc26e6811271 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2b7cc26e6811278 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222236.549866:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222236.549868:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222236.549870:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222236.551344:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3652:1868795081833600:0@lo:38:kworker.0 00000100:00080000:1.0:1782222236.553626:0:15620:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1782222236.553648:0:15620:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f0747ef7b80 x1868795081833728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222251 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222236.553673:0:15620:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f086b784000 x1868795081834112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222252 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222236.553706:0:15620:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1782222236.553713:0:15620:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1782222236.553749:0:15620:0:(import.c:65:import_set_state_nolock()) ffff8f07415bf000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1782222236.554417:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1868795081833728:0@lo:400:kworker.0 00000100:00100000:0.0:1782222236.554474:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b784000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1868795081834112:0@lo:400:kworker.0 00000100:00100000:0.0:1782222236.554512:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3652:1868795081834368:0@lo:39:umount.0 00000400:00000100:0.0:1782222236.554575:0:3652:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868795081834368 offset 0 length 224: 4 00000001:00100000:2.0:1782222237.172210:0:9523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1782222237.172220:0:9523:0:(genops.c:906:class_export_put()) final put ffff8f07463b5800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1782222237.172334:0:15024:0:(genops.c:865:class_export_destroy()) destroying export ffff8f07463b5800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1782222237.172385:0:15024:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f07463b2800 for lustre-OST0001 00000001:00100000:3.0:1782222237.172468:0:8436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1782222237.172609:0:8436:0:(genops.c:906:class_export_put()) final put ffff8f0746086000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1782222237.172735:0:15024:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0746086000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1782222237.172756:0:15024:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f0746085800 for lustre-OST0000 00010000:00010000:0.0:1782222237.226559:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222238.250653:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222239.275425:0:15419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782222240.170594:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) 12746f60-61b2-4e8e-97c6-1ec65f2f4df5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1782222240.170611:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) 12746f60-61b2-4e8e-97c6-1ec65f2f4df5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782222240.170614:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1782222240.170617:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1782222240.170783:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1868795081834496:0@lo:400:kworker.0 00000400:00000100:0.0:1782222240.170870:0:3656:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868795081834496 offset 0 length 224: 4 00010000:00010000:1.0:1782222240.298587:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222241.322949:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222241.706379:0:3652:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782222231/real 1782222231] req@ffff8f0747531f80 x1868795081833472/t0(0) o250->MGC192.168.203.127@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1782222241 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222241.706412:0:3652:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f0747531f80 x1868795081833472/t0(0) o250->MGC192.168.203.127@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1782222241 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782222241.706432:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f08672fa800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782222241.706473:0:3652:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1782222241.706476:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3652:1868795081833472:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:3.0:1782222241.710760:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) 12746f60-61b2-4e8e-97c6-1ec65f2f4df5->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1782222241.710772:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1782222241.710808:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f08672fa800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782222241.710822:0:8:0:(import.c:512:import_select_connection()) MGC192.168.203.127@tcp: connect to NID 0@lo last attempt 430 00000100:00080000:3.0:1782222241.710828:0:8:0:(import.c:591:import_select_connection()) MGC192.168.203.127@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1782222241.710836:0:8:0:(import.c:626:import_select_connection()) MGC192.168.203.127@tcp: import ffff8f08672fa800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:3.0:1782222241.710872:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0747ef5180 x1868795081834624/t0(0) o250->MGC192.168.203.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782222241.710907:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1782222241.710912:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1782222241.711150:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1868795081834752:0@lo:400:kworker.0 00000400:00000100:1.0:1782222241.711201:0:3653:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868795081834752 offset 0 length 224: 4 00000100:00100000:0.0:1782222241.711413:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3652:1868795081834624:0@lo:250:kworker.0 00000400:00000100:0.0:1782222241.711438:0:3652:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1868795081834624 offset 0 length 520: 4 00010000:00010000:0.0:1782222242.346529:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222243.370573:0:15419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222244.395064:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222245.419059:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222246.442574:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222246.826408:0:3652:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782222236/real 1782222236] req@ffff8f0747533480 x1868795081834368/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782222246 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222246.826453:0:3652:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f0747533480 x1868795081834368/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782222246 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782222246.826474:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f07415bf000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1782222246.826496:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3652:1868795081834368:0@lo:39:umount.0 00000100:00080000:1.0:1782222246.829355:0:15620:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1782222246.829363:0:15620:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1782222246.829371:0:15620:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1782222246.830273:0:15620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb83a00/0xe2b7cc26e681127f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6811286 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222246.830288:0:15620:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb83a00/0xe2b7cc26e681127f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6811286 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222246.830296:0:15620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb83a00/0xe2b7cc26e681127f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2b7cc26e6811286 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222246.830302:0:15620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.127@tcp lock: ffff8f087fb83a00/0xe2b7cc26e681127f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2b7cc26e6811286 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222246.830331:0:15620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782222246.830353:0:15620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e6811503 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681150a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222246.830360:0:15620:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e6811503 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e681150a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222246.830367:0:15620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e6811503 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2b7cc26e681150a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222246.830374:0:15620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e6811503 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2b7cc26e681150a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222246.830396:0:15620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1782222246.830401:0:15620:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1782222246.830435:0:15620:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1782222246.830439:0:15620:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1782222246.830444:0:15620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782222246.830450:0:15620:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1782222246.830455:0:15620:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff8f087f9399c0) has no exports 00010000:00010000:3.0:1782222246.830457:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782222246.830466:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f087fb83a00/0xe2b7cc26e681127f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2b7cc26e6811286 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222246.830477:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83a00 already unused, calling callback (ffffffffc138ac20) 00000020:00080000:1.0:1782222246.830479:0:15620:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff8f087f9399c0) has no exports 10000000:00010000:3.0:1782222246.830482:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f087fb83a00/0xe2b7cc26e681127f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2b7cc26e6811286 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222246.830493:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f087fb83a00/0xe2b7cc26e681127f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2b7cc26e6811286 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782222246.830500:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f087fb83a00/0xe2b7cc26e681127f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2b7cc26e6811286 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782222246.830507:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1782222246.830510:0:6514:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1782222246.830512:0:6514:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1782222246.830527:0:6514:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f08672fa800 00010000:00010000:3.0:1782222246.830532:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f087fb83a00/0xe2b7cc26e681127f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2b7cc26e6811286 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222246.830645:0:15419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782222246.830652:0:15419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e6811503 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2b7cc26e681150a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222246.830660:0:15419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0840031a00 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:2.0:1782222246.830663:0:15419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e6811503 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2b7cc26e681150a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222246.830682:0:15419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e6811503 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2b7cc26e681150a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782222246.830689:0:15419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e6811503 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2b7cc26e681150a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782222246.830694:0:15419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1782222246.830697:0:15419:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1782222246.830699:0:15419:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1782222246.830706:0:15419:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f08672fa800 00010000:00010000:2.0:1782222246.830710:0:15419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e6811503 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2b7cc26e681150a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222246.830715:0:15419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f0840031a00/0xe2b7cc26e6811503 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2b7cc26e681150a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222246.830730:0:15419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222246.830732:0:15419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222246.830734:0:15419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222246.830944:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f087fb83a00/0xe2b7cc26e681127f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2b7cc26e6811286 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222246.830956:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222246.830957:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222246.830959:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1782222246.832086:0:15620:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8f07457d9d20 - data ffff8f0745885d80/ffff8f087fd18400 00000020:01000000:1.0:1782222246.832198:0:15620:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8f07457d99c0 - data ffff8f0866e6d438/ffff8f087fd55c00 00100000:10000000:0.0:1782222246.859560:0:15620:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1782222246.879465:0:15620:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6810fd1 00000020:00000080:1.0:1782222246.879479:0:15620:0:(genops.c:906:class_export_put()) final put ffff8f087e835800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1782222246.879495:0:15620:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f087fb98800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1782222246.879498:0:15620:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8f087fb98800 2 00000020:01000004:1.0:1782222246.879502:0:15620:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f087fb98800 from lustre-OST0000 00000020:00000080:1.0:1782222246.879522:0:15620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782222246.879532:0:15620:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1782222246.879547:0:15620:0:(genops.c:906:class_export_put()) final put ffff8f0875c72000/lustre-OST0000_UUID 00000020:00000080:1.0:1782222246.879550:0:15620:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0875c72000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1782222246.879567:0:15620:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1782222246.879618:0:15620:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1782222246.879622:0:15620:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1782222246.879625:0:15620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782222246.879630:0:15620:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1782222246.879637:0:15620:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8f0745635000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1782222246.879644:0:15620:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff8f07460f19c0) has exports, disconnecting them 00000020:00080000:1.0:1782222246.879649:0:15620:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8f0745635000), last request at 1782221990 00000020:00000080:1.0:1782222246.879652:0:15620:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6810ffb 00000020:00080000:1.0:1782222246.879662:0:15620:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f0745635000): rc 0 00000020:00000080:1.0:1782222246.879667:0:15620:0:(genops.c:906:class_export_put()) final put ffff8f0745635000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1782222246.880420:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f087e835800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1782222246.880443:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0745635000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00000100:00080000:3.0:1782222246.890306:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) 12746f60-61b2-4e8e-97c6-1ec65f2f4df5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1782222246.890321:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) 12746f60-61b2-4e8e-97c6-1ec65f2f4df5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782222246.890325:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1782222246.890328:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1782222246.890444:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782222246.890466:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1868795081834880:0@lo:400:kworker.0 00000400:00000100:3.0:1782222246.890541:0:3653:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868795081834880 offset 0 length 224: 4 00010000:01000000:3.0:1782222246.890641:0:15620:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1782222246.890647:0:15620:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782222246.890652:0:15620:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1782222246.890659:0:15620:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1782222246.890692:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f0745631000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1782222246.891322:0:15620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782222246.891336:0:15620:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1782222246.891343:0:15620:0:(genops.c:906:class_export_put()) final put ffff8f0745632800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1782222246.891349:0:15620:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0745632800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1782222246.891361:0:15620:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1782222246.891453:0:15620:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1782222246.891458:0:15620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782222246.891476:0:15620:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1782222246.891484:0:15620:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8f07415b9000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1782222246.891491:0:15620:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff8f087fb93380) has exports, disconnecting them 00000020:00080000:3.0:1782222246.891496:0:15620:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8f07415b9000), last request at 1782221990 00000020:00000080:3.0:1782222246.891500:0:15620:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6811010 00000020:00080000:3.0:1782222246.891518:0:15620:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f07415b9000): rc 0 00000020:00000080:3.0:1782222246.891524:0:15620:0:(genops.c:906:class_export_put()) final put ffff8f07415b9000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1782222246.892009:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f07415b9000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1782222246.990316:0:15620:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1782222246.990329:0:15620:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1782222246.990334:0:15620:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1782222246.990344:0:15620:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1782222246.990597:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f07415bf000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1782222246.990638:0:15620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782222246.990651:0:15620:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1782222246.990659:0:15620:0:(genops.c:906:class_export_put()) final put ffff8f07415bb800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1782222246.990664:0:15620:0:(genops.c:865:class_export_destroy()) destroying export ffff8f07415bb800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1782222246.990671:0:15620:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1782222246.990775:0:15620:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8f087fb98800 1 00000020:00000080:3.0:1782222246.990783:0:15620:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6810f99 00000020:00000080:3.0:1782222246.990791:0:15620:0:(genops.c:906:class_export_put()) final put ffff8f087fc54000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1782222246.990912:0:15620:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1782222246.990917:0:15620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782222246.990927:0:15620:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1782222246.990933:0:15620:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff8f087fb90000) has no exports 00000020:00000080:1.0:1782222246.992363:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8f087fc54000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1782222247.042047:0:15620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782222247.042061:0:15620:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1782222247.042066:0:15620:0:(genops.c:906:class_export_put()) final put ffff8f087fb9a800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1782222247.042071:0:15620:0:(genops.c:865:class_export_destroy()) destroying export ffff8f087fb9a800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1782222247.042077:0:15620:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1782222247.042186:0:15620:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff8f087fb9b800 00000020:02000400:1.0:1782222247.042230:0:15620:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1782222247.469595:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222248.490672:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222249.515218:0:15419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222250.542477:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1782222251.475893:0:15822:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1782222251.487762:0:15822:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1782222251.487882:0:15822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875803e00/0xe2b7cc26e6811255 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681125c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222251.487902:0:15822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875803e00/0xe2b7cc26e6811255 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e681125c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222251.487928:0:15822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875803e00/0xe2b7cc26e6811255 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2b7cc26e681125c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222251.487934:0:15822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.127@tcp lock: ffff8f0875803e00/0xe2b7cc26e6811255 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2b7cc26e681125c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222251.487971:0:15822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1782222251.487979:0:15822:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1782222251.488015:0:15822:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782222251.488030:0:15822:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f0747ef4a80 x1868795081833856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1782222255 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222251.488053:0:15822:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1782222251.488060:0:15822:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1782222251.488068:0:15822:0:(import.c:65:import_set_state_nolock()) ffff8f0875aa2800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1782222251.488073:0:15822:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782222251.488077:0:15822:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f0747ef4a80 x1868795081833856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1782222255 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222251.488083:0:15822:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1782222251.488087:0:15822:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00000100:00100000:3.0:1782222251.488158:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1868795081833856:0@lo:38:kworker.0 00000100:00080000:3.0:1782222251.489044:0:15822:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1782222251.489057:0:15822:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f0747ef4700 x1868795081833984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222251 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222251.489093:0:15822:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f086b784e00 x1868795081834240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222252 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222251.489111:0:15822:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f0747ef6a00 x1868795081834496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222256 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222251.489143:0:15822:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f0747ef7800 x1868795081834752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222257 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222251.489152:0:15822:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f0747ef5500 x1868795081834880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222262 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222251.489159:0:15822:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1782222251.489164:0:15822:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1782222251.489194:0:15822:0:(import.c:65:import_set_state_nolock()) ffff8f07472a5000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1782222251.489270:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3652:1868795081835008:0@lo:39:umount.0 00000400:00000100:3.0:1782222251.489347:0:3652:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868795081835008 offset 0 length 224: 4 00000100:00100000:3.0:1782222251.489488:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1868795081834240:0@lo:400:kworker.0 00000100:00100000:3.0:1782222251.489539:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1868795081834880:0@lo:400:kworker.0 00000100:00100000:3.0:1782222251.489548:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1868795081834752:0@lo:400:kworker.0 00000100:00100000:3.0:1782222251.489554:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1868795081833984:0@lo:400:kworker.0 00010000:00010000:1.0:1782222251.489838:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782222251.489850:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f0875803e00/0xe2b7cc26e6811255 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2b7cc26e681125c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222251.489862:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0875803e00 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:1.0:1782222251.489868:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f0875803e00/0xe2b7cc26e6811255 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2b7cc26e681125c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222251.489893:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f0875803e00/0xe2b7cc26e6811255 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2b7cc26e681125c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782222251.489901:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f0875803e00/0xe2b7cc26e6811255 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2b7cc26e681125c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782222251.489908:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1782222251.489911:0:6515:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1782222251.489914:0:6515:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1782222251.489933:0:6515:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f08672fa800 00010000:00010000:1.0:1782222251.489937:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f0875803e00/0xe2b7cc26e6811255 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2b7cc26e681125c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222251.489944:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f0875803e00/0xe2b7cc26e6811255 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2b7cc26e681125c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222251.489957:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222251.489958:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222251.489960:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222251.490275:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1868795081834496:0@lo:400:kworker.0 00010000:00010000:0.0:1782222251.562721:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782222252.011192:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) 12746f60-61b2-4e8e-97c6-1ec65f2f4df5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1782222252.011203:0:491:0:(pinger.c:249:ptlrpc_pinger_process_import()) 12746f60-61b2-4e8e-97c6-1ec65f2f4df5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1782222252.587025:0:15419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222253.610574:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222254.634780:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222255.658656:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222256.618690:0:3652:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782222241/real 1782222241] req@ffff8f0747ef5180 x1868795081834624/t0(0) o250->MGC192.168.203.127@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1782222256 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222256.618738:0:3652:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f0747ef5180 x1868795081834624/t0(0) o250->MGC192.168.203.127@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1782222256 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782222256.618765:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f08672fa800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782222256.618796:0:3652:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1782222256.618802:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3652:1868795081834624:0@lo:250:kworker.0 00000100:00080000:2.0:1782222256.619100:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) 12746f60-61b2-4e8e-97c6-1ec65f2f4df5->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1782222256.619107:0:491:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1782222256.619137:0:491:0:(import.c:65:import_set_state_nolock()) ffff8f08672fa800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782222256.619143:0:491:0:(import.c:512:import_select_connection()) MGC192.168.203.127@tcp: connect to NID 0@lo last attempt 440 00000100:00080000:2.0:1782222256.619150:0:491:0:(import.c:591:import_select_connection()) MGC192.168.203.127@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1782222256.619160:0:491:0:(import.c:626:import_select_connection()) MGC192.168.203.127@tcp: import ffff8f08672fa800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:2.0:1782222256.619207:0:491:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f074561fb80 x1868795081835136/t0(0) o250->MGC192.168.203.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782222256.619741:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3652:1868795081835136:0@lo:250:kworker.0 00000400:00000100:3.0:1782222256.619822:0:3652:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1868795081835136 offset 0 length 520: 4 00010000:00010000:2.0:1782222256.683678:0:15419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222257.707052:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222258.730691:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222259.754602:0:7468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222260.779066:0:15419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222261.738652:0:3652:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782222251/real 1782222251] req@ffff8f0747ef4a80 x1868795081835008/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782222261 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222261.738697:0:3652:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f0747ef4a80 x1868795081835008/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782222261 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782222261.738726:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f07472a5000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1782222261.738756:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3652:1868795081835008:0@lo:39:umount.0 00000100:00080000:0.0:1782222261.738938:0:15822:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1782222261.738944:0:15822:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1782222261.738950:0:15822:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1782222261.738998:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) 12746f60-61b2-4e8e-97c6-1ec65f2f4df5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1782222261.739006:0:491:0:(pinger.c:249:ptlrpc_pinger_process_import()) 12746f60-61b2-4e8e-97c6-1ec65f2f4df5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1782222261.741946:0:15822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e6811263 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681126a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222261.741974:0:15822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e6811263 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e681126a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222261.741982:0:15822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e6811263 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2b7cc26e681126a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222261.741989:0:15822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e6811263 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2b7cc26e681126a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222261.742109:0:15822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782222261.742121:0:15822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f074744c600/0xe2b7cc26e68114f5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68114fc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222261.742129:0:15822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f074744c600/0xe2b7cc26e68114f5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e68114fc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222261.742135:0:15822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f074744c600/0xe2b7cc26e68114f5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2b7cc26e68114fc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222261.742141:0:15822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.127@tcp lock: ffff8f074744c600/0xe2b7cc26e68114f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2b7cc26e68114fc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222261.745433:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782222261.745456:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e6811263 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2b7cc26e681126a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222261.745471:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0875803000 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:3.0:1782222261.745476:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e6811263 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2b7cc26e681126a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222261.745489:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e6811263 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2b7cc26e681126a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782222261.745498:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e6811263 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2b7cc26e681126a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782222261.745505:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1782222261.745508:0:6514:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1782222261.745527:0:6514:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f08672fa800 00010000:00010000:3.0:1782222261.745532:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e6811263 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2b7cc26e681126a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222261.745568:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f0875803000/0xe2b7cc26e6811263 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2b7cc26e681126a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222261.745593:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782222261.745598:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f074744c600/0xe2b7cc26e68114f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2b7cc26e68114fc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222261.745603:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744c600 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:3.0:1782222261.745607:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f074744c600/0xe2b7cc26e68114f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2b7cc26e68114fc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222261.745614:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f074744c600/0xe2b7cc26e68114f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2b7cc26e68114fc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782222261.745621:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f074744c600/0xe2b7cc26e68114f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2b7cc26e68114fc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782222261.745627:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1782222261.745630:0:6514:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1782222261.745636:0:6514:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f08672fa800 00010000:00010000:3.0:1782222261.745639:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f074744c600/0xe2b7cc26e68114f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2b7cc26e68114fc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222261.745646:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222261.745648:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222261.745651:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222261.752228:0:15822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782222261.752275:0:15822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f074744c600/0xe2b7cc26e68114f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2b7cc26e68114fc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782222261.752318:0:15822:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1782222261.752331:0:15822:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1782222261.752333:0:15822:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1782222261.752384:0:15822:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1782222261.752398:0:15822:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1782222261.752414:0:15822:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782222261.752421:0:15822:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1782222261.752427:0:15822:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff8f07460f4d40) has no exports 00000020:00080000:0.0:1782222261.752460:0:15822:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff8f07460f4d40) has no exports 00010000:00010000:1.0:1782222261.755467:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1782222261.760108:0:15822:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8f07462ab720 - data ffff8f07458c1798/ffff8f08815a8c00 00000020:01000000:0.0:1782222261.760894:0:15822:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8f07457d9300 - data ffff8f0745886e58/ffff8f087fd64c00 00100000:10000000:0.0:1782222261.773360:0:15822:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1782222261.789316:0:15822:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e68110f7 00000020:00000080:3.0:1782222261.789337:0:15822:0:(genops.c:906:class_export_put()) final put ffff8f07466f5800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1782222261.789359:0:15822:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f08815e6800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1782222261.789380:0:15822:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8f08815e6800 2 00000020:01000004:3.0:1782222261.789384:0:15822:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f08815e6800 from lustre-OST0001 00000020:00000080:3.0:1782222261.789446:0:15822:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782222261.789481:0:15822:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1782222261.789485:0:15822:0:(genops.c:906:class_export_put()) final put ffff8f0875a8c800/lustre-OST0001_UUID 00000020:00000080:3.0:1782222261.789489:0:15822:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0875a8c800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1782222261.789500:0:15822:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1782222261.789683:0:15822:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import 12746f60-61b2-4e8e-97c6-1ec65f2f4df5->MGS 00010000:00010000:3.0:1782222261.789714:0:15822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f086732f600/0xe2b7cc26e6810e6c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2b7cc26e6810e73 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782222261.789730:0:15822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f086732f600/0xe2b7cc26e6810e6c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2b7cc26e6810e73 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782222261.789746:0:15822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1782222261.789750:0:15822:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1782222261.789754:0:15822:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1782222261.789793:0:15822:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f08672fa800 00010000:00010000:3.0:1782222261.789797:0:15822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f086732f600/0xe2b7cc26e6810e6c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2b7cc26e6810e73 expref: -99 pid: 7456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222261.789814:0:15822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f0840030600/0xe2b7cc26e68112c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2b7cc26e68112cc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782222261.789820:0:15822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f0840030600/0xe2b7cc26e68112c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2b7cc26e68112cc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782222261.789825:0:15822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1782222261.789828:0:15822:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1782222261.789830:0:15822:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1782222261.789847:0:15822:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f08672fa800 00010000:00010000:3.0:1782222261.789851:0:15822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f0840030600/0xe2b7cc26e68112c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2b7cc26e68112cc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1782222261.789876:0:15822:0:(import.c:65:import_set_state_nolock()) ffff8f08672fa800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1782222261.789880:0:15822:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1782222261.789883:0:15822:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1782222261.789885:0:15822:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1782222261.789890:0:15822:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1782222261.789903:0:15822:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f074561fb80 x1868795081835136/t0(0) o250->MGC192.168.203.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1782222276 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1782222261.789933:0:15822:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1782222261.789937:0:15822:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1782222261.790074:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:12746f60-61b2-4e8e-97c6-1ec65f2f4df5:3652:1868795081835136:0@lo:250:kworker.0 00000020:00000080:2.0:1782222261.791281:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff8f07466f5800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:3.0:1782222261.792913:0:15822:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1782222261.792939:0:15822:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6810d4d 00000020:00000080:3.0:1782222261.792953:0:15822:0:(genops.c:906:class_export_put()) final put ffff8f085fcf0000/12746f60-61b2-4e8e-97c6-1ec65f2f4df5 00000020:01000000:3.0:1782222261.792980:0:15822:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.203.127@tcp (flags='') 00000020:00000080:3.0:1782222261.792989:0:15822:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782222261.792991:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff8f085fcf0000/12746f60-61b2-4e8e-97c6-1ec65f2f4df5 for MGC192.168.203.127@tcp 00000020:00000080:3.0:1782222261.792998:0:15822:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.127@tcp: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1782222261.793003:0:15822:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff8f087805cd40) has no exports 10000000:01000000:1.0:1782222261.793130:0:6523:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1782222261.794333:0:15822:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.127@tcp: client import never connected 00000100:00080000:3.0:1782222261.794342:0:15822:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1782222261.794347:0:15822:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1782222261.794351:0:15822:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1782222261.794354:0:15822:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1782222261.794430:0:15822:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782222261.794439:0:491:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f08672fa800 for MGC192.168.203.127@tcp 00000020:00000080:3.0:1782222261.794442:0:15822:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.127@tcp (uuid 12746f60-61b2-4e8e-97c6-1ec65f2f4df5) 00000020:00000080:2.0:1782222261.794451:0:491:0:(genops.c:906:class_export_put()) final put ffff8f08672f9800/12746f60-61b2-4e8e-97c6-1ec65f2f4df5 00000020:00000080:2.0:1782222261.794457:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff8f08672f9800/12746f60-61b2-4e8e-97c6-1ec65f2f4df5 for MGC192.168.203.127@tcp 00000020:01000000:3.0:1782222261.794461:0:15822:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:01000000:2.0:1782222261.794463:0:491:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.127@tcp (12746f60-61b2-4e8e-97c6-1ec65f2f4df5) 00000020:00000080:3.0:1782222261.794466:0:15822:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782222261.794472:0:15822:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1782222261.795311:0:15822:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8f0849b43800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1782222261.795319:0:15822:0:(genops.c:1574:class_disconnect_exports()) OBD device 25 (ffff8f087e8419c0) has exports, disconnecting them 00000020:00080000:3.0:1782222261.795324:0:15822:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8f0849b43800), last request at 1782222013 00000020:00000080:3.0:1782222261.795329:0:15822:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6811121 00000020:00080000:3.0:1782222261.795361:0:15822:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f0849b43800): rc 0 00000020:00000080:3.0:1782222261.795368:0:15822:0:(genops.c:906:class_export_put()) final put ffff8f0849b43800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1782222261.795524:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0849b43800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1782222261.799048:0:15822:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1782222261.799061:0:15822:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1782222261.799067:0:15822:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1782222261.799078:0:15822:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1782222261.799350:0:15822:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782222261.799363:0:15822:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1782222261.799374:0:15822:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1782222261.799386:0:15822:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782222261.799392:0:15822:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1782222261.799417:0:15822:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8f07472a6800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1782222261.799439:0:15822:0:(genops.c:1574:class_disconnect_exports()) OBD device 26 (ffff8f087e840000) has exports, disconnecting them 00000020:00080000:2.0:1782222261.799445:0:15822:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8f07472a6800), last request at 1782222013 00000020:00000080:2.0:1782222261.799450:0:15822:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6811136 00000020:00080000:2.0:1782222261.799470:0:15822:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f07472a6800): rc 0 00000020:00000080:2.0:1782222261.799478:0:15822:0:(genops.c:906:class_export_put()) final put ffff8f07472a6800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1782222261.801383:0:491:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f0875aa2800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1782222261.801928:0:491:0:(genops.c:906:class_export_put()) final put ffff8f0881596800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1782222261.801936:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0881596800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1782222261.801955:0:491:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1782222261.802222:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff8f07472a6800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1782222261.896213:0:15822:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1782222261.896227:0:15822:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1782222261.896263:0:15822:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1782222261.896274:0:15822:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1782222261.896513:0:7468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1782222261.896954:0:15419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000020:00000080:1.0:1782222261.896991:0:491:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8f07472a5000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1782222261.897169:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:1.0:1782222261.897548:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:1.0:1782222261.897909:0:6510:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8f085142c800:6510] 1 exiting: rc = 0 00000100:00100000:0.0:1782222261.899513:0:6509:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8f085142d200:6509] 0 exiting: rc = 1 00000100:00100000:3.0:1782222261.899703:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.900283:0:9532:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8f07414dfa00:9532] 3 exiting: rc = 0 00000100:00100000:1.0:1782222261.900379:0:6511:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8f085142d800:6511] 0 exiting: rc = 1 00000100:00100000:1.0:1782222261.900471:0:6513:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8f0844c82600:6513] 2 exiting: rc = 0 00000100:00100000:1.0:1782222261.900543:0:6512:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8f086b63b400:6512] 1 exiting: rc = 0 00000100:00100000:3.0:1782222261.901922:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.901936:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.901943:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.901950:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.901957:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.901964:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.901972:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.901978:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.901985:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.901992:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.901998:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902005:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902011:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902020:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902029:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902034:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902040:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902046:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902052:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902060:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902066:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902072:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902078:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902084:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902117:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902122:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902127:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902133:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902139:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902145:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902152:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902158:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902164:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902169:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902176:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902181:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902186:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902191:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902196:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902201:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902206:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902212:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902217:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902224:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902230:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902255:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902262:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902267:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902273:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902278:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902285:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902291:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902297:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902313:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902320:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902329:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902335:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902342:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902349:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902363:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902369:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902375:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902380:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.902386:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1782222261.907039:0:15822:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782222261.907056:0:15822:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1782222261.907063:0:15822:0:(genops.c:906:class_export_put()) final put ffff8f0881590800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1782222261.907070:0:15822:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0881590800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1782222261.907078:0:15822:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1782222261.907148:0:15822:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8f08815e6800 1 00000020:00000080:3.0:1782222261.907155:0:15822:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e68110c6 00000020:00000080:3.0:1782222261.907163:0:15822:0:(genops.c:906:class_export_put()) final put ffff8f0881590000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1782222261.907183:0:15822:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1782222261.907188:0:15822:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782222261.907193:0:15822:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1782222261.907198:0:15822:0:(genops.c:1579:class_disconnect_exports()) OBD device 23 (ffff8f07460f3380) has no exports 00000020:00000080:0.0:1782222261.932569:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff8f0881590000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1782222261.976211:0:15822:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782222261.976231:0:15822:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1782222261.976591:0:15822:0:(genops.c:906:class_export_put()) final put ffff8f08815e6000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1782222261.976599:0:15822:0:(genops.c:865:class_export_destroy()) destroying export ffff8f08815e6000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1782222261.976607:0:15822:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1782222261.977091:0:15822:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff8f08815e3800 00000020:01000000:2.0:1782222261.977121:0:15822:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1782222261.977127:0:15822:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782222261.977133:0:15822:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1782222261.977139:0:15822:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff8f087f93cd40) has no exports 00000020:00000080:2.0:1782222261.977168:0:15822:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782222261.977174:0:15822:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1782222261.977178:0:15822:0:(genops.c:906:class_export_put()) final put ffff8f087fc53800/OSS_uuid 00000020:00000080:2.0:1782222261.977181:0:15822:0:(genops.c:865:class_export_destroy()) destroying export ffff8f087fc53800/OSS_uuid for OSS 00000020:01000000:2.0:1782222261.977185:0:15822:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1782222261.977359:0:8443:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8f087fc45e00:8443] 2 exiting: rc = 0 00000100:00100000:1.0:1782222261.977367:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8f087e82b800:8440] 0 exiting: rc = 1 00000100:00080000:0.0:1782222261.977474:0:6522:0:(pinger.c:550:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1782222261.977898:0:8887:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8f087f90e800:8887] 3 exiting: rc = 0 00000100:00100000:1.0:1782222261.978018:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8f087fc44400:8442] 1 exiting: rc = 0 00000100:00100000:0.0:1782222261.978338:0:14437:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff8f07463c2a00:14437] 4 exiting: rc = 0 00000100:00100000:2.0:1782222261.978605:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.978616:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.978625:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.978632:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.978640:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.978648:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.978654:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.978661:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.978668:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.978674:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.978699:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.978705:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.978711:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.978717:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.978724:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.978730:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.978854:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.978863:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.978869:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.978874:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.978879:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.978885:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.978891:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.978898:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.978903:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.978909:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.978915:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.978920:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.978925:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.978931:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.978937:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.978942:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.978947:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.978953:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.978958:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.978965:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.978970:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.978976:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.978982:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.979022:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.979031:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.979037:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.979043:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.979049:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.979055:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.979067:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.979073:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.979078:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.979083:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.979089:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.979095:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.979101:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.979107:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.979114:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.979120:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.979126:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.979133:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.979138:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.979144:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.979150:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.979156:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.979163:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.979169:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.979180:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222261.981122:0:10157:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8f08450ce600:10157] 2 exiting: rc = 0 00000100:00100000:0.0:1782222261.981719:0:8444:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8f087fc45400:8444] 0 exiting: rc = 1 00000100:00100000:0.0:1782222261.984173:0:8445:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8f087fc44a00:8445] 1 exiting: rc = 0 00000100:00100000:2.0:1782222261.984319:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.984337:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.984346:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.984353:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.984359:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.984366:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.984371:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.984378:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.984386:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.984406:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.984415:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.984422:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.984427:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.984434:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.984440:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.984446:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.984544:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.984674:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.984681:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.984687:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.984693:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.984699:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.984705:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.984711:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.984717:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.984722:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.984728:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.985048:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.985064:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.985075:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.985087:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.985099:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.985110:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.985121:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.985132:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.985144:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.985154:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.985173:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.985186:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.985199:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.985211:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.985223:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.985261:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.985272:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.985284:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.985290:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.985295:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.985313:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.985320:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.985328:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.985345:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.985361:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.985367:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.985373:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.985380:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.985387:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.985406:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.985412:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.985417:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.985424:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.985436:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.985445:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.986715:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782222261.986862:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782222261.992559:0:8448:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8f087d44ea00:8448] 2 exiting: rc = 0 00000100:00100000:0.0:1782222261.993584:0:8446:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8f087d44ec00:8446] 0 exiting: rc = 1 00000100:00100000:2.0:1782222261.996143:0:8447:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8f087d44e200:8447] 1 exiting: rc = 0 00000100:00100000:3.0:1782222261.997131:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997143:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997149:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997155:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997161:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997169:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997176:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997182:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997189:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997196:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997202:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997209:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997215:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997224:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997231:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997267:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997274:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997336:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997344:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997352:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997358:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997365:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997372:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997379:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997385:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997393:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997399:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997414:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997424:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997431:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997437:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997444:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997450:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997457:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997463:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997470:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997487:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997495:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997501:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997508:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997515:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997539:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997547:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997554:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997561:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997568:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997573:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997580:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997586:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997790:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997802:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997809:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997824:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997831:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997838:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997844:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997849:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997869:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997895:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997903:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997910:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.997916:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.998058:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222261.998065:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.008850:0:8449:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8f087d44e400:8449] 0 exiting: rc = 1 00000100:00100000:1.0:1782222262.009162:0:8450:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8f087d44fc00:8450] 1 exiting: rc = 0 00000100:00100000:3.0:1782222262.009740:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.009750:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.009756:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.009761:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.009766:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.009772:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.009778:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.009783:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.009789:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.009795:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.009800:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.009806:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.009812:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.009818:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.009823:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.009828:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.009834:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.009840:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.009845:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.009851:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.009857:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.009863:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.009869:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.009905:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.009912:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.009926:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.009933:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.009938:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.009944:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.009951:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.009957:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.009963:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.009970:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.009975:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.009980:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.009985:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.009989:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.009996:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.010002:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.010007:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.010012:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.010018:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.010023:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.010029:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.010034:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.010040:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.010045:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.010049:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.010054:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.010060:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.010066:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.010072:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.010078:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.010084:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.010090:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.010096:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.010101:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.010108:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.010121:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.010126:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.010133:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.010138:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.010144:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.010158:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782222262.012518:0:8451:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8f085281a400:8451] 0 exiting: rc = 1 00000100:00100000:3.0:1782222262.013949:0:8452:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8f087fb5f000:8452] 1 exiting: rc = 0 00000100:00100000:0.0:1782222262.014221:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.014296:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.014315:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.014335:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.014342:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.014350:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.014357:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.014363:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.014372:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.014380:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.014390:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.014399:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.014414:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.014438:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.014446:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.014452:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.014460:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.014467:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.014483:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.014490:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.014497:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.014504:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.014510:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.014517:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.014524:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.014546:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.014554:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.014560:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.014566:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.014573:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.014579:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.014585:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.014592:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.014850:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.014856:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.014862:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.014869:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.014901:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.015031:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.015041:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.015049:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.015057:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.015064:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.015070:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.015078:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.015084:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.015091:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.015098:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.015104:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.015127:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.015134:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.015142:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.015149:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.015158:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.015166:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.015173:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.015182:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.015189:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.015197:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.015203:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.015211:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.015218:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.015225:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782222262.015266:0:15822:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1782222262.036121:0:15822:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1782222283.467771:0:16587:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1782222294.537940:0:17187:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1782222294.537950:0:17187:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1782222294.537952:0:17187:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1782222294.538517:0:17187:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8f0748460800 00000020:01000004:2.0:1782222294.538540:0:17187:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1782222294.538549:0:17187:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1782222294.538569:0:17187:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8f087fb919c0) 00000020:00000080:2.0:1782222294.538590:0:17187:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1782222294.673521:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1782222294.680370:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1782222294.696082:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1782222294.697563:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1782222294.701291:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1782222294.701986:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1782222294.702473:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1782222294.702665:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1782222294.702904:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1782222294.703142:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1782222294.703691:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1782222294.704078:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1782222294.706718:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1782222294.707647:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1782222294.708043:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1782222294.708667:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1782222294.713154:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1782222294.717523:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1782222294.718917:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1782222294.719709:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1782222294.720131:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1782222294.720527:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1782222294.721671:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1782222294.722917:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1782222294.727328:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1782222294.731536:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1782222294.734117:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1782222294.735957:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1782222294.736506:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1782222294.738380:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1782222294.739429:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1782222294.743646:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1782222294.746502:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1782222294.753082:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1782222294.757530:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1782222294.760774:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1782222294.763937:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1782222294.765375:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1782222294.766859:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1782222294.767940:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1782222294.774733:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1782222294.775510:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1782222294.776229:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1782222294.776852:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1782222294.777329:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1782222294.777757:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1782222294.793844:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1782222294.801827:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1782222294.803135:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1782222294.809114:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1782222294.810356:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1782222294.810702:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1782222294.811104:0:17187:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:0.0:1782222294.812458:0:17187:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1782222294.812913:0:17187:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1782222294.812926:0:17187:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1782222294.812944:0:17187:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe2b7cc26e681230a 00000020:01000004:0.0:1782222294.812954:0:17187:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1782222294.812961:0:17187:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1782222294.812967:0:17187:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f0748460800 from MGS 00000020:01000004:0.0:1782222294.812985:0:17187:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1782222294.813000:0:17187:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8f087f93b380) 00000020:00000080:0.0:1782222294.813013:0:17187:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1782222294.813391:0:17187:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f0748460800 from MGS, refs=2 00080000:01000000:0.0:1782222294.813398:0:17187:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1782222294.813404:0:17187:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe2b7cc26e6812318 00000100:00100000:0.0:1782222294.813572:0:17187:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1782222294.814185:0:17187:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1782222294.814192:0:17187:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1782222294.824455:0:17187:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1782222294.824486:0:17187:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1782222294.831316:0:17187:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782222294.831497:0:17187:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1782222294.831504:0:17187:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1782222294.838987:0:17187:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1782222294.839028:0:17187:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1782222294.839644:0:17187:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1782222294.839659:0:17187:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1782222294.843495:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222294.843503:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222294.843507:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222294.844126:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222294.845488:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222294.845492:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222294.847538:0:17187:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1782222294.849881:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1782222294.872490:0:17187:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1782222294.877448:0:17199:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1782222294.880232:0:17187:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1782222294.880477:0:17187:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1782222294.885615:0:17187:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1782222294.886300:0:17187:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782222294.886530:0:17187:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1782222294.886537:0:17187:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1782222294.892190:0:17187:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1782222294.892207:0:17187:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1782222294.895632:0:17187:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1782222294.895652:0:17187:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:0.0:1782222294.898698:0:17204:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1782222294.899793:0:17187:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1782222294.899826:0:17187:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.203.127@tcp' 00000020:01000004:2.0:1782222294.899829:0:17187:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1782222294.899874:0:17187:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.203.127@tcp (typ=mgc) 00000020:00000080:2.0:1782222294.901661:0:17187:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.127@tcp (ffff8f087fb94d40) 00000020:00000080:2.0:1782222294.901697:0:17187:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1782222294.901820:0:17187:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f0748460000@MGC192.168.203.127@tcp: add connection 192.168.203.127@tcp at head 00010000:00010000:2.0:1782222294.901994:0:17187:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.127@tcp-0 is initialized 00000040:01000000:2.0:1782222294.902001:0:17187:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.127@tcp ctxt 1 is initialized 10000000:01000000:3.0:1782222294.920853:0:17206:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1782222294.925524:0:17187:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.127@tcp (uuid a0873f67-836f-4221-9522-aadc54ad715e) 00000020:00000080:2.0:1782222294.925998:0:17187:0:(genops.c:1406:class_connect()) connect: client a0873f67-836f-4221-9522-aadc54ad715e, cookie 0xe2b7cc26e6812326 00000100:00080000:2.0:1782222294.926326:0:17187:0:(import.c:512:import_select_connection()) MGC192.168.203.127@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782222294.926335:0:17187:0:(import.c:626:import_select_connection()) MGC192.168.203.127@tcp: import ffff8f0748460000 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:2.0:1782222294.926383:0:17187:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f074561f100 x1868795081835264/t0(0) o250->MGC192.168.203.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782222294.926420:0:17187:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import a0873f67-836f-4221-9522-aadc54ad715e->MGS 00000020:01000004:2.0:1782222294.926492:0:17187:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1782222294.926500:0:17187:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1782222294.926520:0:17187:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8f087fb90000) 00000020:00000080:2.0:1782222294.926538:0:17187:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1782222294.926585:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a0873f67-836f-4221-9522-aadc54ad715e:3652:1868795081835264:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1782222294.926692:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222294.931670:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081835264 00000100:00100000:1.0:1782222294.931691:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081835264 00000100:00100000:1.0:1782222294.931751:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782222294.931762:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3652:x1868795081835264:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1782222294.931796:0:17201:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from a0873f67-836f-4221-9522-aadc54ad715e@0@lo t0 exp 0000000000000000 cur 493 last 0 00000020:00000080:1.0:1782222294.931838:0:17201:0:(genops.c:1406:class_connect()) connect: client a0873f67-836f-4221-9522-aadc54ad715e, cookie 0xe2b7cc26e6812334 00000100:00080000:1.0:1782222294.933480:0:17201:0:(import.c:65:import_set_state_nolock()) ffff8f0747d9c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782222294.933623:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+5:3652:x1868795081835264:12345-0@lo:250:mount.lustre.0 Request processed in 1857us (6934us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222294.933637:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782222294.941048:0:3652:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.203.127@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1782222294.941074:0:3652:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.203.127@tcp: connect to target with instance 0 00000100:00080000:1.0:1782222294.941087:0:3652:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.203.127@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1782222294.941094:0:3652:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1782222294.941100:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f0748460000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1782222294.941104:0:3652:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1782222294.941121:0:3652:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1782222294.941132:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a0873f67-836f-4221-9522-aadc54ad715e:3652:1868795081835264:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1782222294.963221:0:17187:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782222294.963475:0:17187:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1782222294.963490:0:17187:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1782222294.967333:0:17187:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1782222294.967349:0:17187:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1782222294.967975:0:17187:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1782222294.967983:0:17187:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1782222294.973512:0:17187:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782222294.973835:0:17187:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1782222294.974029:0:17187:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1782222294.982476:0:17187:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1782222294.982492:0:17187:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1782222295.090129:0:17187:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782222295.090802:0:17187:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1782222295.090809:0:17187:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1782222295.092885:0:17187:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1782222295.092897:0:17187:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1782222295.094124:0:17187:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782222295.094327:0:17187:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1782222295.094338:0:17187:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1782222295.100670:0:17187:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1782222295.100683:0:17187:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1782222295.102777:0:17187:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782222295.102965:0:17187:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1782222295.102972:0:17187:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1782222295.104490:0:17187:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1782222295.104501:0:17187:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1782222295.106086:0:17187:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782222295.108103:0:17187:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1782222295.108112:0:17187:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1782222295.117095:0:17187:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1782222295.117112:0:17187:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1782222295.138982:0:17187:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782222295.139190:0:17187:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1782222295.139197:0:17187:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1782222295.141156:0:17187:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1782222295.141171:0:17187:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1782222295.142175:0:17187:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1782222295.142355:0:17187:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1782222295.147795:0:17187:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1782222295.147826:0:17187:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1782222295.147832:0:17187:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.127@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1782222295.147939:0:17187:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.127@tcp ctxt 0 is initialized 00000020:01000004:0.0:1782222295.147972:0:17187:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.127@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1782222295.147976:0:17187:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1782222295.147978:0:17187:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782222295.147979:0:17187:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782222295.147980:0:17187:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782222295.147981:0:17187:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782222295.147983:0:17187:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782222295.147984:0:17187:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782222295.147986:0:17187:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782222295.147988:0:17187:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782222295.147989:0:17187:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782222295.147992:0:17187:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1782222295.147994:0:17187:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782222295.147995:0:17187:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782222295.147996:0:17187:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782222295.147997:0:17187:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782222295.147998:0:17187:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782222295.147999:0:17187:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782222295.148001:0:17187:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782222295.148002:0:17187:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782222295.148003:0:17187:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782222295.148004:0:17187:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782222295.148032:0:17187:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1782222295.148052:0:17187:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b784000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17187:1868795081835392:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1782222295.148144:0:17187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222295.148187:0:17187:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08455e26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782222295.148451:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081835392 00000100:00100000:3.0:1782222295.148459:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081835392 00000100:00100000:3.0:1782222295.148533:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782222295.148543:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+5:17187:x1868795081835392:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1782222295.148591:0:17203:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1782222295.148595:0:17203:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1782222295.148598:0:17203:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1782222295.155528:0:17224:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1782222295.156069:0:17203:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:0.0:1782222295.159454:0:17225:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1782222295.159462:0:17225:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1782222295.159478:0:17225:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1782222295.159481:0:17225:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1782222295.160009:0:17225:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1782222295.161635:0:17203:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1782222295.161656:0:17203:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1782222295.165725:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+5:17187:x1868795081835392:12345-0@lo:253:mount.lustre.0 Request processed in 17167us (17564us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222295.165745:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782222295.167318:0:17187:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b784000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17187:1868795081835392:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1782222295.167338:0:17187:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1782222295.167341:0:17187:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782222295.167343:0:17187:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782222295.167344:0:17187:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782222295.167345:0:17187:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782222295.167347:0:17187:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782222295.167348:0:17187:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782222295.167350:0:17187:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782222295.167351:0:17187:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782222295.167353:0:17187:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782222295.167355:0:17187:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1782222295.167384:0:17187:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f0748460800 from lustre-MDT0000 10000000:01000000:0.0:1782222295.167420:0:17187:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1782222295.167423:0:17187:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1782222295.167427:0:17187:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8f087fb94d40 10000000:01000000:0.0:1782222295.167432:0:17187:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782222295.167440:0:17187:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8f087fb94d40 from 1 10000000:01000000:0.0:1782222295.167443:0:17187:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1782222295.167486:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fcb9400/0xe2b7cc26e681233b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222295.167498:0:17187:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f087fcb9400/0xe2b7cc26e681233b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222295.167508:0:17187:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f087fcb9400/0xe2b7cc26e681233b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222295.167529:0:17187:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b784000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17187:1868795081835520:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782222295.167592:0:17187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222295.167649:0:17187:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f085091e600 going to sleep for 11 seconds 00000100:00100000:1.0:1782222295.167691:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081835520 00000100:00100000:1.0:1782222295.167708:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081835520 00000100:00100000:1.0:1782222295.167792:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782222295.167804:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+5:17187:x1868795081835520:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782222295.167825:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222295.167849:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f074744de00/0xe2b7cc26e6812342 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e681233b expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222295.167882:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f074744de00/0xe2b7cc26e6812342 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e681233b expref: 6 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222295.167895:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f074744de00/0xe2b7cc26e6812342 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e681233b expref: 6 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222295.167906:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744de00, rc 0) 00000100:00100000:1.0:1782222295.168077:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+6:17187:x1868795081835520:12345-0@lo:101:mount.lustre.0 Request processed in 274us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222295.168085:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782222295.170884:0:17187:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b784000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17187:1868795081835520:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782222295.170927:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f087fcb9400/0xe2b7cc26e681233b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812342 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222295.170943:0:17187:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f087fcb9400/0xe2b7cc26e681233b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6812342 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222295.171110:0:17187:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17187:1868795081835648:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782222295.171470:0:17187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222295.171597:0:17187:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747e4c600 going to sleep for 11 seconds 00000100:00100000:1.0:1782222295.174101:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081835648 00000100:00100000:1.0:1782222295.174121:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081835648 00000100:00100000:0.0:1782222295.174413:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782222295.174436:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+6:17187:x1868795081835648:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782222295.174601:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+6:17187:x1868795081835648:12345-0@lo:501:mount.lustre.0 Request processed in 173us (3132us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782222295.174609:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782222295.174736:0:17187:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17187:1868795081835648:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1782222295.174793:0:17187:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1782222295.174818:0:17187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fcb9400/0xe2b7cc26e681233b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812342 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222295.174846:0:17187:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f087fcb9400/0xe2b7cc26e681233b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812342 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782222295.174856:0:17187:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f0748460800 10000000:01000000:3.0:1782222295.174861:0:17187:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1782222295.174866:0:17187:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8f0748460800 10000000:01000000:3.0:1782222295.174868:0:17187:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1782222295.174872:0:17187:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff8f0748460800 from 1 10000000:01000000:3.0:1782222295.174874:0:17187:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1782222295.174907:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0746431e00/0xe2b7cc26e6812349 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222295.174914:0:17187:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f0746431e00/0xe2b7cc26e6812349 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222295.174923:0:17187:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0746431e00/0xe2b7cc26e6812349 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222295.174941:0:17187:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17187:1868795081835776:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782222295.174972:0:17187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222295.175010:0:17187:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747e4c600 going to sleep for 11 seconds 00000100:00100000:1.0:1782222295.175065:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081835776 00000100:00100000:1.0:1782222295.175074:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081835776 00000100:00100000:1.0:1782222295.175123:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782222295.175134:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+6:17187:x1868795081835776:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782222295.175516:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222295.175540:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f074744c200/0xe2b7cc26e6812350 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6812349 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222295.175574:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f074744c200/0xe2b7cc26e6812350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6812349 expref: 7 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222295.175587:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f074744c200/0xe2b7cc26e6812350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6812349 expref: 7 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222295.175597:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744c200, rc 0) 00000100:00100000:1.0:1782222295.175671:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+7:17187:x1868795081835776:12345-0@lo:101:mount.lustre.0 Request processed in 538us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222295.175679:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782222295.177404:0:17187:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17187:1868795081835776:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782222295.177431:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0746431e00/0xe2b7cc26e6812349 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812350 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222295.177444:0:17187:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0746431e00/0xe2b7cc26e6812349 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6812350 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782222295.177483:0:17187:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1782222295.177502:0:17187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0746431e00/0xe2b7cc26e6812349 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812350 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222295.177509:0:17187:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f0746431e00/0xe2b7cc26e6812349 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812350 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782222295.177518:0:17187:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1782222295.177524:0:17187:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782222295.177530:0:17187:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8f0748460800 10000000:01000000:3.0:1782222295.177533:0:17187:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1782222295.177536:0:17187:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1782222295.177538:0:17187:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1782222295.177570:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0746430600/0xe2b7cc26e6812357 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222295.177578:0:17187:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f0746430600/0xe2b7cc26e6812357 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222295.177587:0:17187:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0746430600/0xe2b7cc26e6812357 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222295.177606:0:17187:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17187:1868795081835904:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782222295.177661:0:17187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222295.177706:0:17187:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747e4c600 going to sleep for 11 seconds 00000100:00100000:1.0:1782222295.177755:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081835904 00000100:00100000:1.0:1782222295.177768:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081835904 00000100:00100000:1.0:1782222295.177842:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782222295.177854:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+7:17187:x1868795081835904:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782222295.177872:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222295.177891:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f074744c400/0xe2b7cc26e681235e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6812357 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222295.177918:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f074744c400/0xe2b7cc26e681235e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6812357 expref: 8 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222295.177945:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f074744c400/0xe2b7cc26e681235e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6812357 expref: 8 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222295.177956:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744c400, rc 0) 00000100:00100000:1.0:1782222295.178038:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+8:17187:x1868795081835904:12345-0@lo:101:mount.lustre.0 Request processed in 184us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222295.178045:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782222295.178111:0:17187:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17187:1868795081835904:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782222295.178126:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0746430600/0xe2b7cc26e6812357 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681235e expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222295.178135:0:17187:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0746430600/0xe2b7cc26e6812357 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e681235e expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222295.178262:0:17187:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17187:1868795081836032:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782222295.178297:0:17187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222295.178319:0:17187:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b72ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1782222295.178470:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081836032 00000100:00100000:1.0:1782222295.178477:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081836032 00000100:00100000:1.0:1782222295.178523:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782222295.178532:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+8:17187:x1868795081836032:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782222295.178718:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+9:17187:x1868795081836032:12345-0@lo:501:mount.lustre.0 Request processed in 187us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222295.178726:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782222295.179518:0:17187:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17187:1868795081836032:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782222295.179586:0:17187:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17187:1868795081836160:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782222295.179643:0:17187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222295.179728:0:17187:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b72ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1782222295.183494:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081836160 00000100:00100000:3.0:1782222295.183511:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081836160 00000100:00100000:3.0:1782222295.183620:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782222295.183646:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+9:17187:x1868795081836160:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782222295.188128:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+9:17187:x1868795081836160:12345-0@lo:503:mount.lustre.0 Request processed in 4476us (8475us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222295.188143:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782222295.188299:0:17187:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17187:1868795081836160:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782222295.189501:0:17226:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b786680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0873f67-836f-4221-9522-aadc54ad715e:17226:1868795081836288:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782222295.189607:0:17226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222295.189668:0:17226:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f085091ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1782222295.189817:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081836288 00000100:00100000:1.0:1782222295.189827:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081836288 00000100:00100000:1.0:1782222295.189890:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782222295.189899:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+9:17226:x1868795081836288:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782222295.190866:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+9:17226:x1868795081836288:12345-0@lo:502:llog_process_th.0 Request processed in 960us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222295.190881:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782222295.191515:0:17226:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b786680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0873f67-836f-4221-9522-aadc54ad715e:17226:1868795081836288:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782222295.191574:0:17226:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782222295.191591:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782222295.191594:0:17226:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1782222295.191599:0:17226:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1782222295.191602:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782222295.191623:0:17226:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8f087f938000) 00000020:00000080:0.0:1782222295.191644:0:17226:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1782222295.191650:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1782222295.191772:0:17226:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:0.0:1782222295.191780:0:17226:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe2b7cc26e681236c 00000020:00000080:0.0:1782222295.192039:0:17226:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1782222295.192045:0:17226:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782222295.192049:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782222295.192051:0:17226:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1782222295.192053:0:17226:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782222295.192070:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782222295.192072:0:17226:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1782222295.192076:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782222295.192086:0:17226:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8f087f93cd40) 00000020:00000080:0.0:1782222295.192104:0:17226:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1782222295.192110:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1782222295.192112:0:17226:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1782222295.192116:0:17226:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1782222295.192123:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1782222295.193533:0:17226:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f0748460800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1782222295.193562:0:17226:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8f087f9399c0) 00000020:00000080:0.0:1782222295.193577:0:17226:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1782222295.193666:0:17226:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1782222295.193674:0:17226:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe2b7cc26e6812381 00000020:00000080:0.0:1782222295.193826:0:17226:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1782222295.193833:0:17226:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1782222295.193838:0:17226:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xe2b7cc26e6812388 00080000:01000000:0.0:1782222295.193844:0:17226:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:0.0:1782222295.193848:0:17226:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe2b7cc26e681238f 00010000:00010000:3.0:1782222295.299495:0:17226:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1782222295.299963:0:17226:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:3.0:1782222295.301132:0:17226:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1782222295.301901:0:17226:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8f0747568000) 00000020:00000080:3.0:1782222295.301918:0:17226:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1782222295.301980:0:17226:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:3.0:1782222295.301986:0:17226:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe2b7cc26e681239d 00000020:00000080:1.0:1782222295.302891:0:17226:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1782222295.306609:0:17226:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xe2b7cc26e68123a4 00000020:00000080:1.0:1782222295.309355:0:17226:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1782222295.309370:0:17226:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782222295.309377:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222295.309384:0:17226:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1782222295.309389:0:17226:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1782222295.309392:0:17226:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1782222295.309394:0:17226:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782222295.309395:0:17226:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782222295.309397:0:17226:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1782222295.309400:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222295.309402:0:17226:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1782222295.309404:0:17226:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782222295.309409:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222295.309410:0:17226:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1782222295.309415:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1782222295.309464:0:17226:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1782222295.309480:0:17226:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782222295.309483:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222295.309484:0:17226:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1782222295.309487:0:17226:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782222295.309490:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222295.309491:0:17226:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1782222295.309493:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1782222295.309498:0:17226:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.127@tcp to nid 0x20000c0a8cb7f (192.168.203.127@tcp) 00000020:00000080:1.0:1782222295.309524:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782222295.309541:0:17226:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8f087fe94d40) 00000020:00000080:1.0:1782222295.309559:0:17226:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1782222295.309564:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1782222295.309618:0:17226:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1782222295.309625:0:17226:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1782222295.309630:0:17226:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe2b7cc26e68123b2 00010000:00080000:1.0:1782222295.309662:0:17226:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f085294f800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.127@tcp at head 00010000:00010000:1.0:1782222295.316562:0:17226:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1782222295.320726:0:17226:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1782222295.320743:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1782222295.320785:0:17226:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1782222295.320820:0:17226:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe2b7cc26e68123b9 00000100:00080000:1.0:1782222295.320834:0:17226:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782222295.320841:0:17226:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8f085294f800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:1.0:1782222295.320881:0:17226:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0747531c00 x1868795081836416/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782222295.320909:0:17226:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1782222295.320957:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081836416:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1782222295.320962:0:17226:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782222295.320968:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222295.320969:0:17226:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1782222295.320973:0:17226:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1782222295.320976:0:17226:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1782222295.320978:0:17226:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782222295.320979:0:17226:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782222295.320981:0:17226:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1782222295.320984:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222295.320985:0:17226:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1782222295.320988:0:17226:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1782222295.320993:0:17226:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1782222295.320997:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222295.320999:0:17226:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1782222295.321002:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1782222295.321006:0:17226:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.127@tcp to nid 0x20000c0a8cb7f (192.168.203.127@tcp) 00000100:00100000:0.0:1782222295.321030:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1782222295.321031:0:17226:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1782222295.321037:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782222295.321049:0:17226:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8f087fe919c0) 00000020:00000080:1.0:1782222295.321070:0:17226:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1782222295.321076:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1782222295.321136:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081836416 00000004:00080000:1.0:1782222295.321140:0:17226:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00000100:00100000:0.0:1782222295.321143:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081836416 00080000:01000000:1.0:1782222295.321146:0:17226:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:1.0:1782222295.321155:0:17226:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe2b7cc26e68123c7 00000100:00100000:0.0:1782222295.321177:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1782222295.321184:0:17226:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f085294e000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.127@tcp at head 00000100:00100000:0.0:1782222295.321186:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1868795081836416:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1782222295.321215:0:17213:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00010000:1.0:1782222295.321662:0:17226:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1782222295.324908:0:17226:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1782222295.327623:0:17226:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1782222295.330343:0:17226:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782222295.340348:0:17226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000100:00100000:0.0:1782222295.346691:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1868795081836416:12345-0@lo:38:llog_process_th.0 Request processed in 25496us (25654us total) trans 0 rc -19/-19 00000100:00100000:0.0:1782222295.346706:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1782222295.346834:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f085294f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782222295.346840:0:3652:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1782222295.346844:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081836416:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1782222295.347619:0:17226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1782222295.348672:0:17232:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1782222295.348678:0:17232:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1782222295.353367:0:17226:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782222295.353387:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1782222295.353437:0:17226:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1782222295.353459:0:17226:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe2b7cc26e68123ce 00000100:00080000:2.0:1782222295.353471:0:17226:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782222295.353477:0:17226:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f085294e000 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:2.0:1782222295.353513:0:17226:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f074561e680 x1868795081836544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782222295.353545:0:17226:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1782222295.353623:0:17226:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782222295.353627:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782222295.353629:0:17226:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1782222295.353632:0:17226:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1782222295.353635:0:17226:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1782222295.353636:0:17226:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1782222295.353637:0:17226:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1782222295.353639:0:17226:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1782222295.353641:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782222295.353642:0:17226:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1782222295.353645:0:17226:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1782222295.353649:0:17226:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1782222295.353652:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782222295.353653:0:17226:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1782222295.353656:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1782222295.353660:0:17226:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.127@tcp to nid 0x20000c0a8cb7f (192.168.203.127@tcp) 00000100:00100000:1.0:1782222295.353680:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081836544:0@lo:8:llog_process_th.0 00000020:01000000:2.0:1782222295.353694:0:17226:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1782222295.353697:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782222295.353708:0:17226:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8f087fb93380) 00000020:00000080:2.0:1782222295.353720:0:17226:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1782222295.353724:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000400:00000100:1.0:1782222295.353739:0:3652:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868795081836544 offset 0 length 520: 4 00000004:00080000:2.0:1782222295.353790:0:17226:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1782222295.353838:0:17226:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:2.0:1782222295.353845:0:17226:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe2b7cc26e68123dc 00010000:00080000:2.0:1782222295.353872:0:17226:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f07472a5800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.127@tcp at head 00010000:00010000:2.0:1782222295.354096:0:17226:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1782222295.354162:0:17226:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1782222295.354174:0:17226:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1782222295.356864:0:17226:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782222295.357103:0:17226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1782222295.357501:0:17226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1782222295.363348:0:17234:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1782222295.363357:0:17234:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1782222295.368868:0:17226:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1782222295.368884:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1782222295.368929:0:17226:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1782222295.368949:0:17226:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe2b7cc26e68123e3 00000100:00080000:1.0:1782222295.368959:0:17226:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782222295.368966:0:17226:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f07472a5800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:1.0:1782222295.369014:0:17226:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0747531c00 x1868795081836672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782222295.369041:0:17226:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1782222295.369095:0:17226:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782222295.369099:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222295.369101:0:17226:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1782222295.369104:0:17226:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782222295.369109:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222295.369110:0:17226:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782222295.369113:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782222295.369128:0:17226:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1782222295.369131:0:17226:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782222295.369134:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222295.369135:0:17226:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1782222295.369137:0:17226:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782222295.369139:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222295.369140:0:17226:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1782222295.369143:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1782222295.369175:0:17226:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747531880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0873f67-836f-4221-9522-aadc54ad715e:17226:1868795081836800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782222295.369275:0:17226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222295.369310:0:17226:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875bfcf00 going to sleep for 11 seconds 00000100:00100000:2.0:1782222295.369392:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081836800 00000100:00100000:2.0:1782222295.369400:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081836800 00000100:00100000:2.0:1782222295.369435:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782222295.369443:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+9:17226:x1868795081836800:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782222295.369570:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+9:17226:x1868795081836800:12345-0@lo:502:llog_process_th.0 Request processed in 126us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222295.369578:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782222295.369665:0:17226:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747531880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0873f67-836f-4221-9522-aadc54ad715e:17226:1868795081836800:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782222295.369692:0:17226:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782222295.369697:0:17226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782222295.369698:0:17226:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1782222295.369702:0:17226:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00100000:0.0:1782222295.369740:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081836672:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1782222295.369780:0:3652:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868795081836672 offset 0 length 520: 4 00000020:01000000:2.0:1782222295.369843:0:17187:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1782222295.369863:0:17187:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1782222295.369886:0:17187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0746430600/0xe2b7cc26e6812357 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681235e expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222295.369897:0:17187:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f0746430600/0xe2b7cc26e6812357 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681235e expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782222295.369915:0:17187:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8f0748460800 from 1 10000000:01000000:2.0:1782222295.369918:0:17187:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782222295.369943:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb83200/0xe2b7cc26e68123ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222295.369951:0:17187:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f087fb83200/0xe2b7cc26e68123ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222295.369959:0:17187:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f087fb83200/0xe2b7cc26e68123ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222295.369972:0:17187:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17187:1868795081836928:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1782222295.370000:0:17187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222295.370018:0:17187:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b72aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1782222295.370069:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081836928 00000100:00100000:3.0:1782222295.370074:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081836928 00000100:00100000:3.0:1782222295.370103:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782222295.370110:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+9:17187:x1868795081836928:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782222295.370120:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222295.370132:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0746431400/0xe2b7cc26e68123f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e68123ea expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222295.370153:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0746431400/0xe2b7cc26e68123f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e68123ea expref: 10 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222295.370163:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0746431400/0xe2b7cc26e68123f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68123ea expref: 10 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222295.370177:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746431400, rc 0) 00000100:00100000:3.0:1782222295.370224:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+10:17187:x1868795081836928:12345-0@lo:101:mount.lustre.0 Request processed in 113us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222295.370229:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782222295.371101:0:17187:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17187:1868795081836928:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782222295.371120:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f087fb83200/0xe2b7cc26e68123ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68123f1 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222295.371130:0:17187:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f087fb83200/0xe2b7cc26e68123ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e68123f1 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222295.371826:0:17187:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747530380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17187:1868795081837056:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1782222295.371885:0:17187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222295.371929:0:17187:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875bfc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782222295.372419:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081837056 00000100:00100000:0.0:1782222295.372428:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081837056 00000100:00100000:0.0:1782222295.372475:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782222295.372484:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+10:17187:x1868795081837056:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1782222295.372507:0:17202:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1782222295.372513:0:17202:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1782222295.372601:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+10:17187:x1868795081837056:12345-0@lo:256:mount.lustre.0 Request processed in 117us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222295.372607:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782222295.374646:0:17187:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747530380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17187:1868795081837056:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1782222295.375231:0:17187:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782222295.375289:0:17187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb83200/0xe2b7cc26e68123ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68123f1 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222295.375303:0:17187:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f087fb83200/0xe2b7cc26e68123ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68123f1 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782222295.375329:0:17187:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f0748460800 from 1 10000000:01000000:1.0:1782222295.375332:0:17187:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782222295.375374:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f074744da00/0xe2b7cc26e68123f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222295.375504:0:17187:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f074744da00/0xe2b7cc26e68123f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222295.375516:0:17187:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f074744da00/0xe2b7cc26e68123f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222295.375539:0:17187:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747530380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17187:1868795081837184:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782222295.375598:0:17187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222295.375640:0:17187:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875bfc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782222295.376096:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081837184 00000100:00100000:2.0:1782222295.376104:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081837184 00000100:00100000:2.0:1782222295.376152:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782222295.376160:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+10:17187:x1868795081837184:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782222295.376173:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222295.376197:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f087fb83000/0xe2b7cc26e68123ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e68123f8 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222295.376224:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fb83000/0xe2b7cc26e68123ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e68123f8 expref: 11 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222295.376264:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f087fb83000/0xe2b7cc26e68123ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68123f8 expref: 11 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222295.376285:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb83000, rc 0) 00000100:00100000:2.0:1782222295.376324:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+11:17187:x1868795081837184:12345-0@lo:101:mount.lustre.0 Request processed in 165us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222295.376331:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782222295.379507:0:17187:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747530380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17187:1868795081837184:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782222295.379537:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f074744da00/0xe2b7cc26e68123f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68123ff expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222295.379550:0:17187:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f074744da00/0xe2b7cc26e68123f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e68123ff expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222295.379652:0:17187:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747530380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17187:1868795081837312:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782222295.379709:0:17187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222295.379752:0:17187:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875bfc0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782222295.380100:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081837312 00000100:00100000:3.0:1782222295.380107:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081837312 00000100:00100000:3.0:1782222295.380155:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782222295.380163:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+11:17187:x1868795081837312:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782222295.380374:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+11:17187:x1868795081837312:12345-0@lo:501:mount.lustre.0 Request processed in 211us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222295.380382:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782222295.382735:0:17187:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747530380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17187:1868795081837312:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782222295.382810:0:17187:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747530380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17187:1868795081837440:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782222295.382893:0:17187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222295.382939:0:17187:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875bfc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782222295.383109:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081837440 00000100:00100000:0.0:1782222295.383117:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081837440 00000100:00100000:0.0:1782222295.383173:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782222295.383182:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+11:17187:x1868795081837440:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782222295.383947:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+11:17187:x1868795081837440:12345-0@lo:503:mount.lustre.0 Request processed in 763us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222295.383956:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782222295.384080:0:17187:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747530380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17187:1868795081837440:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782222295.384623:0:17236:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747530380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0873f67-836f-4221-9522-aadc54ad715e:17236:1868795081837568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782222295.384669:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222295.384702:0:17236:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875bfc000 going to sleep for 11 seconds 00000100:00100000:2.0:1782222295.384753:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081837568 00000100:00100000:2.0:1782222295.384759:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081837568 00000100:00100000:2.0:1782222295.384799:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782222295.384809:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+11:17236:x1868795081837568:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782222295.385384:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+11:17236:x1868795081837568:12345-0@lo:502:llog_process_th.0 Request processed in 575us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222295.385392:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782222295.385536:0:17236:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747530380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0873f67-836f-4221-9522-aadc54ad715e:17236:1868795081837568:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782222295.385562:0:17236:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782222295.385572:0:17236:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222295.385574:0:17236:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1782222295.385580:0:17236:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f0748460800 00000020:00000080:1.0:1782222295.385583:0:17236:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782222295.385590:0:17236:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782222295.385592:0:17236:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222295.385594:0:17236:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1782222295.385596:0:17236:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782222295.385598:0:17236:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222295.385599:0:17236:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1782222295.385602:0:17236:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f0748460800 00000020:00000080:1.0:1782222295.385604:0:17236:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782222295.385663:0:17236:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782222295.385668:0:17236:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222295.385669:0:17236:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1782222295.385671:0:17236:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782222295.385673:0:17236:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222295.385674:0:17236:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1782222295.385678:0:17236:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f0748460800 00000020:00000080:1.0:1782222295.385680:0:17236:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782222295.385696:0:17236:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782222295.385699:0:17236:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222295.385706:0:17236:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1782222295.385709:0:17236:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782222295.385712:0:17236:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222295.385714:0:17236:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1782222295.385717:0:17236:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f0748460800 00000020:00000080:1.0:1782222295.385719:0:17236:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1782222295.385759:0:17236:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747530380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0873f67-836f-4221-9522-aadc54ad715e:17236:1868795081837696:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782222295.385797:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222295.385828:0:17236:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875bfc000 going to sleep for 11 seconds 00000100:00100000:2.0:1782222295.385882:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081837696 00000100:00100000:2.0:1782222295.385887:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081837696 00000100:00100000:2.0:1782222295.385915:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782222295.385922:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+11:17236:x1868795081837696:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782222295.386005:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+11:17236:x1868795081837696:12345-0@lo:502:llog_process_th.0 Request processed in 81us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222295.386011:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782222295.395137:0:17236:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747530380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0873f67-836f-4221-9522-aadc54ad715e:17236:1868795081837696:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782222295.395200:0:17236:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782222295.395217:0:17236:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222295.395219:0:17236:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1782222295.395224:0:17236:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1782222295.402078:0:17187:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1782222295.402116:0:17187:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782222295.402142:0:17187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f074744da00/0xe2b7cc26e68123f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68123ff expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222295.402156:0:17187:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f074744da00/0xe2b7cc26e68123f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68123ff expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782222295.402635:0:17187:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1782222295.402640:0:17187:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f0748460800 10000000:01000000:2.0:1782222295.402643:0:17187:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f0748460800 10000000:01000000:2.0:1782222295.402648:0:17187:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782222295.402654:0:17187:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8f0748460800 from 1 10000000:01000000:2.0:1782222295.402657:0:17187:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782222295.402693:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb83a00/0xe2b7cc26e6812406 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222295.402703:0:17187:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f087fb83a00/0xe2b7cc26e6812406 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222295.402712:0:17187:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f087fb83a00/0xe2b7cc26e6812406 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222295.402736:0:17187:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17187:1868795081837824:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1782222295.402800:0:17187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222295.402838:0:17187:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b72a180 going to sleep for 11 seconds 00000100:00100000:2.0:1782222295.402878:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081837824 00000100:00100000:2.0:1782222295.402884:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081837824 00000100:00100000:2.0:1782222295.402925:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782222295.402933:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+11:17187:x1868795081837824:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782222295.402947:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222295.402959:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f087fb82000/0xe2b7cc26e681240d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6812406 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222295.402980:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fb82000/0xe2b7cc26e681240d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6812406 expref: 12 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222295.403007:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f087fb82000/0xe2b7cc26e681240d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6812406 expref: 12 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222295.403016:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb82000, rc 0) 00000100:00100000:2.0:1782222295.403930:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+12:17187:x1868795081837824:12345-0@lo:101:mount.lustre.0 Request processed in 120us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222295.403944:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782222295.404016:0:17187:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17187:1868795081837824:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782222295.404034:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f087fb83a00/0xe2b7cc26e6812406 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681240d expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222295.404046:0:17187:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f087fb83a00/0xe2b7cc26e6812406 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e681240d expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222295.409582:0:17187:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17187:1868795081837952:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782222295.409645:0:17187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222295.409677:0:17187:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b72a180 going to sleep for 11 seconds 00000100:00100000:3.0:1782222295.409853:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081837952 00000100:00100000:3.0:1782222295.409860:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081837952 00000100:00100000:3.0:1782222295.409934:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782222295.409942:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+12:17187:x1868795081837952:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782222295.410068:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+12:17187:x1868795081837952:12345-0@lo:501:mount.lustre.0 Request processed in 116us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222295.410076:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782222295.411818:0:17187:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17187:1868795081837952:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782222295.411893:0:17187:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17187:1868795081838080:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782222295.413469:0:17187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222295.413510:0:17187:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b72a180 going to sleep for 11 seconds 00000100:00100000:2.0:1782222295.413538:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081838080 00000100:00100000:2.0:1782222295.413544:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081838080 00000100:00100000:2.0:1782222295.413584:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782222295.413591:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+12:17187:x1868795081838080:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782222295.413707:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+12:17187:x1868795081838080:12345-0@lo:503:mount.lustre.0 Request processed in 115us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222295.413713:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782222295.413763:0:17187:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17187:1868795081838080:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782222295.431848:0:17241:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747530380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0873f67-836f-4221-9522-aadc54ad715e:17241:1868795081838208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782222295.431939:0:17241:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222295.431986:0:17241:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875bfc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782222295.432040:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081838208 00000100:00100000:2.0:1782222295.432047:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081838208 00000100:00100000:2.0:1782222295.432108:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782222295.432117:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+12:17241:x1868795081838208:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782222295.432296:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+12:17241:x1868795081838208:12345-0@lo:502:llog_process_th.0 Request processed in 178us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222295.432305:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782222295.432500:0:17241:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747530380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0873f67-836f-4221-9522-aadc54ad715e:17241:1868795081838208:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1782222295.432559:0:17241:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1782222295.432573:0:17241:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8f087fe90000) 00000020:00000080:1.0:1782222295.432591:0:17241:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1782222295.432740:0:17241:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f0748460800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1782222295.432745:0:17241:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f0748460800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1782222295.432748:0:17241:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8f0748460800 4 00010000:00080000:1.0:1782222295.432774:0:17241:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f0746083000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.127@tcp at head 00010000:00010000:0.0:1782222295.448408:0:17241:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1782222295.448523:0:17241:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1782222295.448572:0:17241:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1782222295.448585:0:17241:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xe2b7cc26e681241b 00000100:00080000:0.0:1782222295.448596:0:17241:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782222295.448614:0:17241:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8f0746083000 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:0.0:1782222295.448651:0:17241:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f086b784a80 x1868795081838336/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782222295.448686:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b784a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3652:1868795081838336:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1782222295.448768:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782222295.448818:0:17241:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1782222295.452040:0:17241:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b785f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0873f67-836f-4221-9522-aadc54ad715e:17241:1868795081838464:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782222295.452129:0:17241:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222295.452170:0:17241:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0850178d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782222295.452565:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081838464 00000100:00100000:2.0:1782222295.452573:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081838464 00000100:00100000:2.0:1782222295.452621:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782222295.452629:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+12:17241:x1868795081838464:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782222295.452770:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+12:17241:x1868795081838464:12345-0@lo:502:llog_process_th.0 Request processed in 140us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222295.452778:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782222295.453368:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081838336 00000100:00100000:2.0:1782222295.453375:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081838336 00000100:00100000:2.0:1782222295.453402:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782222295.453408:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b785c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3652:x1868795081838336:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1782222295.453464:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b785c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3652:x1868795081838336:12345-0@lo:38:llog_process_th.0 Request processed in 55us (4697us total) trans 0 rc -11/-11 00000100:00100000:2.0:1782222295.453470:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782222295.453513:0:3652:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782222295.453520:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f0746083000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782222295.453524:0:3652:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1782222295.453528:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b784a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3652:1868795081838336:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1782222295.453603:0:17241:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b785f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0873f67-836f-4221-9522-aadc54ad715e:17241:1868795081838464:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782222295.453657:0:17241:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747530380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0873f67-836f-4221-9522-aadc54ad715e:17241:1868795081838592:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782222295.453702:0:17241:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222295.453734:0:17241:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875bfcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1782222295.454365:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081838592 00000100:00100000:2.0:1782222295.454372:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081838592 00000100:00100000:2.0:1782222295.454416:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782222295.454424:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+12:17241:x1868795081838592:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782222295.455319:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+12:17241:x1868795081838592:12345-0@lo:502:llog_process_th.0 Request processed in 891us (1612us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222295.455330:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782222295.457153:0:17241:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747530380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0873f67-836f-4221-9522-aadc54ad715e:17241:1868795081838592:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1782222295.457792:0:17241:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1782222295.458098:0:17187:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1782222295.458124:0:17187:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782222295.458151:0:17187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb83a00/0xe2b7cc26e6812406 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681240d expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222295.458163:0:17187:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f087fb83a00/0xe2b7cc26e6812406 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681240d expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1782222295.458229:0:17187:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1782222295.458231:0:17187:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782222295.458564:0:17187:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782222295.458565:0:17187:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782222295.458567:0:17187:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782222295.458568:0:17187:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782222295.458570:0:17187:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782222295.458571:0:17187:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782222295.458573:0:17187:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782222295.458575:0:17187:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782222295.458579:0:17187:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1782222295.458581:0:17187:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782222295.458589:0:17187:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782222295.458590:0:17187:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782222295.458591:0:17187:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782222295.458592:0:17187:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782222295.458593:0:17187:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782222295.458594:0:17187:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782222295.458595:0:17187:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782222295.458596:0:17187:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782222295.458597:0:17187:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782222295.458622:0:17187:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1782222295.458641:0:17187:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17187:1868795081838720:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1782222295.458710:0:17187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222295.458761:0:17187:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b72a300 going to sleep for 11 seconds 00000100:00100000:3.0:1782222295.458767:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081838720 00000100:00100000:3.0:1782222295.458775:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081838720 00000100:00100000:3.0:1782222295.458827:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782222295.458837:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+12:17187:x1868795081838720:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1782222295.458865:0:17203:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1782222295.458879:0:17203:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1782222295.463106:0:17203:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1782222295.463127:0:17203:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1782222295.463580:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+12:17187:x1868795081838720:12345-0@lo:253:mount.lustre.0 Request processed in 4740us (4865us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222295.463592:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 20000000:01000000:3.0:1782222295.463716:0:17224:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1782222295.463721:0:17224:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1782222295.463742:0:17224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f0746430e00/0xe2b7cc26e6812422 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222295.463745:0:17187:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17187:1868795081838720:0@lo:253:mount.lustre.0 00010000:00010000:3.0:1782222295.463764:0:17224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0746431400/0xe2b7cc26e68123f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68123ea expref: 11 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782222295.463764:0:17187:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1782222295.463770:0:17187:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782222295.463773:0:17187:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782222295.463777:0:17187:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782222295.463778:0:17187:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00010000:00010000:3.0:1782222295.463780:0:17224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f0746430e00/0xe2b7cc26e6812422 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1782222295.463780:0:17187:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782222295.463783:0:17187:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782222295.463786:0:17187:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782222295.463789:0:17187:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782222295.463793:0:17187:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782222295.463795:0:17187:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1782222295.463813:0:17187:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1782222295.463829:0:17224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0746431400/0xe2b7cc26e68123f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e68123ea expref: 11 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222295.463846:0:17224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f0746431400/0xe2b7cc26e68123f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e68123ea expref: 11 pid: 17203 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222295.463859:0:17224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17224:1868795081838848:0@lo:104: 00000100:00100000:3.0:1782222295.463896:0:17224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222295.463970:0:17224:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f085091ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1782222295.467932:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081838848 00000100:00100000:2.0:1782222295.467946:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081838848 00000100:00100000:2.0:1782222295.468062:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782222295.468073:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0873f67-836f-4221-9522-aadc54ad715e+3:17224:x1868795081838848:12345-0@lo:104: 00010000:00010000:2.0:1782222295.468091:0:17191:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f087fb83200/0xe2b7cc26e68123ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e68123f1 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222295.468200:0:17191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782222295.468207:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0873f67-836f-4221-9522-aadc54ad715e+3:17224:x1868795081838848:12345-0@lo:104: Request processed in 136us (4310us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222295.468214:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1782222295.470262:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782222295.470275:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f087fb83200/0xe2b7cc26e68123ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e68123f1 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222295.470287:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83200 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:1.0:1782222295.470292:0:17197:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f087fb83200/0xe2b7cc26e68123ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e68123f1 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222295.470303:0:17197:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f087fb83200/0xe2b7cc26e68123ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e68123f1 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782222295.470311:0:17197:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f087fb83200/0xe2b7cc26e68123ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e68123f1 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782222295.470316:0:17197:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1782222295.470370:0:17197:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f087fb83200/0xe2b7cc26e68123ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e68123f1 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222295.470377:0:17197:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782222295.470404:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f087fb83200/0xe2b7cc26e68123ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e68123f1 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222295.470411:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f087fb83200/0xe2b7cc26e68123ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e68123f1 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222295.470432:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222295.470446:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222295.470448:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782222295.470491:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782222295.470508:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0873f67-836f-4221-9522-aadc54ad715e:3656:1868795081838976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782222295.470578:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222295.470634:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081838976 00000100:00100000:1.0:1782222295.470640:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081838976 00010000:00010000:1.0:1782222295.470664:0:17193:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0746431400/0xe2b7cc26e68123f1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e68123ea expref: 12 pid: 17203 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222295.470691:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782222295.470699:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747531180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0873f67-836f-4221-9522-aadc54ad715e+12:3656:x1868795081838976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782222295.470711:0:17193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222295.470716:0:17193:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0746431400/0xe2b7cc26e68123f1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e68123ea expref: 12 pid: 17203 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222295.470728:0:17193:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0746431400/0xe2b7cc26e68123f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e68123ea expref: 12 pid: 17203 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222295.470744:0:17193:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f0746430e00/0xe2b7cc26e6812422 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222295.470753:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0746430e00/0xe2b7cc26e6812422 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782222295.470767:0:17193:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007046334s 00010000:00010000:1.0:1782222295.470772:0:17193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f0746430e00/0xe2b7cc26e6812422 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222295.470779:0:17193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f0746430e00/0xe2b7cc26e6812422 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222295.470796:0:17193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f0746430e00/0xe2b7cc26e6812422 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222295.470803:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f0746430e00/0xe2b7cc26e6812422 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222295.470809:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746430e00 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:1.0:1782222295.470814:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f0746430e00/0xe2b7cc26e6812422 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222295.470822:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f0746430e00/0xe2b7cc26e6812422 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222295.470830:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f0746430e00/0xe2b7cc26e6812422 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222295.470840:0:17193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782222295.470876:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747531180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0873f67-836f-4221-9522-aadc54ad715e+12:3656:x1868795081838976:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222295.470884:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782222295.470920:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0873f67-836f-4221-9522-aadc54ad715e:3656:1868795081838976:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782222295.471196:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0746431400/0xe2b7cc26e68123f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e68123ea expref: 11 pid: 17203 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222295.471209:0:17224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17224:1868795081838848:0@lo:104: 00010000:00010000:3.0:1782222295.471225:0:17224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f0746430e00/0xe2b7cc26e6812422 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222295.471253:0:17224:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f0746430e00/0xe2b7cc26e6812422 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222295.471259:0:17224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f0746430e00/0xe2b7cc26e6812422 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222295.471272:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0746430e00/0xe2b7cc26e6812422 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1782222295.498394:0:17187:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1782222295.498791:0:17187:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1782222295.498873:0:17247:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1782222295.498877:0:17247:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1782222295.499313:0:17248:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1782222295.499626:0:17187:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1782222295.499856:0:17248:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782222295.501961:0:17248:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1782222295.502047:0:17248:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:0.0:1782222295.506868:0:17249:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8f086b786300 x1868795081839104/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222295.506885:0:17249:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747482840 going to sleep for 0 seconds 00000040:01000000:3.0:1782222295.507639:0:17187:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1782222295.507677:0:17187:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1782222295.508472:0:17187:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1782222295.508484:0:17187:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1782222295.508535:0:17187:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782222295.514841:0:17187:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1782222295.515633:0:17187:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1782222295.515680:0:17187:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1782222295.516989:0:17187:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:2.0:1782222295.520616:0:17187:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1782222295.523440:0:17187:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1782222295.523479:0:17187:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa0b981677988 00100000:10000000:1.0:1782222295.523488:0:17187:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1782222295.524322:0:17187:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1782222295.524335:0:17187:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.127@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1782222295.524350:0:17187:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1782222295.524365:0:17187:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1782222295.525130:0:17187:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782222295.525355:0:17187:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1782222295.852776:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782222296.427874:0:17242:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1782222296.558363:0:17249:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747482840 going to sleep for 0 seconds 10000000:01000000:0.0:1782222296.692021:0:17206:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1782222296.692027:0:17206:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8f0748460800 from 7 10000000:01000000:0.0:1782222296.692032:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1782222296.692088:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fcb8c00/0xe2b7cc26e6812429 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222296.692101:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f087fcb8c00/0xe2b7cc26e6812429 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222296.692126:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f087fcb8c00/0xe2b7cc26e6812429 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222296.692153:0:17206:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b787800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081839232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782222296.692223:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222296.692296:0:17206:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747482600 going to sleep for 11 seconds 00000100:00100000:0.0:1782222296.692315:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081839232 00000100:00100000:0.0:1782222296.692321:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081839232 00000100:00100000:0.0:1782222296.692368:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782222296.692376:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+11:17206:x1868795081839232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782222296.692389:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222296.692404:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f087fcb9200/0xe2b7cc26e6812430 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6812429 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222296.692424:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fcb9200/0xe2b7cc26e6812430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6812429 expref: 12 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222296.692434:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f087fcb9200/0xe2b7cc26e6812430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6812429 expref: 12 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222296.692443:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fcb9200, rc 0) 00000100:00100000:0.0:1782222296.692480:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+12:17206:x1868795081839232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222296.692487:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782222296.692532:0:17206:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b787800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081839232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782222296.692546:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f087fcb8c00/0xe2b7cc26e6812429 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812430 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222296.692560:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f087fcb8c00/0xe2b7cc26e6812429 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6812430 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222296.692607:0:17206:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b787800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081839360:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1782222296.692637:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222296.692651:0:17206:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747482600 going to sleep for 11 seconds 00000100:00100000:0.0:1782222296.692664:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081839360 00000100:00100000:0.0:1782222296.692668:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081839360 00000100:00100000:0.0:1782222296.692689:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782222296.692694:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+12:17206:x1868795081839360:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1782222296.692706:0:17203:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1782222296.692720:0:17203:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1782222296.692723:0:17203:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1782222296.692786:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+12:17206:x1868795081839360:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 91us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222296.692793:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782222296.692822:0:17206:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b787800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081839360:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1782222296.692862:0:17206:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782222296.692868:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fcb8c00/0xe2b7cc26e6812429 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812430 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222296.692875:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f087fcb8c00/0xe2b7cc26e6812429 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812430 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222296.883675:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782222297.452520:0:17242:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1782222297.578409:0:17249:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747482840 going to sleep for 0 seconds 00010000:00010000:1.0:1782222297.898591:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222298.605273:0:17249:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747482840 going to sleep for 0 seconds 00010000:00010000:1.0:1782222298.923096:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222299.634277:0:17249:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747482840 going to sleep for 0 seconds 00010000:00010000:2.0:1782222299.947555:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782222300.355714:0:17492:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1782222300.651074:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1782222300.651080:0:491:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1782222300.651083:0:491:0:(import.c:65:import_set_state_nolock()) ffff8f085294f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782222300.651091:0:491:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 494 00000100:00080000:2.0:1782222300.651097:0:491:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1782222300.651103:0:491:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8f085294f800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:2.0:1782222300.651123:0:491:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f074561f480 x1868795081839616/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782222300.651138:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782222300.651141:0:491:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782222300.651144:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782222300.651147:0:491:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782222300.651149:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1782222300.651152:0:491:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1782222300.651154:0:491:0:(import.c:65:import_set_state_nolock()) ffff8f0746083000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782222300.651159:0:491:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8f0746083000 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:3.0:1782222300.651256:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782222300.651270:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0873f67-836f-4221-9522-aadc54ad715e:3655:1868795081839488:0@lo:400:kworker.0 00000100:00100000:3.0:1782222300.651335:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222300.651398:0:17249:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747482840 going to sleep for 0 seconds 00000100:00100000:2.0:1782222300.652309:0:491:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f074561c000 x1868795081839744/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782222300.652343:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081839616:0@lo:38:kworker.0 00000100:00100000:2.0:1782222300.652439:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222300.652467:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3652:1868795081839744:0@lo:38:kworker.0 00000100:00100000:2.0:1782222300.652491:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222300.652534:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081839616 00000100:00100000:2.0:1782222300.652541:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081839616 00000100:00100000:2.0:1782222300.652572:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782222300.652579:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3652:x1868795081839616:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1782222300.652597:0:17214:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1782222300.657593:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081839488 00000100:00100000:1.0:1782222300.657607:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081839488 00000100:00100000:1.0:1782222300.657667:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782222300.657677:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+12:3655:x1868795081839488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222300.657768:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+12:3655:x1868795081839488:12345-0@lo:400:kworker.0 Request processed in 92us (6432us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222300.657777:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782222300.658593:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081839744 00000100:00100000:1.0:1782222300.658601:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081839744 00000100:00100000:1.0:1782222300.658628:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782222300.658635:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3652:x1868795081839744:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1782222300.658657:0:17210:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 499 last 0 00000020:00000080:1.0:1782222300.658700:0:17210:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xe2b7cc26e6812437 00000004:00100000:1.0:1782222300.658717:0:17210:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782222300.658905:0:17210:0:(import.c:65:import_set_state_nolock()) ffff8f08513bd000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782222300.658975:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1868795081839744:12345-0@lo:38:kworker.0 Request processed in 339us (6482us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222300.658983:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1782222300.659049:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f074561c000 x1868795081839744/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782222310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1782222300.659071:0:3652:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1782222300.659079:0:3652:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1782222300.659084:0:3652:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1782222300.659087:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f0746083000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1782222300.659093:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3652:1868795081839744:0@lo:38:kworker.0 00000100:00100000:3.0:1782222300.659668:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0873f67-836f-4221-9522-aadc54ad715e:3655:1868795081839488:0@lo:400:kworker.0 00000100:00100000:2.0:1782222300.684797:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3652:x1868795081839616:12345-0@lo:38:kworker.0 Request processed in 32208us (32349us total) trans 0 rc -19/-19 00000100:00100000:2.0:1782222300.684811:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1782222300.684897:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f085294f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782222300.684903:0:3652:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1782222300.684908:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081839616:0@lo:38:kworker.0 00010000:00010000:1.0:1782222300.974354:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1782222301.233052:0:17544:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782222301.233533:0:17544:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1782222301.678771:0:17249:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747482840 going to sleep for 0 seconds 00010000:00010000:2.0:1782222301.995546:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1782222302.075466:0:17594:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782222302.075670:0:17594:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1782222302.698368:0:17249:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747482840 going to sleep for 0 seconds 00010000:00010000:3.0:1782222303.018658:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222303.725558:0:17249:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747482840 going to sleep for 0 seconds 00010000:00010000:1.0:1782222304.043335:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222304.746511:0:17249:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747482840 going to sleep for 0 seconds 00010000:00010000:1.0:1782222305.074327:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782222305.770724:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0873f67-836f-4221-9522-aadc54ad715e:3653:1868795081839872:0@lo:400:kworker.0 00000100:00100000:1.0:1782222305.770850:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782222305.771632:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1782222305.771639:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1782222305.771642:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f085294f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782222305.771649:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 499 00000100:00080000:2.0:1782222305.771655:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1782222305.771661:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8f085294f800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:2.0:1782222305.771689:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f074561fb80 x1868795081840000/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782222305.771723:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782222305.771727:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782222305.771729:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782222305.771732:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1782222305.771813:0:17249:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747482840 going to sleep for 0 seconds 00000100:00100000:0.0:1782222305.771842:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081839872 00000100:00100000:0.0:1782222305.771849:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081839872 00000100:00100000:0.0:1782222305.771894:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782222305.771902:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+12:3653:x1868795081839872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222305.776820:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1868795081840128:0@lo:400:kworker.0 00000100:00100000:2.0:1782222305.776898:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222305.777863:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+12:3653:x1868795081839872:12345-0@lo:400:kworker.0 Request processed in 5956us (7008us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222305.777876:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782222305.777953:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081840128 00000100:00100000:0.0:1782222305.777960:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081840128 00000100:00100000:0.0:1782222305.778158:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782222305.778168:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1868795081840128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222305.778261:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1868795081840128:12345-0@lo:400:kworker.0 Request processed in 94us (1363us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222305.778268:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1782222305.778306:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f074561dc00 x1868795081840128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222305.778320:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1868795081840128:0@lo:400:kworker.0 00000100:00100000:0.0:1782222305.778863:0:3652:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782222295/real 1782222295] req@ffff8f0747531c00 x1868795081836672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782222305 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222305.778883:0:3652:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f0747531c00 x1868795081836672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782222305 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222305.778910:0:3652:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782222295/real 1782222295] req@ffff8f074561e680 x1868795081836544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782222305 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222305.778923:0:3652:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f074561e680 x1868795081836544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782222305 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222305.778941:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081840000:0@lo:38:kworker.0 00000100:00100000:0.0:1782222305.779027:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782222305.779057:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f07472a5800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782222305.779068:0:3652:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1782222305.779072:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081836672:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1782222305.779077:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f085294e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782222305.779082:0:3652:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1782222305.779085:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081836544:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1782222305.779207:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081840000 00000100:00100000:2.0:1782222305.779214:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081840000 00000100:00100000:2.0:1782222305.779268:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782222305.779275:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b787800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1868795081840000:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1782222305.779292:0:17213:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1782222305.784326:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0873f67-836f-4221-9522-aadc54ad715e:3653:1868795081839872:0@lo:400:kworker.0 00000100:00080000:3.0:1782222305.797913:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782222305.797923:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1782222305.797927:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f085294e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782222305.797935:0:8:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 494 00000100:00080000:3.0:1782222305.797941:0:8:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1782222305.797949:0:8:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f085294e000 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:3.0:1782222305.798752:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0747ef4a80 x1868795081840256/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782222305.798790:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782222305.798794:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1782222305.798796:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f07472a5800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782222305.798800:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 494 00000100:00080000:3.0:1782222305.798804:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1782222305.798809:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f07472a5800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:3.0:1782222305.798824:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0747ef4700 x1868795081840384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782222305.799359:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081840256:0@lo:8:kworker.0 00000400:00000100:0.0:1782222305.799918:0:3652:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868795081840256 offset 0 length 520: 4 00000100:00100000:0.0:1782222305.799961:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081840384:0@lo:8:kworker.0 00000400:00000100:0.0:1782222305.801529:0:3652:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868795081840384 offset 0 length 520: 4 00000100:00100000:3.0:1782222305.813106:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b787800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1868795081840000:12345-0@lo:38:kworker.0 Request processed in 33824us (34073us total) trans 0 rc -19/-19 00000100:00100000:3.0:1782222305.813126:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1782222305.813644:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f085294f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782222305.813651:0:3652:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1782222305.813656:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081840000:0@lo:38:kworker.0 00010000:00010000:2.0:1782222306.090390:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222306.800750:0:17249:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747482840 going to sleep for 0 seconds 00010000:00010000:1.0:1782222307.116306:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782222307.697979:0:17242:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1782222307.823592:0:17249:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747482840 going to sleep for 0 seconds 00010000:00010000:1.0:1782222308.138440:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1782222308.751065:0:17939:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1782222308.751070:0:17939:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1782222308.751071:0:17939:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1782222308.751214:0:17939:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8f08516c3800 00000020:01000004:0.0:1782222308.751266:0:17939:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1782222308.751279:0:17939:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1782222308.751770:0:17939:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8f07460f3380) 00000020:00000080:0.0:1782222308.751800:0:17939:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00000100:00100000:2.0:1782222308.845558:0:17249:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747482840 going to sleep for 0 seconds 00100000:10000000:0.0:1782222308.939983:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1782222308.940553:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1782222308.942536:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1782222308.946989:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1782222308.947417:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1782222308.949030:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1782222308.949986:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1782222308.951067:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1782222308.951485:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1782222308.952204:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1782222308.953095:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1782222308.961427:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1782222308.965120:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1782222308.970333:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1782222308.974002:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1782222308.974683:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1782222308.974973:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1782222308.975282:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1782222308.975577:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1782222308.975825:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1782222308.976027:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1782222308.978063:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1782222308.978815:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1782222308.979103:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1782222308.979363:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1782222308.979609:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1782222308.979840:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1782222308.980088:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1782222308.982551:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1782222308.983045:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1782222308.983378:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1782222308.983621:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1782222308.983862:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1782222308.988925:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1782222308.994616:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1782222308.996702:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1782222308.997516:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1782222308.997836:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1782222308.998214:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1782222308.998741:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1782222308.999201:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1782222308.999750:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1782222309.001376:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1782222309.004076:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1782222309.005995:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1782222309.007173:0:17939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:0.0:1782222309.017629:0:17939:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1782222309.018334:0:17939:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1782222309.018347:0:17939:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1782222309.018361:0:17939:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe2b7cc26e6812445 00000020:01000004:0.0:1782222309.018369:0:17939:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1782222309.018391:0:17939:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.127@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1782222309.018395:0:17939:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1782222309.018402:0:17939:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1782222309.018429:0:17939:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1782222309.018433:0:17939:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.127@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1782222309.032302:0:17939:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.127@tcp ctxt 0 is initialized 00000020:01000004:0.0:1782222309.032371:0:17939:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.127@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1782222309.032377:0:17939:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1782222309.032379:0:17939:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1782222309.032380:0:17939:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782222309.032381:0:17939:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782222309.032382:0:17939:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782222309.032384:0:17939:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782222309.032385:0:17939:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782222309.032394:0:17939:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782222309.032395:0:17939:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782222309.032399:0:17939:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1782222309.032401:0:17939:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782222309.032402:0:17939:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1782222309.032403:0:17939:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782222309.032404:0:17939:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782222309.032405:0:17939:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782222309.032406:0:17939:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782222309.032407:0:17939:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782222309.032407:0:17939:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782222309.032408:0:17939:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782222309.032438:0:17939:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1782222309.032460:0:17939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b785880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081840512:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1782222309.032532:0:17939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222309.032596:0:17939:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f085023e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782222309.033268:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081840512 00000100:00100000:2.0:1782222309.033279:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081840512 00000100:00100000:2.0:1782222309.033343:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782222309.033352:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+12:17939:x1868795081840512:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1782222309.033386:0:17203:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1782222309.033390:0:17203:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1782222309.033398:0:17203:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1782222309.033852:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+12:17939:x1868795081840512:12345-0@lo:253:mount.lustre.0 Request processed in 500us (1319us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222309.033861:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782222309.033997:0:17939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b785880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081840512:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1782222309.034009:0:17939:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1782222309.034012:0:17939:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782222309.034014:0:17939:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1782222309.034015:0:17939:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782222309.034016:0:17939:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782222309.034017:0:17939:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782222309.034019:0:17939:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782222309.034020:0:17939:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782222309.034022:0:17939:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782222309.034023:0:17939:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1782222309.034041:0:17939:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f08516c3800 from lustre-MDT0001 10000000:01000000:3.0:1782222309.034086:0:17939:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1782222309.034089:0:17939:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1782222309.034096:0:17939:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f087fb94d40 local copy 00010000:00010000:3.0:1782222309.034115:0:17939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fcb9400/0xe2b7cc26e681233b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812342 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222309.034227:0:17939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081840640:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782222309.034298:0:17939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222309.034327:0:17939:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074765f780 going to sleep for 11 seconds 00000100:00100000:1.0:1782222309.034398:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081840640 00000100:00100000:1.0:1782222309.034404:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081840640 00000100:00100000:1.0:1782222309.034442:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782222309.034450:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+12:17939:x1868795081840640:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782222309.034523:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+12:17939:x1868795081840640:12345-0@lo:501:mount.lustre.0 Request processed in 74us (224us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782222309.034529:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782222309.034906:0:17939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081840640:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1782222309.034923:0:17939:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1782222309.034943:0:17939:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1782222309.034949:0:17939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fcb9400/0xe2b7cc26e681233b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812342 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222309.034968:0:17939:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f087fcb9400/0xe2b7cc26e681233b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812342 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782222309.034995:0:17939:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f08516c3800 10000000:01000000:3.0:1782222309.034999:0:17939:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1782222309.035003:0:17939:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8f087fb94d40 10000000:01000000:3.0:1782222309.035006:0:17939:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1782222309.035009:0:17939:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8f087fb94d40 from 1 10000000:01000000:3.0:1782222309.035012:0:17939:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782222309.035034:0:17939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0746431400/0xe2b7cc26e681244c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222309.035041:0:17939:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f0746431400/0xe2b7cc26e681244c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222309.035050:0:17939:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0746431400/0xe2b7cc26e681244c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222309.035078:0:17939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081840768:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782222309.035115:0:17939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222309.035212:0:17939:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074765f780 going to sleep for 11 seconds 00000100:00100000:1.0:1782222309.040099:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081840768 00000100:00100000:1.0:1782222309.040122:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081840768 00000100:00100000:1.0:1782222309.040185:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782222309.040195:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+12:17939:x1868795081840768:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782222309.040211:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222309.040228:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f074744d800/0xe2b7cc26e6812453 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e681244c expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222309.040271:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f074744d800/0xe2b7cc26e6812453 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e681244c expref: 13 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222309.040280:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f074744d800/0xe2b7cc26e6812453 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e681244c expref: 13 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222309.040288:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744d800, rc 0) 00000100:00100000:1.0:1782222309.040355:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+13:17939:x1868795081840768:12345-0@lo:101:mount.lustre.0 Request processed in 162us (5250us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222309.040363:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782222309.040611:0:17939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081840768:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782222309.040629:0:17939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0746431400/0xe2b7cc26e681244c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812453 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222309.040639:0:17939:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0746431400/0xe2b7cc26e681244c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6812453 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782222309.040661:0:17939:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782222309.040681:0:17939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0746431400/0xe2b7cc26e681244c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812453 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222309.040689:0:17939:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f0746431400/0xe2b7cc26e681244c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812453 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782222309.040701:0:17939:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8f08516c3800 10000000:01000000:3.0:1782222309.040707:0:17939:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1782222309.040711:0:17939:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff8f08516c3800 from 1 10000000:01000000:3.0:1782222309.040714:0:17939:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1782222309.040738:0:17939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0746430e00/0xe2b7cc26e681245a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222309.040746:0:17939:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f0746430e00/0xe2b7cc26e681245a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222309.040753:0:17939:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0746430e00/0xe2b7cc26e681245a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222309.040778:0:17939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081840896:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782222309.040813:0:17939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222309.040843:0:17939:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074765f780 going to sleep for 11 seconds 00000100:00100000:2.0:1782222309.041113:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081840896 00000100:00100000:2.0:1782222309.041118:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081840896 00000100:00100000:3.0:1782222309.041643:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782222309.041652:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+13:17939:x1868795081840896:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782222309.041663:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222309.041674:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0746430c00/0xe2b7cc26e6812461 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e681245a expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222309.041693:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0746430c00/0xe2b7cc26e6812461 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e681245a expref: 14 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222309.041703:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0746430c00/0xe2b7cc26e6812461 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e681245a expref: 14 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222309.041711:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746430c00, rc 0) 00000100:00100000:3.0:1782222309.041764:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+14:17939:x1868795081840896:12345-0@lo:101:mount.lustre.0 Request processed in 112us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222309.041770:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782222309.042760:0:17939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081840896:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782222309.042780:0:17939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0746430e00/0xe2b7cc26e681245a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812461 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222309.042790:0:17939:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0746430e00/0xe2b7cc26e681245a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6812461 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782222309.042806:0:17939:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1782222309.042824:0:17939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0746430e00/0xe2b7cc26e681245a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812461 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222309.042831:0:17939:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f0746430e00/0xe2b7cc26e681245a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812461 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782222309.042839:0:17939:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1782222309.042844:0:17939:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782222309.042850:0:17939:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8f08516c3800 10000000:01000000:2.0:1782222309.042852:0:17939:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1782222309.042856:0:17939:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1782222309.042859:0:17939:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1782222309.042883:0:17939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb82400/0xe2b7cc26e6812468 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222309.042890:0:17939:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f087fb82400/0xe2b7cc26e6812468 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222309.042925:0:17939:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f087fb82400/0xe2b7cc26e6812468 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222309.042969:0:17939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081841024:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1782222309.043013:0:17939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222309.043041:0:17939:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0852963600 going to sleep for 11 seconds 00000100:00100000:1.0:1782222309.043124:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081841024 00000100:00100000:1.0:1782222309.043130:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081841024 00000100:00100000:1.0:1782222309.043173:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782222309.043182:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+14:17939:x1868795081841024:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782222309.043192:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222309.043203:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f074744c600/0xe2b7cc26e681246f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6812468 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222309.043220:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f074744c600/0xe2b7cc26e681246f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6812468 expref: 15 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222309.043228:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f074744c600/0xe2b7cc26e681246f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6812468 expref: 15 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222309.043260:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744c600, rc 0) 00000100:00100000:1.0:1782222309.043292:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+15:17939:x1868795081841024:12345-0@lo:101:mount.lustre.0 Request processed in 111us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222309.043298:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782222309.044524:0:17939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081841024:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782222309.044545:0:17939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f087fb82400/0xe2b7cc26e6812468 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681246f expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222309.044554:0:17939:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f087fb82400/0xe2b7cc26e6812468 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e681246f expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782222309.049518:0:17939:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:2.0:1782222309.050441:0:17939:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782222309.074952:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1782222309.075023:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1782222309.075040:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1782222309.075056:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1782222309.075071:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1782222309.075085:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1782222309.075099:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1782222309.075125:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1782222309.075140:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1782222309.075167:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1782222309.075182:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1782222309.075197:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1782222309.075214:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1782222309.075229:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1782222309.075869:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1782222309.076076:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1782222309.076094:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1782222309.076183:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1782222309.076201:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1782222309.076214:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1782222309.076226:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1782222309.076355:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1782222309.076372:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1782222309.076400:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1782222309.076406:0:17939:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1782222309.076519:0:17939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081841152:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782222309.076585:0:17939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222309.076619:0:17939:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074765f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782222309.076712:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081841152 00000100:00100000:1.0:1782222309.076719:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081841152 00000100:00100000:1.0:1782222309.076770:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782222309.076779:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+15:17939:x1868795081841152:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782222309.076928:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+15:17939:x1868795081841152:12345-0@lo:501:mount.lustre.0 Request processed in 149us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222309.076936:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782222309.077053:0:17939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081841152:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782222309.077089:0:17939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081841280:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782222309.077145:0:17939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222309.077170:0:17939:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074765f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782222309.077222:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081841280 00000100:00100000:0.0:1782222309.077227:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081841280 00000100:00100000:0.0:1782222309.077284:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782222309.077291:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+15:17939:x1868795081841280:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782222309.078438:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+15:17939:x1868795081841280:12345-0@lo:503:mount.lustre.0 Request processed in 1143us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222309.078449:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782222309.078560:0:17939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081841280:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1782222309.079024:0:17939:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782222309.079105:0:17939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081841408:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782222309.079168:0:17939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222309.079285:0:17939:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074765f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782222309.081013:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081841408 00000100:00100000:2.0:1782222309.081026:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081841408 00000100:00100000:2.0:1782222309.081162:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782222309.081172:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+15:17939:x1868795081841408:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782222309.083946:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+15:17939:x1868795081841408:12345-0@lo:502:mount.lustre.0 Request processed in 2766us (4768us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222309.083969:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782222309.084069:0:17939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081841408:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782222309.084368:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1782222309.084400:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1782222309.084417:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1782222309.084432:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1782222309.084446:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1782222309.084460:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1782222309.084473:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1782222309.084490:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1782222309.084504:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1782222309.084518:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1782222309.084532:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1782222309.084545:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1782222309.084559:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1782222309.084571:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1782222309.084583:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1782222309.084593:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1782222309.084605:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1782222309.084616:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1782222309.084640:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1782222309.084657:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1782222309.084672:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1782222309.084686:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1782222309.084701:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1782222309.084716:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1782222309.084731:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1782222309.084746:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1782222309.084777:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1782222309.084794:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1782222309.084809:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1782222309.084822:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1782222309.084837:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1782222309.084861:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1782222309.084876:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1782222309.084891:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1782222309.084905:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1782222309.084919:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1782222309.084932:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1782222309.084946:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1782222309.084976:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1782222309.084993:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1782222309.085007:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1782222309.085021:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1782222309.085050:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1782222309.085067:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1782222309.085106:0:17939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081841536:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782222309.085162:0:17939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222309.085859:0:17939:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074765f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782222309.086281:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081841536 00000100:00100000:1.0:1782222309.086290:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081841536 00000100:00100000:1.0:1782222309.086334:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782222309.086342:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+15:17939:x1868795081841536:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782222309.086676:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+15:17939:x1868795081841536:12345-0@lo:502:mount.lustre.0 Request processed in 333us (1513us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222309.086684:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782222309.088317:0:17939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081841536:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782222309.088416:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:3.0:1782222309.088430:0:17939:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1782222309.089808:0:17943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782222309.089822:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782222309.089824:0:17943:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1782222309.089830:0:17943:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1782222309.089833:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782222309.089848:0:17943:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8f087e840000) 00000020:00000080:2.0:1782222309.089869:0:17943:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1782222309.089875:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1782222309.089981:0:17943:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1782222309.089990:0:17943:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe2b7cc26e681247d 00000020:00000080:2.0:1782222309.090290:0:17943:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1782222309.090295:0:17943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782222309.090299:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782222309.090301:0:17943:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1782222309.090303:0:17943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782222309.090307:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782222309.090308:0:17943:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1782222309.090311:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782222309.090319:0:17943:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8f087e8419c0) 00000020:00000080:2.0:1782222309.090331:0:17943:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1782222309.090335:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1782222309.090338:0:17943:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1782222309.090340:0:17943:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1782222309.090346:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1782222309.090400:0:17943:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f08516c3800 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1782222309.090412:0:17943:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8f087e844d40) 00000020:00000080:2.0:1782222309.090421:0:17943:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1782222309.090482:0:17943:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1782222309.090488:0:17943:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe2b7cc26e6812492 00000020:00000080:2.0:1782222309.090574:0:17943:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1782222309.090581:0:17943:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1782222309.090586:0:17943:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xe2b7cc26e6812499 00080000:01000000:2.0:1782222309.090592:0:17943:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1782222309.090595:0:17943:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe2b7cc26e68124a0 00010000:00010000:1.0:1782222309.162422:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222309.172766:0:17943:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1782222309.173542:0:17943:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1782222309.173974:0:17943:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1782222309.175780:0:17943:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1782222309.175794:0:17943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782222309.175801:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782222309.175803:0:17943:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1782222309.175812:0:17943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782222309.176031:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782222309.176034:0:17943:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1782222309.176039:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1782222309.176044:0:17943:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.127@tcp to nid 0x20000c0a8cb7f (192.168.203.127@tcp) 00000020:00000080:2.0:1782222309.176072:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782222309.176092:0:17943:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8f087e843380) 00000020:00000080:2.0:1782222309.176187:0:17943:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1782222309.176194:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1782222309.176291:0:17943:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1782222309.176298:0:17943:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:2.0:1782222309.176305:0:17943:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe2b7cc26e68124ae 00010000:00080000:2.0:1782222309.176341:0:17943:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f085097f000@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.127@tcp at head 00010000:00010000:2.0:1782222309.183497:0:17943:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1782222309.187011:0:17943:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1782222309.187028:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1782222309.187065:0:17943:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1782222309.187087:0:17943:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe2b7cc26e68124b5 00000100:00080000:3.0:1782222309.187098:0:17943:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782222309.187114:0:17943:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8f085097f000 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:3.0:1782222309.187149:0:17943:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0747ef5500 x1868795081841664/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782222309.187176:0:17943:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1782222309.187231:0:17943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782222309.187264:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782222309.187267:0:17943:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1782222309.187270:0:17943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1782222309.187273:0:17943:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1782222309.187275:0:17943:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1782222309.187277:0:17943:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1782222309.187279:0:17943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1782222309.187281:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782222309.187282:0:17943:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1782222309.187285:0:17943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782222309.187290:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782222309.187291:0:17943:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1782222309.187295:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1782222309.187330:0:17943:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1782222309.187343:0:17943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782222309.187347:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782222309.187348:0:17943:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1782222309.187351:0:17943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1782222309.187353:0:17943:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1782222309.187354:0:17943:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1782222309.187355:0:17943:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1782222309.187357:0:17943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1782222309.187360:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782222309.187361:0:17943:0:(obd_config.c:1561:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1782222309.187364:0:17943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782222309.187367:0:17943:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1782222309.187371:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782222309.187372:0:17943:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1782222309.187375:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1782222309.187379:0:17943:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.127@tcp to nid 0x20000c0a8cb7f (192.168.203.127@tcp) 00000020:01000000:3.0:1782222309.187401:0:17943:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1782222309.187404:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782222309.187417:0:17943:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8f074756b380) 00000020:00000080:3.0:1782222309.187430:0:17943:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1782222309.187443:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1782222309.187520:0:17943:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1782222309.187528:0:17943:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:3.0:1782222309.187533:0:17943:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe2b7cc26e68124c3 00010000:00080000:3.0:1782222309.187563:0:17943:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f08672fb000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.127@tcp at head 00010000:00010000:3.0:1782222309.187791:0:17943:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:2.0:1782222309.188475:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1782222309.188482:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1782222309.188485:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f085294f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782222309.188492:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 504 00000100:00080000:2.0:1782222309.188496:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1782222309.188501:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8f085294f800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:2.0:1782222309.188529:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f074561ca80 x1868795081841792/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782222309.188541:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782222309.188544:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782222309.188547:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782222309.188550:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1782222309.188688:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1868795081841664:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1782222309.188763:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222309.188802:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081841792:0@lo:38:kworker.0 00000100:00100000:1.0:1782222309.188824:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222309.188854:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782222309.188862:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1868795081841920:0@lo:400:kworker.0 00000100:00100000:1.0:1782222309.188900:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222309.188932:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081841664 00000100:00100000:1.0:1782222309.188939:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081841664 00000100:00100000:1.0:1782222309.188973:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081841792 00000100:00100000:1.0:1782222309.188976:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081841792 00000100:00100000:1.0:1782222309.188990:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782222309.188996:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1868795081841664:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1782222309.189021:0:17213:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 508 last 0 00000020:00000080:1.0:1782222309.189055:0:17213:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe2b7cc26e68124ca 00000004:00100000:1.0:1782222309.189069:0:17213:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1782222309.189075:0:17213:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1782222309.189176:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081841920 00000100:00100000:1.0:1782222309.189181:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081841920 00000100:00100000:1.0:1782222309.189213:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782222309.189220:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1868795081841920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222309.189287:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1868795081841920:12345-0@lo:400:kworker.0 Request processed in 67us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222309.189299:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1782222309.189342:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f074561c380 x1868795081841920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222309.189355:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1868795081841920:0@lo:400:kworker.0 00000100:00080000:3.0:1782222309.193693:0:17213:0:(import.c:65:import_set_state_nolock()) ffff8f0745637000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782222309.193801:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3652:x1868795081841664:12345-0@lo:38:llog_process_th.0 Request processed in 4801us (5036us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222309.193811:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782222309.193842:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782222309.193849:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1868795081841792:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1782222309.194074:0:3652:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782222309.194084:0:3652:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1782222309.194094:0:3652:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xe2400010450010a0 00000100:00080000:1.0:1782222309.194100:0:3652:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1782222309.194103:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f085097f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1782222309.194133:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1868795081841664:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1782222309.195049:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1868795081841792:12345-0@lo:38:kworker.0 Request processed in 1194us (6219us total) trans 0 rc -11/-11 00000100:00100000:3.0:1782222309.195060:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782222309.195230:0:3652:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782222309.195257:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f085294f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782222309.195262:0:3652:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1782222309.195265:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081841792:0@lo:38:kworker.0 00000100:00100000:3.0:1782222309.196135:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782222309.196152:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081842048:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782222309.196209:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222309.200593:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081842048 00000100:00100000:2.0:1782222309.200616:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081842048 00000100:00100000:2.0:1782222309.200714:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782222309.200723:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3655:x1868795081842048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782222309.200757:0:17214:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1782222309.200827:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3655:x1868795081842048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (4618us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222309.200834:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782222309.200985:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081842048:0@lo:41:osp-pre-0-1.0 00000040:01000000:2.0:1782222309.201665:0:17943:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1782222309.201860:0:17943:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1782222309.203785:0:17943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782222309.204215:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1782222309.204371:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:3.0:1782222309.205377:0:17948:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1782222309.205383:0:17948:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1782222309.207591:0:17943:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1782222309.207611:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1782222309.207658:0:17943:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1782222309.207680:0:17943:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe2b7cc26e68124d1 00000100:00080000:3.0:1782222309.207691:0:17943:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782222309.207697:0:17943:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8f08672fb000 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:3.0:1782222309.207743:0:17943:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0747ef4000 x1868795081842176/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782222309.207770:0:17943:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1782222309.207819:0:17943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782222309.207823:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782222309.207824:0:17943:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1782222309.207827:0:17943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1782222309.207830:0:17943:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1782222309.207831:0:17943:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1782222309.207832:0:17943:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1782222309.207834:0:17943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1782222309.207836:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782222309.207837:0:17943:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1782222309.207839:0:17943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782222309.207843:0:17943:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1782222309.207846:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782222309.207847:0:17943:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1782222309.207850:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1782222309.207854:0:17943:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.127@tcp to nid 0x20000c0a8cb7f (192.168.203.127@tcp) 00000020:01000000:3.0:1782222309.207876:0:17943:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1782222309.207879:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782222309.207891:0:17943:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8f074756cd40) 00000020:00000080:3.0:1782222309.207904:0:17943:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1782222309.207908:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1782222309.207992:0:17943:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1782222309.207999:0:17943:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1782222309.208005:0:17943:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe2b7cc26e68124df 00010000:00080000:3.0:1782222309.208036:0:17943:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f08450bd800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.127@tcp at head 00010000:00010000:3.0:1782222309.208274:0:17943:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1782222309.208344:0:17943:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1782222309.208361:0:17943:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1782222309.208570:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782222309.208576:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782222309.208579:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782222309.208582:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1782222309.208680:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1868795081842176:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1782222309.208729:0:3652:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868795081842176 offset 0 length 520: 4 00000040:00080000:3.0:1782222309.212093:0:17943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782222309.212506:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1782222309.212618:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1782222309.213970:0:17950:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1782222309.213977:0:17950:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1782222309.214815:0:17943:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1782222309.214830:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1782222309.214871:0:17943:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1782222309.214893:0:17943:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe2b7cc26e68124e6 00000100:00080000:2.0:1782222309.214904:0:17943:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782222309.214909:0:17943:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f08450bd800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:2.0:1782222309.214943:0:17943:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f074561df80 x1868795081842304/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782222309.214980:0:17943:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1782222309.215061:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1868795081842304:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1782222309.215115:0:3652:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868795081842304 offset 0 length 520: 4 00000020:01000000:2.0:1782222309.215400:0:17943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782222309.215405:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782222309.215407:0:17943:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1782222309.215416:0:17943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782222309.215420:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782222309.215422:0:17943:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1782222309.215425:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782222309.215427:0:17943:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1782222309.215429:0:17943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782222309.215431:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782222309.215432:0:17943:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1782222309.215434:0:17943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782222309.215436:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782222309.215438:0:17943:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1782222309.215442:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1782222309.215467:0:17943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782222309.215470:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782222309.215471:0:17943:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1782222309.215474:0:17943:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00080000:3.0:1782222309.216212:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782222309.216219:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782222309.216221:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782222309.216224:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1782222309.216372:0:17939:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1782222309.216408:0:17939:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1782222309.216434:0:17939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb82400/0xe2b7cc26e6812468 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681246f expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222309.216447:0:17939:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f087fb82400/0xe2b7cc26e6812468 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681246f expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782222309.216456:0:17939:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8f08516c3800 from 1 10000000:01000000:1.0:1782222309.216469:0:17939:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782222309.216504:0:17939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e68124ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222309.216512:0:17939:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e68124ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222309.216523:0:17939:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e68124ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222309.216546:0:17939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747530e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081842432:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782222309.216598:0:17939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222309.217614:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081842432 00000100:00100000:3.0:1782222309.217624:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081842432 00000100:00100000:3.0:1782222309.217678:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782222309.217687:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+15:17939:x1868795081842432:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782222309.217703:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222309.217716:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0746430800/0xe2b7cc26e68124f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e68124ed expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222309.217741:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0746430800/0xe2b7cc26e68124f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e68124ed expref: 16 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222309.217753:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0746430800/0xe2b7cc26e68124f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68124ed expref: 16 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222309.217762:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746430800, rc 0) 00000100:00100000:3.0:1782222309.217811:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+16:17939:x1868795081842432:12345-0@lo:101:mount.lustre.0 Request processed in 124us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222309.217818:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782222309.218049:0:17939:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08428fca80 going to sleep for 11 seconds 00000100:00100000:1.0:1782222309.218073:0:17939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747530e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081842432:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782222309.218090:0:17939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e68124ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68124f4 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222309.218098:0:17939:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e68124ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e68124f4 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222309.218785:0:17939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747530e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081842560:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1782222309.218836:0:17939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222309.219521:0:17939:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08428fca80 going to sleep for 11 seconds 00000100:00100000:0.0:1782222309.219894:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081842560 00000100:00100000:0.0:1782222309.219903:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081842560 00000100:00100000:0.0:1782222309.219972:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782222309.219981:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+16:17939:x1868795081842560:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1782222309.220021:0:17202:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1782222309.220043:0:17202:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1782222309.220046:0:17202:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1782222309.220177:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+16:17939:x1868795081842560:12345-0@lo:256:mount.lustre.0 Request processed in 197us (1340us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222309.220188:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1782222309.220478:0:17939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747530e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081842560:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1782222309.221194:0:17939:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782222309.221549:0:17939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e68124ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68124f4 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222309.221576:0:17939:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e68124ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68124f4 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782222309.221586:0:17939:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f08516c3800 from 1 10000000:01000000:1.0:1782222309.221589:0:17939:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782222309.221620:0:17939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f074744ca00/0xe2b7cc26e68124fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222309.221628:0:17939:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f074744ca00/0xe2b7cc26e68124fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222309.221637:0:17939:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f074744ca00/0xe2b7cc26e68124fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222309.221658:0:17939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747530e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081842688:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782222309.221706:0:17939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222309.221739:0:17939:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08428fca80 going to sleep for 11 seconds 00000100:00100000:3.0:1782222309.221806:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081842688 00000100:00100000:3.0:1782222309.221812:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081842688 00000100:00100000:3.0:1782222309.221860:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1782222309.221874:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+16:17939:x1868795081842688:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782222309.221886:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222309.221898:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0746431200/0xe2b7cc26e6812502 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e68124fb expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222309.221919:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0746431200/0xe2b7cc26e6812502 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e68124fb expref: 17 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222309.221934:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0746431200/0xe2b7cc26e6812502 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68124fb expref: 17 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222309.221942:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746431200, rc 0) 00000100:00100000:3.0:1782222309.221985:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+17:17939:x1868795081842688:12345-0@lo:101:mount.lustre.0 Request processed in 112us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222309.221991:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782222309.222215:0:17939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747530e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081842688:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782222309.222228:0:17939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f074744ca00/0xe2b7cc26e68124fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812502 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222309.222264:0:17939:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f074744ca00/0xe2b7cc26e68124fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6812502 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782222309.222382:0:17939:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782222309.222406:0:17939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747530e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081842816:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782222309.222430:0:17939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222309.222452:0:17939:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08428fc000 going to sleep for 11 seconds 00000100:00100000:3.0:1782222309.222497:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081842816 00000100:00100000:3.0:1782222309.222501:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081842816 00000100:00100000:3.0:1782222309.222530:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782222309.222536:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f4f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+17:17939:x1868795081842816:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782222309.222617:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f4f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+17:17939:x1868795081842816:12345-0@lo:501:mount.lustre.0 Request processed in 81us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222309.222624:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782222309.222685:0:17939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747530e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081842816:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782222309.222710:0:17939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747530e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081842944:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782222309.222747:0:17939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222309.222765:0:17939:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08428fc000 going to sleep for 11 seconds 00000100:00100000:3.0:1782222309.222809:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081842944 00000100:00100000:3.0:1782222309.222813:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081842944 00000100:00100000:3.0:1782222309.222846:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782222309.222853:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f4f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+17:17939:x1868795081842944:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782222309.222932:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f4f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+17:17939:x1868795081842944:12345-0@lo:503:mount.lustre.0 Request processed in 79us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222309.222947:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782222309.223056:0:17939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747530e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081842944:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1782222309.223397:0:17939:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782222309.223462:0:17939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747530e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081843072:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782222309.223498:0:17939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222309.223514:0:17939:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08428fca80 going to sleep for 11 seconds 00000100:00100000:3.0:1782222309.223659:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081843072 00000100:00100000:3.0:1782222309.223664:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081843072 00000100:00100000:3.0:1782222309.223699:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782222309.223706:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f4f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+17:17939:x1868795081843072:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782222309.223784:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f4f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+17:17939:x1868795081843072:12345-0@lo:502:mount.lustre.0 Request processed in 79us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222309.223791:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782222309.223883:0:17939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747530e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081843072:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782222309.224098:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1782222309.224352:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1782222309.224386:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1782222309.224403:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1782222309.224418:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1782222309.224427:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1782222309.224436:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1782222309.224445:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1782222309.224454:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1782222309.224463:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1782222309.224472:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1782222309.224494:0:17939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747530e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081843200:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782222309.224531:0:17939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222309.224593:0:17939:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08428fca80 going to sleep for 11 seconds 00000100:00100000:3.0:1782222309.224623:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081843200 00000100:00100000:3.0:1782222309.224628:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081843200 00000100:00100000:3.0:1782222309.224692:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782222309.224700:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f4f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+17:17939:x1868795081843200:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782222309.224804:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f4f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+17:17939:x1868795081843200:12345-0@lo:502:mount.lustre.0 Request processed in 105us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222309.224811:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782222309.224880:0:17939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747530e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081843200:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782222309.224920:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:1.0:1782222309.224934:0:17939:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1782222309.225633:0:17952:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782222309.225643:0:17952:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222309.225646:0:17952:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1782222309.225653:0:17952:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f08516c3800 00000020:00000080:1.0:1782222309.225655:0:17952:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782222309.225664:0:17952:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782222309.225666:0:17952:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222309.225668:0:17952:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1782222309.225670:0:17952:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782222309.225672:0:17952:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222309.225673:0:17952:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1782222309.225677:0:17952:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f08516c3800 00000020:00000080:1.0:1782222309.225679:0:17952:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782222309.225766:0:17952:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782222309.225771:0:17952:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222309.225772:0:17952:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1782222309.225774:0:17952:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782222309.225777:0:17952:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222309.225778:0:17952:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1782222309.225781:0:17952:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f08516c3800 00000020:00000080:1.0:1782222309.225783:0:17952:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782222309.235053:0:17952:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782222309.235068:0:17952:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222309.235070:0:17952:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1782222309.235076:0:17952:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782222309.235080:0:17952:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222309.235082:0:17952:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1782222309.235087:0:17952:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f08516c3800 00000020:00000080:1.0:1782222309.235090:0:17952:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782222309.235297:0:17952:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782222309.235302:0:17952:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222309.235304:0:17952:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1782222309.235308:0:17952:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:3.0:1782222309.235488:0:17939:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1782222309.235517:0:17939:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782222309.235571:0:17939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f074744ca00/0xe2b7cc26e68124fb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812502 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222309.235584:0:17939:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f074744ca00/0xe2b7cc26e68124fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812502 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782222309.235642:0:17939:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1782222309.235645:0:17939:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f08516c3800 10000000:01000000:3.0:1782222309.235649:0:17939:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f08516c3800 10000000:01000000:3.0:1782222309.235653:0:17939:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782222309.235665:0:17939:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8f08516c3800 from 1 10000000:01000000:3.0:1782222309.235668:0:17939:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782222309.235702:0:17939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0746430200/0xe2b7cc26e6812509 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222309.235711:0:17939:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f0746430200/0xe2b7cc26e6812509 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222309.235722:0:17939:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f0746430200/0xe2b7cc26e6812509 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222309.235748:0:17939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081843328:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782222309.235818:0:17939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222309.235861:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081843328 00000100:00100000:3.0:1782222309.235868:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081843328 00000100:00100000:3.0:1782222309.235916:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782222309.235924:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f4f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+17:17939:x1868795081843328:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782222309.235939:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222309.239110:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0746430400/0xe2b7cc26e6812510 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6812509 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222309.239161:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0746430400/0xe2b7cc26e6812510 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6812509 expref: 18 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222309.239174:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0746430400/0xe2b7cc26e6812510 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6812509 expref: 18 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222309.239183:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746430400, rc 0) 00000100:00100000:3.0:1782222309.239274:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f4f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+18:17939:x1868795081843328:12345-0@lo:101:mount.lustre.0 Request processed in 3349us (3455us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222309.239294:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782222309.239366:0:17939:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875edf780 going to sleep for 11 seconds 00000100:00100000:3.0:1782222309.239390:0:17939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081843328:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782222309.239408:0:17939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f0746430200/0xe2b7cc26e6812509 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812510 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222309.239417:0:17939:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f0746430200/0xe2b7cc26e6812509 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6812510 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782222309.240577:0:17939:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1782222309.240881:0:17939:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782222309.241062:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1782222309.241087:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:3.0:1782222309.241102:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:3.0:1782222309.245181:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:3.0:1782222309.245211:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:3.0:1782222309.245227:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:3.0:1782222309.245258:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:3.0:1782222309.245273:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:3.0:1782222309.245304:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:3.0:1782222309.245321:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:3.0:1782222309.245336:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:3.0:1782222309.245350:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:3.0:1782222309.245363:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:3.0:1782222309.245377:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:3.0:1782222309.245391:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:3.0:1782222309.245405:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:3.0:1782222309.245419:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:3.0:1782222309.245434:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:3.0:1782222309.245448:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:3.0:1782222309.245473:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:3.0:1782222309.245488:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:3.0:1782222309.245502:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:3.0:1782222309.245516:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:3.0:1782222309.245530:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:3.0:1782222309.245560:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:3.0:1782222309.245577:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:3.0:1782222309.245590:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:3.0:1782222309.245604:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:3.0:1782222309.245631:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:3.0:1782222309.245637:0:17939:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1782222309.245737:0:17939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081843456:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782222309.245803:0:17939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222309.245856:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081843456 00000100:00100000:3.0:1782222309.245862:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081843456 00000100:00100000:3.0:1782222309.245906:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1782222309.245915:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f4f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+18:17939:x1868795081843456:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782222309.246039:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f4f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+18:17939:x1868795081843456:12345-0@lo:501:mount.lustre.0 Request processed in 124us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222309.246047:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1782222309.246084:0:17939:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875edfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1782222309.246106:0:17939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081843456:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782222309.246136:0:17939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081843584:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782222309.246173:0:17939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222309.246195:0:17939:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875edfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1782222309.246343:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081843584 00000100:00100000:3.0:1782222309.246348:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081843584 00000100:00100000:3.0:1782222309.246372:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782222309.246385:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f4f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+18:17939:x1868795081843584:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782222309.246460:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f4f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+18:17939:x1868795081843584:12345-0@lo:503:mount.lustre.0 Request processed in 75us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222309.246467:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782222309.246507:0:17939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081843584:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1782222309.246885:0:17939:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782222309.246941:0:17939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081843712:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782222309.249289:0:17939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222309.249340:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081843712 00000100:00100000:3.0:1782222309.249347:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081843712 00000100:00100000:3.0:1782222309.249394:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782222309.249403:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f4f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+18:17939:x1868795081843712:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782222309.249528:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f4f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+18:17939:x1868795081843712:12345-0@lo:502:mount.lustre.0 Request processed in 127us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222309.249537:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782222309.249590:0:17939:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08490edc00 going to sleep for 11 seconds 00000100:00100000:3.0:1782222309.249612:0:17939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081843712:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782222309.249820:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1782222309.249851:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:3.0:1782222309.249863:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:3.0:1782222309.249875:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:3.0:1782222309.249889:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:3.0:1782222309.249901:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:3.0:1782222309.249914:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:3.0:1782222309.249926:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:3.0:1782222309.249938:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:3.0:1782222309.249972:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:3.0:1782222309.249994:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:3.0:1782222309.250007:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:3.0:1782222309.250018:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:3.0:1782222309.250031:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:3.0:1782222309.250043:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:3.0:1782222309.250055:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:3.0:1782222309.250069:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:3.0:1782222309.250081:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:3.0:1782222309.250094:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:3.0:1782222309.252320:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:3.0:1782222309.252374:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:3.0:1782222309.252390:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:3.0:1782222309.252405:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:3.0:1782222309.252419:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:3.0:1782222309.252431:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:3.0:1782222309.252462:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:3.0:1782222309.252478:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:3.0:1782222309.252492:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:3.0:1782222309.252506:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:3.0:1782222309.252521:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:3.0:1782222309.252536:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:3.0:1782222309.252551:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:3.0:1782222309.252565:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:3.0:1782222309.252580:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:3.0:1782222309.252593:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:3.0:1782222309.252606:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:3.0:1782222309.252617:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:3.0:1782222309.252629:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:3.0:1782222309.252642:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:3.0:1782222309.252655:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:3.0:1782222309.252668:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:3.0:1782222309.252695:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:3.0:1782222309.252712:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:3.0:1782222309.252736:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:3.0:1782222309.252750:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:3.0:1782222309.252765:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:3.0:1782222309.252779:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:3.0:1782222309.252793:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:3.0:1782222309.252850:0:17939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081843840:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782222309.252926:0:17939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222309.252979:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081843840 00000100:00100000:3.0:1782222309.252985:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081843840 00000100:00100000:3.0:1782222309.253028:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782222309.253037:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f4f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+18:17939:x1868795081843840:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782222309.253217:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f4f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+18:17939:x1868795081843840:12345-0@lo:502:mount.lustre.0 Request processed in 180us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222309.253225:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782222309.253295:0:17939:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08490edc00 going to sleep for 11 seconds 00000100:00100000:3.0:1782222309.253315:0:17939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081843840:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782222309.253474:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1782222309.253496:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1782222309.253518:0:17939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081843968:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782222309.253551:0:17939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222309.253573:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081843968 00000100:00100000:3.0:1782222309.253577:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081843968 00000100:00100000:3.0:1782222309.253602:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782222309.253609:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f4f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+18:17939:x1868795081843968:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782222309.253667:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f4f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+18:17939:x1868795081843968:12345-0@lo:502:mount.lustre.0 Request processed in 58us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222309.253672:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782222309.253704:0:17939:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08490edc00 going to sleep for 11 seconds 00000100:00100000:3.0:1782222309.253714:0:17939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081843968:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782222309.253743:0:17939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:3.0:1782222309.253749:0:17939:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1782222309.256073:0:17957:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1782222309.256091:0:17957:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8f087805cd40) 00000020:00000080:2.0:1782222309.256185:0:17957:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1782222309.256393:0:17957:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f08516c3800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1782222309.256397:0:17957:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f08516c3800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1782222309.256400:0:17957:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8f08516c3800 3 00010000:00080000:2.0:1782222309.256430:0:17957:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f08672f9800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.127@tcp at head 00010000:00010000:2.0:1782222309.266509:0:17957:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1782222309.266631:0:17957:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1782222309.266675:0:17957:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1782222309.266689:0:17957:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xe2b7cc26e681251e 00000100:00080000:2.0:1782222309.266699:0:17957:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782222309.266704:0:17957:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8f08672f9800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:2.0:1782222309.266737:0:17957:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f074561ce00 x1868795081844096/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782222309.266761:0:17957:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1782222309.268252:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782222309.268261:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1782222309.268264:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782222309.268268:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1782222309.268378:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3652:1868795081844096:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1782222309.268459:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222309.268561:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081844096 00000100:00100000:1.0:1782222309.268570:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081844096 00000100:00100000:1.0:1782222309.268612:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782222309.268620:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3652:x1868795081844096:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1782222309.268647:0:17210:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 508 last 0 00000020:00000080:1.0:1782222309.268687:0:17210:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xe2b7cc26e6812525 00000004:00100000:1.0:1782222309.268701:0:17210:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782222309.268733:0:17210:0:(import.c:65:import_set_state_nolock()) ffff8f07476f2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782222309.268784:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1868795081844096:12345-0@lo:38:llog_process_th.0 Request processed in 162us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222309.268792:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1782222309.268864:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f074561ce00 x1868795081844096/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782222319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222309.268876:0:3652:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782222309.268884:0:3652:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1782222309.268892:0:3652:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1782222309.268896:0:3652:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1782222309.268899:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f08672f9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1782222309.268905:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3652:1868795081844096:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1782222309.269350:0:17957:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:3.0:1782222309.271157:0:17939:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1782222309.271198:0:17939:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782222309.271223:0:17939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f0746430200/0xe2b7cc26e6812509 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812510 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222309.271263:0:17939:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f0746430200/0xe2b7cc26e6812509 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812510 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1782222309.271313:0:17939:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1782222309.271315:0:17939:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1782222309.271317:0:17939:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782222309.271318:0:17939:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782222309.271319:0:17939:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782222309.271321:0:17939:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782222309.271323:0:17939:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782222309.271325:0:17939:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782222309.271326:0:17939:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782222309.271330:0:17939:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1782222309.271333:0:17939:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782222309.271334:0:17939:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1782222309.271335:0:17939:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782222309.271336:0:17939:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782222309.271338:0:17939:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782222309.271339:0:17939:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782222309.271340:0:17939:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782222309.271341:0:17939:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782222309.271343:0:17939:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782222309.271369:0:17939:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1782222309.271391:0:17939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081844224:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1782222309.271457:0:17939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222309.271491:0:17939:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08490edc00 going to sleep for 11 seconds 00000100:00100000:3.0:1782222309.271521:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081844224 00000100:00100000:3.0:1782222309.271526:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081844224 00000100:00100000:3.0:1782222309.271568:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1782222309.271577:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f4f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+18:17939:x1868795081844224:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1782222309.271604:0:17202:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1782222309.271616:0:17202:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1782222309.272798:0:17188:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1782222309.272830:0:17202:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1782222309.272838:0:17202:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1782222309.272889:0:17224:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1782222309.272894:0:17224:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1782222309.272911:0:17224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f0746431600/0xe2b7cc26e681252c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222309.272929:0:17224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f087fcb9200/0xe2b7cc26e6812430 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6812429 expref: 18 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222309.272936:0:17224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0746430800/0xe2b7cc26e68124f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68124ed expref: 18 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222309.272942:0:17224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f0746431600/0xe2b7cc26e681252c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222309.272983:0:17224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0746430800/0xe2b7cc26e68124f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e68124ed expref: 18 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222309.272999:0:17224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f0746430800/0xe2b7cc26e68124f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e68124ed expref: 18 pid: 17201 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222309.273012:0:17224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef6d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17224:1868795081844352:0@lo:104: 00000100:00100000:3.0:1782222309.273069:0:17224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782222309.273116:0:17224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f087fcb9200/0xe2b7cc26e6812430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e6812429 expref: 18 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222309.273125:0:17224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f087fcb9200/0xe2b7cc26e6812430 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e6812429 expref: 18 pid: 17201 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222309.273134:0:17224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17224:1868795081844480:0@lo:104: 00000100:00100000:3.0:1782222309.273155:0:17224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222309.273171:0:17224:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875edf3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782222309.274542:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f4f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+18:17939:x1868795081844224:12345-0@lo:253:mount.lustre.0 Request processed in 2960us (3078us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222309.274556:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1782222309.274651:0:17939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:17939:1868795081844224:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1782222309.274665:0:17939:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1782222309.274668:0:17939:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782222309.274670:0:17939:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1782222309.274672:0:17939:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782222309.274673:0:17939:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782222309.274674:0:17939:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782222309.274676:0:17939:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782222309.274677:0:17939:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782222309.274679:0:17939:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782222309.274681:0:17939:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1782222309.274694:0:17939:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1782222309.277145:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081844352 00000100:00100000:2.0:1782222309.277158:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081844352 00000100:00100000:2.0:1782222309.277195:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081844480 00000100:00100000:2.0:1782222309.277199:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081844480 00000100:00100000:2.0:1782222309.277216:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782222309.277225:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0873f67-836f-4221-9522-aadc54ad715e+4:17224:x1868795081844352:12345-0@lo:104: 00010000:00010000:2.0:1782222309.277266:0:17191:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e68124ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e68124f4 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222309.277354:0:17191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782222309.277360:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0873f67-836f-4221-9522-aadc54ad715e+4:17224:x1868795081844352:12345-0@lo:104: Request processed in 137us (4291us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222309.277367:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782222309.277384:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782222309.277390:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0873f67-836f-4221-9522-aadc54ad715e+3:17224:x1868795081844480:12345-0@lo:104: 00010000:00010000:2.0:1782222309.277398:0:17191:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f087fcb8c00/0xe2b7cc26e6812429 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6812430 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222309.277430:0:17191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782222309.277435:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0873f67-836f-4221-9522-aadc54ad715e+3:17224:x1868795081844480:12345-0@lo:104: Request processed in 46us (4280us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222309.277441:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1782222309.277470:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782222309.277475:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e68124ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e68124f4 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222309.277483:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744d000 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:2.0:1782222309.277487:0:17197:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e68124ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e68124f4 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222309.277505:0:17197:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e68124ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e68124f4 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782222309.277513:0:17197:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e68124ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e68124f4 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782222309.277519:0:17197:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1782222309.277556:0:17197:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e68124ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e68124f4 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222309.277562:0:17197:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782222309.277581:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e68124ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e68124f4 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222309.277587:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e68124ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e68124f4 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222309.277601:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782222309.277605:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f087fcb8c00/0xe2b7cc26e6812429 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6812430 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222309.277610:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb8c00 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:2.0:1782222309.277613:0:17197:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f087fcb8c00/0xe2b7cc26e6812429 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e6812430 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222309.277619:0:17197:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f087fcb8c00/0xe2b7cc26e6812429 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e6812430 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782222309.277624:0:17197:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f087fcb8c00/0xe2b7cc26e6812429 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e6812430 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782222309.277637:0:17197:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1782222309.277651:0:17197:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f087fcb8c00/0xe2b7cc26e6812429 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6812430 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222309.277657:0:17197:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782222309.277662:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f087fcb8c00/0xe2b7cc26e6812429 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6812430 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222309.277668:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f087fcb8c00/0xe2b7cc26e6812429 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6812430 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222309.277680:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222309.277682:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222309.277684:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222309.277706:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0873f67-836f-4221-9522-aadc54ad715e:3653:1868795081844608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782222309.277745:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222309.277779:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782222309.277784:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0873f67-836f-4221-9522-aadc54ad715e:3653:1868795081844736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782222309.277803:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222309.277834:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081844608 00000100:00100000:2.0:1782222309.277837:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081844608 00010000:00010000:2.0:1782222309.277853:0:17193:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0746430800/0xe2b7cc26e68124f4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e68124ed expref: 18 pid: 17201 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222309.277871:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081844736 00000100:00100000:2.0:1782222309.277873:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081844736 00010000:00010000:2.0:1782222309.277882:0:17193:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f087fcb9200/0xe2b7cc26e6812430 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6812429 expref: 19 pid: 17201 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222309.277906:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782222309.277912:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0873f67-836f-4221-9522-aadc54ad715e+19:3653:x1868795081844608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782222309.277922:0:17193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782222309.277927:0:17193:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0746430800/0xe2b7cc26e68124f4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e68124ed expref: 19 pid: 17201 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222309.277937:0:17193:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0746430800/0xe2b7cc26e68124f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e68124ed expref: 19 pid: 17201 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222309.277964:0:17193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782222309.277993:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0873f67-836f-4221-9522-aadc54ad715e+19:3653:x1868795081844608:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222309.277999:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782222309.278011:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782222309.278017:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0873f67-836f-4221-9522-aadc54ad715e+18:3653:x1868795081844736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782222309.278025:0:17193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782222309.278029:0:17193:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f087fcb9200/0xe2b7cc26e6812430 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6812429 expref: 18 pid: 17201 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222309.278038:0:17193:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f087fcb9200/0xe2b7cc26e6812430 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e6812429 expref: 18 pid: 17201 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222309.278050:0:17193:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f0746431600/0xe2b7cc26e681252c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222309.278057:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0746431600/0xe2b7cc26e681252c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1782222309.278080:0:17193:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007046334s 00010000:00010000:2.0:1782222309.278084:0:17193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f0746431600/0xe2b7cc26e681252c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222309.278090:0:17193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f0746431600/0xe2b7cc26e681252c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222309.278096:0:17193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f0746431600/0xe2b7cc26e681252c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222309.278102:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f0746431600/0xe2b7cc26e681252c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222309.278107:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746431600 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:2.0:1782222309.278110:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f0746431600/0xe2b7cc26e681252c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222309.278117:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f0746431600/0xe2b7cc26e681252c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222309.278124:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f0746431600/0xe2b7cc26e681252c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222309.278133:0:17193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782222309.278155:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0873f67-836f-4221-9522-aadc54ad715e+18:3653:x1868795081844736:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222309.278160:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782222309.278192:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0873f67-836f-4221-9522-aadc54ad715e:3653:1868795081844736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782222309.278201:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0873f67-836f-4221-9522-aadc54ad715e:3653:1868795081844608:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782222309.280069:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0746430800/0xe2b7cc26e68124f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e68124ed expref: 17 pid: 17201 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222309.280091:0:17224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef6d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17224:1868795081844352:0@lo:104: 00010000:00010000:3.0:1782222309.280104:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f087fcb9200/0xe2b7cc26e6812430 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e6812429 expref: 16 pid: 17201 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222309.280112:0:17224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17224:1868795081844480:0@lo:104: 00010000:00010000:3.0:1782222309.280137:0:17224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f0746431600/0xe2b7cc26e681252c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222309.280145:0:17224:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f0746431600/0xe2b7cc26e681252c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222309.280150:0:17224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f0746431600/0xe2b7cc26e681252c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222309.280170:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0746431600/0xe2b7cc26e681252c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222309.282296:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1782222309.287028:0:17939:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:1.0:1782222309.287339:0:17964:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1782222309.287605:0:17939:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000020:00080000:0.0:1782222309.287693:0:17963:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1782222309.287698:0:17963:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:0.0:1782222309.287946:0:17965:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b784380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17965:1868795081844864:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1782222309.288032:0:17965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222309.288068:0:17965:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747418540 going to sleep for 11 seconds 00000040:01000000:3.0:1782222309.288198:0:17939:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1782222309.288263:0:17939:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1782222309.288709:0:17939:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1782222309.288716:0:17939:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1782222309.288757:0:17939:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782222309.289311:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081844864 00000100:00100000:1.0:1782222309.289320:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081844864 00000100:00100000:1.0:1782222309.289367:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782222309.289376:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b785180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17965:x1868795081844864:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1782222309.289474:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b785180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17965:x1868795081844864:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 99us (1442us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222309.289481:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:3.0:1782222309.290109:0:17939:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1782222309.290334:0:17964:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782222309.292453:0:17964:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000040:00080000:3.0:1782222309.293196:0:17939:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1782222309.293293:0:17939:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1782222309.293403:0:17939:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1782222309.293883:0:17939:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000100:00100000:1.0:1782222309.294502:0:17965:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b784380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17965:1868795081844864:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1782222309.294545:0:17965:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1782222309.294593:0:17965:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747530e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17965:1868795081844992:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1782222309.294664:0:17965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222309.294699:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081844992 00000100:00100000:1.0:1782222309.294704:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081844992 00000100:00100000:1.0:1782222309.294745:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782222309.294753:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17965:x1868795081844992:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1782222309.294863:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17965:x1868795081844992:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 110us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222309.294871:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782222309.294895:0:17965:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b795d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782222309.294907:0:17965:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747530e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17965:1868795081844992:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1782222309.294971:0:17965:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747530e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17965:1868795081845120:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1782222309.295000:0:17965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222309.295022:0:17965:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f084a13d840 going to sleep for 11 seconds 00000004:00080000:0.0:1782222309.295553:0:17964:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1782222309.295601:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081845120 00000100:00100000:0.0:1782222309.295621:0:17219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081845120 00000100:00100000:0.0:1782222309.295657:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782222309.295665:0:17219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17965:x1868795081845120:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1782222309.295712:0:17219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17965:x1868795081845120:12345-0@lo:900:lod0001_rec0000.0 Request processed in 48us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222309.295720:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1782222309.296478:0:17965:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f0747530e00 x1868795081845120/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1782222325 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222309.296495:0:17965:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747530e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17965:1868795081845120:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1782222309.296569:0:17965:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747530e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17965:1868795081845248:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1782222309.296606:0:17965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222309.296628:0:17965:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f084a13dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782222309.296799:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081845248 00000100:00100000:3.0:1782222309.296805:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081845248 00000100:00100000:3.0:1782222309.296839:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782222309.296847:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17965:x1868795081845248:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1782222309.296909:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17965:x1868795081845248:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 63us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222309.296916:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782222309.296939:0:17965:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747530e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17965:1868795081845248:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1782222309.296991:0:17965:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00000004:0.0:1782222309.298629:0:17939:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000040:00080000:3.0:1782222309.302501:0:17965:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1782222309.302708:0:17965:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1782222309.302713:0:17965:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:3.0:1782222309.304625:0:17939:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1782222309.304661:0:17939:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa0b985553988 00100000:10000000:3.0:1782222309.304669:0:17939:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1782222309.306839:0:17939:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1782222309.306868:0:17939:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.127@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1782222309.306992:0:17939:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1782222309.307007:0:17939:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1782222309.309823:0:17939:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782222309.310654:0:17939:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1782222309.871904:0:17249:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747482840 going to sleep for 0 seconds 00010000:00010000:3.0:1782222310.186726:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782222310.314956:0:17966:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1782222310.891314:0:17249:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747482840 going to sleep for 0 seconds 10000000:01000000:2.0:1782222310.898342:0:17206:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1782222310.898350:0:17206:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8f08516c3800 from 8 10000000:01000000:2.0:1782222310.898355:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782222310.898417:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb83800/0xe2b7cc26e6812533 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222310.898429:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f087fb83800/0xe2b7cc26e6812533 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222310.898440:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f087fb83800/0xe2b7cc26e6812533 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222310.898464:0:17206:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081845376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782222310.898532:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222310.898585:0:17206:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0852963c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782222310.898651:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081845376 00000100:00100000:3.0:1782222310.898659:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081845376 00000100:00100000:3.0:1782222310.898720:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1782222310.898729:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f4f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+16:17206:x1868795081845376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782222310.898746:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222310.898759:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0746431600/0xe2b7cc26e681253a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6812533 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222310.898781:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0746431600/0xe2b7cc26e681253a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6812533 expref: 17 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222310.898790:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0746431600/0xe2b7cc26e681253a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6812533 expref: 17 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222310.898797:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746431600, rc 0) 00000100:00100000:3.0:1782222310.898844:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f4f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+17:17206:x1868795081845376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222310.898850:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782222310.899491:0:17206:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081845376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782222310.899507:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f087fb83800/0xe2b7cc26e6812533 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681253a expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222310.899516:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f087fb83800/0xe2b7cc26e6812533 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e681253a expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222310.899573:0:17206:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081845504:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1782222310.899610:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222310.899641:0:17206:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0852963c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782222310.899987:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081845504 00000100:00100000:3.0:1782222310.899998:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081845504 00000100:00100000:3.0:1782222310.900041:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1782222310.900048:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f4f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+17:17206:x1868795081845504:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1782222310.900063:0:17202:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1782222310.900078:0:17202:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1782222310.900081:0:17202:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1782222310.900175:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f4f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+17:17206:x1868795081845504:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 127us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222310.900182:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782222310.900274:0:17206:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081845504:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1782222310.900318:0:17206:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782222310.900326:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb83800/0xe2b7cc26e6812533 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681253a expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222310.900334:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f087fb83800/0xe2b7cc26e6812533 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681253a expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782222310.900342:0:17206:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1782222310.900344:0:17206:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8f0748460800 from 8 10000000:01000000:0.0:1782222310.900347:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1782222310.900366:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fcb9600/0xe2b7cc26e6812541 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222310.900374:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f087fcb9600/0xe2b7cc26e6812541 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222310.900382:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f087fcb9600/0xe2b7cc26e6812541 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222310.900406:0:17206:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b786d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081845632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782222310.900443:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222310.900469:0:17206:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f085292a000 going to sleep for 11 seconds 00000100:00100000:2.0:1782222310.900632:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081845632 00000100:00100000:2.0:1782222310.900638:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081845632 00000100:00100000:2.0:1782222310.900674:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1782222310.900680:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f4f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+17:17206:x1868795081845632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782222310.900694:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222310.900705:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e6812548 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6812541 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222310.900724:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e6812548 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6812541 expref: 18 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222310.900733:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e6812548 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6812541 expref: 18 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222310.900739:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb83200, rc 0) 00000100:00100000:2.0:1782222310.900768:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f4f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+18:17206:x1868795081845632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222310.900774:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782222310.900840:0:17206:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b786d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081845632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782222310.900851:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f087fcb9600/0xe2b7cc26e6812541 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812548 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222310.900858:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f087fcb9600/0xe2b7cc26e6812541 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6812548 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222310.900899:0:17206:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b786d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081845760:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1782222310.900926:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222310.900962:0:17206:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f085292a000 going to sleep for 11 seconds 00000100:00100000:0.0:1782222310.900975:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081845760 00000100:00100000:0.0:1782222310.900978:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081845760 00000100:00100000:0.0:1782222310.900995:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782222310.901000:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f4f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+18:17206:x1868795081845760:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1782222310.901011:0:17202:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1782222310.901024:0:17202:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1782222310.901027:0:17202:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1782222310.901104:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f4f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+18:17206:x1868795081845760:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 90us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222310.901110:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782222310.901139:0:17206:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b786d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081845760:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1782222310.901169:0:17206:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782222310.901175:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fcb9600/0xe2b7cc26e6812541 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812548 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222310.901191:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f087fcb9600/0xe2b7cc26e6812541 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812548 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222311.217741:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782222311.350163:0:17966:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1782222311.914588:0:17249:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747482840 going to sleep for 0 seconds 00010000:00010000:2.0:1782222312.234434:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222312.950198:0:17249:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747482840 going to sleep for 0 seconds 00010000:00010000:2.0:1782222313.259368:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222313.962369:0:17249:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747482840 going to sleep for 0 seconds 00000001:02000400:2.0:1782222314.008395:0:18209:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1782222314.297019:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782222314.474605:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1782222314.474612:0:491:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1782222314.474615:0:491:0:(import.c:65:import_set_state_nolock()) ffff8f085294f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782222314.474628:0:491:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8f085294f800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:0.0:1782222314.474637:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782222314.474652:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b786d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0873f67-836f-4221-9522-aadc54ad715e:3656:1868795081845888:0@lo:400:kworker.0 00000100:00100000:0.0:1782222314.474721:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222314.474779:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081845888 00000100:00100000:0.0:1782222314.474786:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081845888 00000100:00100000:0.0:1782222314.474829:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1782222314.474837:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f4f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+18:3656:x1868795081845888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222314.474887:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f4f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+18:3656:x1868795081845888:12345-0@lo:400:kworker.0 Request processed in 51us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222314.474894:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1782222314.474949:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b786d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0873f67-836f-4221-9522-aadc54ad715e:3656:1868795081845888:0@lo:400:kworker.0 00000100:00100000:0.0:1782222314.474985:0:491:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f086b786d80 x1868795081846016/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782222314.475000:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782222314.475015:0:491:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782222314.475018:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782222314.475033:0:491:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1782222314.475046:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b786d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081846016:0@lo:38:kworker.0 00000100:00100000:0.0:1782222314.475140:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222314.475191:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b785880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1868795081846144:0@lo:400:kworker.0 00000100:00100000:0.0:1782222314.475218:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782222314.475307:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782222314.475311:0:491:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782222314.475313:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782222314.475316:0:491:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1782222314.475393:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081846144 00000100:00100000:1.0:1782222314.475398:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081846144 00000100:00100000:1.0:1782222314.475436:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782222314.475444:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1868795081846144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222314.475487:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1868795081846144:12345-0@lo:400:kworker.0 Request processed in 43us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222314.475493:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1782222314.475530:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f086b785880 x1868795081846144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222314.475541:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b785880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1868795081846144:0@lo:400:kworker.0 00000100:00100000:2.0:1782222314.475758:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b784a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081846272:0@lo:400:kworker.0 00000100:00100000:2.0:1782222314.475788:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222314.475817:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782222314.475823:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b784000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1868795081846400:0@lo:400:kworker.0 00000100:00100000:2.0:1782222314.475848:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222314.475875:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081846400 00000100:00100000:2.0:1782222314.475879:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081846400 00000100:00100000:2.0:1782222314.475901:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782222314.475908:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1868795081846400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222314.475962:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1868795081846400:12345-0@lo:400:kworker.0 Request processed in 54us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222314.475969:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1782222314.475995:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f086b784000 x1868795081846400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222314.476016:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b784000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1868795081846400:0@lo:400:kworker.0 00000100:00100000:3.0:1782222314.476445:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081846016 00000100:00100000:3.0:1782222314.476451:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081846016 00000100:00100000:3.0:1782222314.476467:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081846272 00000100:00100000:3.0:1782222314.476470:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081846272 00000100:00100000:3.0:1782222314.476487:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782222314.476492:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b784380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3652:x1868795081846016:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1782222314.476516:0:17214:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 513 last 0 00000020:00000080:3.0:1782222314.476553:0:17214:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe2b7cc26e681254f 00000004:00100000:3.0:1782222314.476569:0:17214:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1782222314.476575:0:17214:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1782222314.477317:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b787b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081846528:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782222314.477363:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222314.477481:0:17213:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1782222314.477491:0:17213:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1782222314.477771:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081846528 00000100:00100000:3.0:1782222314.477777:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081846528 00000100:00100000:1.0:1782222314.478051:0:18230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782222314.478059:0:18230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3653:x1868795081846272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222314.478167:0:18230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3653:x1868795081846272:12345-0@lo:400:kworker.0 Request processed in 108us (2377us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222314.478174:0:18230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782222314.478191:0:18230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782222314.478197:0:18230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081846528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782222314.478218:0:18230:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1782222314.478290:0:18230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081846528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222314.478297:0:18230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782222314.478503:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b787b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081846528:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782222314.478568:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b784a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081846272:0@lo:400:kworker.0 00000100:00080000:3.0:1782222314.487227:0:17214:0:(import.c:65:import_set_state_nolock()) ffff8f0747763800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782222314.487465:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b784380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3652:x1868795081846016:12345-0@lo:38:kworker.0 Request processed in 10969us (12322us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222314.487477:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1782222314.487543:0:3652:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1782222314.487553:0:3652:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xe2400010450010a0 00000100:00080000:0.0:1782222314.487558:0:3652:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1782222314.487561:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f085294f800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1782222314.487605:0:3652:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000ca57c281): req@ffff8f086b786300 x1868795081839104/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222314.487626:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b786d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081846016:0@lo:38:kworker.0 00000100:00100000:3.0:1782222314.487734:0:17249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222314.487791:0:17249:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747482840 going to sleep for 11 seconds 00000100:00100000:3.0:1782222314.487902:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081846656:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782222314.487938:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222314.488215:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081839104 00000100:00100000:0.0:1782222314.488223:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081839104 00000100:00100000:0.0:1782222314.488293:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081846656 00000100:00100000:0.0:1782222314.488296:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081846656 00000100:00100000:0.0:1782222314.488312:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782222314.488319:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17249:x1868795081839104:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1782222314.488411:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17249:x1868795081839104:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 92us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222314.488417:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782222314.488432:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782222314.488438:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3656:x1868795081846656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782222314.488459:0:17213:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1782222314.488494:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3656:x1868795081846656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222314.488501:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782222314.488535:0:17249:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b786300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17249:1868795081839104:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1782222314.488570:0:17249:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1782222314.489002:0:17249:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b786300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17249:1868795081846784:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1782222314.489038:0:17249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222314.489146:0:17249:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f085292a240 going to sleep for 11 seconds 00000100:00100000:0.0:1782222314.489177:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081846656:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782222314.489260:0:18230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081846784 00000100:00100000:1.0:1782222314.489265:0:18230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081846784 00000100:00100000:1.0:1782222314.489297:0:18230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782222314.489305:0:18230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b786d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17249:x1868795081846784:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1782222314.489403:0:18230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b786d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17249:x1868795081846784:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 98us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222314.489409:0:18230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782222314.489536:0:17249:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b786300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17249:1868795081846784:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1782222314.489607:0:17249:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b786300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17249:1868795081846912:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1782222314.489630:0:17249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222314.489802:0:17249:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f085292a240 going to sleep for 11 seconds 00000100:00100000:1.0:1782222314.489936:0:18230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081846912 00000100:00100000:1.0:1782222314.489941:0:18230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081846912 00000100:00100000:1.0:1782222314.489972:0:18230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782222314.489979:0:18230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b787b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17249:x1868795081846912:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1782222314.490075:0:18230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b787b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17249:x1868795081846912:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 88us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222314.490082:0:18230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782222314.490219:0:17249:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b786300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17249:1868795081846912:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1782222314.490301:0:17249:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782222314.493209:0:17249:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1782222314.493429:0:17249:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:0.0:1782222314.493435:0:17249:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:1.0:1782222315.301706:0:18262:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782222315.302070:0:18262:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1782222315.306463:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222316.335409:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1782222316.668384:0:18313:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782222316.668682:0:18313:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1782222317.362491:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782222317.933184:0:17242:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:2.0:1782222318.046447:0:18361:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd45a414a0 20000000:00000080:2.0:1782222318.046464:0:18361:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f084fec9400 uarg=0000000000000000 20000000:01000000:2.0:1782222318.046499:0:18361:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1782222318.046505:0:18361:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1782222318.046510:0:18361:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1782222318.050540:0:18362:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1782222318.050703:0:18361:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1782222318.069994:0:18361:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1782222318.070100:0:18361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f087fb83e00/0xe2b7cc26e6812556 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222318.070120:0:18361:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f087fb83000/0xe2b7cc26e68123ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68123f8 expref: 17 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222318.070128:0:18361:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0746431200/0xe2b7cc26e6812502 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68124fb expref: 17 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222318.070136:0:18361:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f087fb83e00/0xe2b7cc26e6812556 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222318.070197:0:18361:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0746431200/0xe2b7cc26e6812502 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e68124fb expref: 17 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222318.070212:0:18361:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f0746431200/0xe2b7cc26e6812502 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e68124fb expref: 17 pid: 17202 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222318.070226:0:18361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18361:1868795081847040:0@lo:104: 00000100:00100000:2.0:1782222318.070318:0:18361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782222318.070373:0:18361:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f087fb83000/0xe2b7cc26e68123ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e68123f8 expref: 17 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222318.070382:0:18361:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f087fb83000/0xe2b7cc26e68123ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e68123f8 expref: 17 pid: 17201 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222318.070390:0:18361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18361:1868795081847168:0@lo:104: 00000100:00100000:2.0:1782222318.070413:0:18361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222318.070439:0:18361:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875bfc240 going to sleep for 11 seconds 00000100:00100000:1.0:1782222318.070514:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081847040 00000100:00100000:1.0:1782222318.070522:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081847040 00000100:00100000:1.0:1782222318.070556:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081847168 00000100:00100000:1.0:1782222318.070559:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081847168 00000100:00100000:1.0:1782222318.070573:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782222318.070581:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0873f67-836f-4221-9522-aadc54ad715e+4:18361:x1868795081847040:12345-0@lo:104: 00010000:00010000:1.0:1782222318.070600:0:17191:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f074744ca00/0xe2b7cc26e68124fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6812502 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222318.070661:0:17191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782222318.070667:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0873f67-836f-4221-9522-aadc54ad715e+4:18361:x1868795081847040:12345-0@lo:104: Request processed in 87us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222318.070674:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782222318.070691:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782222318.070697:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0873f67-836f-4221-9522-aadc54ad715e+3:18361:x1868795081847168:12345-0@lo:104: 00010000:00010000:1.0:1782222318.070705:0:17191:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f074744da00/0xe2b7cc26e68123f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e68123ff expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222318.070737:0:17191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782222318.070742:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0873f67-836f-4221-9522-aadc54ad715e+3:18361:x1868795081847168:12345-0@lo:104: Request processed in 46us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222318.070748:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1782222318.070765:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782222318.070770:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f074744ca00/0xe2b7cc26e68124fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6812502 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222318.070777:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744ca00 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:1.0:1782222318.070780:0:17197:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f074744ca00/0xe2b7cc26e68124fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e6812502 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222318.070788:0:17197:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f074744ca00/0xe2b7cc26e68124fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e6812502 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782222318.070794:0:17197:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f074744ca00/0xe2b7cc26e68124fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e6812502 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782222318.070806:0:17197:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782222318.070836:0:17197:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f074744ca00/0xe2b7cc26e68124fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6812502 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222318.070842:0:17197:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782222318.070860:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f074744ca00/0xe2b7cc26e68124fb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6812502 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222318.070867:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f074744ca00/0xe2b7cc26e68124fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6812502 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222318.070882:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782222318.070885:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f074744da00/0xe2b7cc26e68123f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e68123ff expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222318.070900:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744da00 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:1.0:1782222318.070903:0:17197:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f074744da00/0xe2b7cc26e68123f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e68123ff expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222318.070909:0:17197:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f074744da00/0xe2b7cc26e68123f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e68123ff expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782222318.070915:0:17197:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f074744da00/0xe2b7cc26e68123f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e68123ff expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782222318.070920:0:17197:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782222318.070932:0:17197:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f074744da00/0xe2b7cc26e68123f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e68123ff expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222318.070937:0:17197:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782222318.070950:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f074744da00/0xe2b7cc26e68123f8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e68123ff expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222318.070956:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f074744da00/0xe2b7cc26e68123f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e68123ff expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222318.070969:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222318.070971:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222318.070973:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222318.070979:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782222318.070997:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0873f67-836f-4221-9522-aadc54ad715e:3654:1868795081847424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782222318.071027:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222318.071052:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782222318.071058:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0873f67-836f-4221-9522-aadc54ad715e:3654:1868795081847296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782222318.071079:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222318.071117:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081847424 00000100:00100000:1.0:1782222318.071122:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081847424 00010000:00010000:1.0:1782222318.071139:0:17194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f087fb83000/0xe2b7cc26e68123ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e68123f8 expref: 18 pid: 17201 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222318.071157:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081847296 00000100:00100000:1.0:1782222318.071159:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081847296 00010000:00010000:1.0:1782222318.071170:0:17194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0746431200/0xe2b7cc26e6812502 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e68124fb expref: 19 pid: 17202 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222318.071183:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782222318.071189:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747530000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0873f67-836f-4221-9522-aadc54ad715e+19:3654:x1868795081847424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782222318.071199:0:17194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222318.071204:0:17194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f087fb83000/0xe2b7cc26e68123ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e68123f8 expref: 19 pid: 17201 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222318.071225:0:17194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f087fb83000/0xe2b7cc26e68123ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e68123f8 expref: 19 pid: 17201 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222318.071265:0:17194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782222318.071292:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747530000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0873f67-836f-4221-9522-aadc54ad715e+19:3654:x1868795081847424:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222318.071298:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782222318.071310:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782222318.071316:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747530e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0873f67-836f-4221-9522-aadc54ad715e+18:3654:x1868795081847296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782222318.071324:0:17194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222318.071329:0:17194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0746431200/0xe2b7cc26e6812502 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e68124fb expref: 18 pid: 17202 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222318.071338:0:17194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0746431200/0xe2b7cc26e6812502 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e68124fb expref: 18 pid: 17202 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222318.071348:0:17194:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f087fb83e00/0xe2b7cc26e6812556 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222318.071355:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fb83e00/0xe2b7cc26e6812556 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222318.071368:0:17194:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f087fb83e00/0xe2b7cc26e6812556 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222318.071375:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f087fb83e00/0xe2b7cc26e6812556 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222318.071382:0:17194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f087fb83e00/0xe2b7cc26e6812556 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222318.071395:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f087fb83e00/0xe2b7cc26e6812556 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222318.071401:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83e00 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:1.0:1782222318.071404:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f087fb83e00/0xe2b7cc26e6812556 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222318.071411:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f087fb83e00/0xe2b7cc26e6812556 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222318.071419:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f087fb83e00/0xe2b7cc26e6812556 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222318.071428:0:17194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782222318.071450:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747530e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0873f67-836f-4221-9522-aadc54ad715e+18:3654:x1868795081847296:12345-0@lo:103:ldlm_bl.0 Request processed in 134us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222318.071457:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782222318.071491:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0873f67-836f-4221-9522-aadc54ad715e:3654:1868795081847296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782222318.071499:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0873f67-836f-4221-9522-aadc54ad715e:3654:1868795081847424:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782222318.071789:0:18361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0746431200/0xe2b7cc26e6812502 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e68124fb expref: 17 pid: 17202 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222318.071800:0:18361:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18361:1868795081847040:0@lo:104: 00010000:00010000:2.0:1782222318.071808:0:18361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f087fb83000/0xe2b7cc26e68123ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e68123f8 expref: 16 pid: 17201 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222318.071815:0:18361:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18361:1868795081847168:0@lo:104: 00010000:00010000:2.0:1782222318.071831:0:18361:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f087fb83e00/0xe2b7cc26e6812556 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222318.071849:0:18361:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f087fb83e00/0xe2b7cc26e6812556 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222318.071855:0:18361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f087fb83e00/0xe2b7cc26e6812556 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222318.071862:0:18361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f087fb83e00/0xe2b7cc26e6812556 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222318.378522:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222319.402529:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222319.594553:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782222319.594589:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b786300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081847552:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782222319.594692:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782222319.595390:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782222319.595396:0:491:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782222319.595399:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782222319.595403:0:491:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782222319.595418:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782222319.595422:0:491:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782222319.595425:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782222319.595428:0:491:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1782222319.595462:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081847808:0@lo:400:kworker.0 00000100:00100000:2.0:1782222319.595513:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1868795081847936:0@lo:400:kworker.0 00000100:00100000:2.0:1782222319.595543:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222319.595606:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081847936 00000100:00100000:2.0:1782222319.595614:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081847936 00000100:00100000:2.0:1782222319.595672:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782222319.595682:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1868795081847936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222319.595774:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1868795081847936:12345-0@lo:400:kworker.0 Request processed in 93us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222319.595782:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1782222319.595831:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f074561d500 x1868795081847936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222319.595846:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1868795081847936:0@lo:400:kworker.0 00000100:00100000:1.0:1782222319.596057:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782222319.596068:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081848320:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782222319.596275:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0873f67-836f-4221-9522-aadc54ad715e:3656:1868795081847680:0@lo:400:kworker.0 00000100:00100000:0.0:1782222319.596314:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222319.596348:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1868795081848192:0@lo:400:kworker.0 00000100:00100000:0.0:1782222319.596374:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222319.596388:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782222319.596393:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081848064:0@lo:400:kworker.0 00000100:00100000:0.0:1782222319.596415:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222319.596443:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081847680 00000100:00100000:0.0:1782222319.596448:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081847680 00000100:00100000:0.0:1782222319.596481:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1782222319.596488:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087eecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+16:3656:x1868795081847680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222319.596527:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087eecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+16:3656:x1868795081847680:12345-0@lo:400:kworker.0 Request processed in 38us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222319.596533:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1782222319.596577:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0873f67-836f-4221-9522-aadc54ad715e:3656:1868795081847680:0@lo:400:kworker.0 00000100:00100000:1.0:1782222319.596660:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081847552 00000100:00100000:1.0:1782222319.596665:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081847552 00000100:00100000:1.0:1782222319.596711:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081848064 00000100:00100000:1.0:1782222319.596715:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081848064 00000100:00100000:1.0:1782222319.596744:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782222319.596750:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3656:x1868795081847552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782222319.596785:0:17214:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1782222319.596831:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3656:x1868795081847552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (2140us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222319.596838:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782222319.596854:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782222319.596861:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b784700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081848064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222319.596902:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b784700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081848064:12345-0@lo:400:kworker.0 Request processed in 41us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222319.596909:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782222319.596928:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081848192 00000100:00100000:1.0:1782222319.596931:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081848192 00000100:00100000:1.0:1782222319.596957:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782222319.596963:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b785500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1868795081848192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222319.596992:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b785500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1868795081848192:12345-0@lo:400:kworker.0 Request processed in 30us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222319.596998:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782222319.597021:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222319.597055:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222319.597075:0:18230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081847808 00000100:00100000:1.0:1782222319.597078:0:18230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081847808 00000100:00100000:1.0:1782222319.597095:0:18230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081848320 00000100:00100000:1.0:1782222319.597099:0:18230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081848320 00000100:00100000:1.0:1782222319.597110:0:18230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782222319.597116:0:18230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3653:x1868795081847808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222319.597172:0:18230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3653:x1868795081847808:12345-0@lo:400:kworker.0 Request processed in 55us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222319.597185:0:18230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782222319.597197:0:18230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782222319.597203:0:18230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3654:x1868795081848320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782222319.597224:0:18230:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1782222319.597281:0:18230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3654:x1868795081848320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222319.597287:0:18230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782222319.597314:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081847808:0@lo:400:kworker.0 00000100:00100000:1.0:1782222319.597342:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081848320:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782222319.597371:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081848064:0@lo:400:kworker.0 00010000:00080000:1.0:1782222319.597385:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f074561dc00 x1868795081848192/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222319.597395:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1868795081848192:0@lo:400:kworker.0 00000100:00100000:1.0:1782222319.597408:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b786300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081847552:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782222319.597931:0:3652:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782222309/real 1782222309] req@ffff8f074561df80 x1868795081842304/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782222319 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222319.597951:0:3652:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f074561df80 x1868795081842304/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782222319 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222319.597963:0:3652:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782222309/real 1782222309] req@ffff8f0747ef4000 x1868795081842176/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782222319 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222319.597975:0:3652:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f0747ef4000 x1868795081842176/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782222319 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1782222319.598004:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f08450bd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782222319.598029:0:3652:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1782222319.598033:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1868795081842304:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1782222319.598038:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f08672fb000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782222319.598044:0:3652:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1782222319.598046:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1868795081842176:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1782222319.598108:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782222319.598114:0:491:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782222319.598118:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782222319.598121:0:491:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782222319.598125:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782222319.598128:0:491:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1782222319.598132:0:491:0:(import.c:65:import_set_state_nolock()) ffff8f08672fb000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782222319.598137:0:491:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 508 00000100:00080000:2.0:1782222319.598143:0:491:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1782222319.598149:0:491:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8f08672fb000 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:2.0:1782222319.598190:0:491:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f074561d500 x1868795081848448/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782222319.598213:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782222319.598216:0:491:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1782222319.598218:0:491:0:(import.c:65:import_set_state_nolock()) ffff8f08450bd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782222319.598221:0:491:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 508 00000100:00080000:2.0:1782222319.598224:0:491:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1782222319.598333:0:491:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f08450bd800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:2.0:1782222319.598349:0:491:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f074561c700 x1868795081848576/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782222319.598543:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1868795081848448:0@lo:8:kworker.0 00000400:00000100:1.0:1782222319.598607:0:3652:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868795081848448 offset 0 length 520: 4 00000100:00100000:1.0:1782222319.598639:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1868795081848576:0@lo:8:kworker.0 00000400:00000100:1.0:1782222319.598660:0:3652:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868795081848576 offset 0 length 520: 4 10000000:01000000:1.0:1782222319.658642:0:17206:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782222319.658654:0:17206:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f08516c3800 from 13 10000000:01000000:1.0:1782222319.658661:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782222319.658801:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e681255d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222319.658826:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e681255d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222319.658840:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e681255d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222319.658903:0:17206:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747531500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081848704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782222319.659054:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222319.659131:0:17206:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f085023ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1782222319.659344:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081848704 00000100:00100000:3.0:1782222319.659356:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081848704 00000100:00100000:3.0:1782222319.659426:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1782222319.659436:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087eec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+16:17206:x1868795081848704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782222319.659454:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222319.659471:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0746431c00/0xe2b7cc26e6812564 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e681255d expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222319.659498:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0746431c00/0xe2b7cc26e6812564 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e681255d expref: 17 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222319.659509:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0746431c00/0xe2b7cc26e6812564 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e681255d expref: 17 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222319.659520:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746431c00, rc 0) 00000100:00100000:3.0:1782222319.659575:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087eec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+17:17206:x1868795081848704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222319.659581:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1782222319.659737:0:17206:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747531500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081848704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782222319.659755:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e681255d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812564 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222319.659764:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e681255d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6812564 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222319.659864:0:17206:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747531500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081848832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782222319.659903:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222319.660039:0:17206:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f085023ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1782222319.663302:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081848832 00000100:00100000:0.0:1782222319.663324:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081848832 00000100:00100000:2.0:1782222319.663546:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782222319.663559:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087eec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+17:17206:x1868795081848832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782222319.664380:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087eec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+17:17206:x1868795081848832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 819us (4472us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222319.664391:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782222319.664499:0:17206:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747531500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081848832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782222319.664569:0:17206:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747531500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081848960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782222319.664761:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222319.664850:0:17206:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f085023ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1782222319.664970:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081848960 00000100:00100000:0.0:1782222319.664978:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081848960 00000100:00100000:0.0:1782222319.665208:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782222319.665220:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087eeca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+17:17206:x1868795081848960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782222319.665902:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087eeca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+17:17206:x1868795081848960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 681us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222319.665911:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782222319.666084:0:17206:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747531500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081848960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782222319.667454:0:18422:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1782222319.667952:0:17206:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1782222319.667983:0:17206:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782222319.668000:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e681255d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812564 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222319.668015:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e681255d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812564 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782222319.668185:0:17206:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782222319.668189:0:17206:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f0748460800 from 13 10000000:01000000:1.0:1782222319.668201:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782222319.668277:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f074744c800/0xe2b7cc26e681256b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222319.668287:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f074744c800/0xe2b7cc26e681256b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222319.668300:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f074744c800/0xe2b7cc26e681256b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222319.668332:0:17206:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747531880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081849088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782222319.668415:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222319.668469:0:17206:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f085023e300 going to sleep for 11 seconds 00000100:00100000:2.0:1782222319.668607:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081849088 00000100:00100000:2.0:1782222319.668617:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081849088 00000100:00100000:2.0:1782222319.668763:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1782222319.668775:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087eeca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+17:17206:x1868795081849088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782222319.668792:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222319.668808:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f087fb83600/0xe2b7cc26e6812572 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e681256b expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222319.668838:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fb83600/0xe2b7cc26e6812572 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e681256b expref: 18 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222319.668849:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f087fb83600/0xe2b7cc26e6812572 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e681256b expref: 18 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222319.668859:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb83600, rc 0) 00000100:00100000:2.0:1782222319.669619:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087eeca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+18:17206:x1868795081849088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 844us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222319.669628:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1782222319.676355:0:17206:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747531880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081849088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782222319.676399:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f074744c800/0xe2b7cc26e681256b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812572 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222319.676416:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f074744c800/0xe2b7cc26e681256b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6812572 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222319.676537:0:17206:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747531880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081849216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782222319.676617:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222319.676675:0:17206:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f085023e300 going to sleep for 11 seconds 00000100:00100000:2.0:1782222319.676849:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081849216 00000100:00100000:2.0:1782222319.676889:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081849216 00000100:00100000:2.0:1782222319.676953:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1782222319.676963:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087eec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+18:17206:x1868795081849216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782222319.677282:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087eec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+18:17206:x1868795081849216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 320us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222319.677291:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782222319.678680:0:17206:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747531880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081849216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782222319.678767:0:17206:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747531880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081849344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782222319.678854:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222319.678912:0:17206:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f085023e300 going to sleep for 11 seconds 00000100:00100000:2.0:1782222319.679271:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081849344 00000100:00100000:2.0:1782222319.679280:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081849344 00000100:00100000:2.0:1782222319.679352:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1782222319.679365:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087eecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+18:17206:x1868795081849344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782222319.679500:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087eecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+18:17206:x1868795081849344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222319.679508:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782222319.680284:0:17206:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747531880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081849344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782222319.699088:0:18423:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1782222319.699864:0:17206:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1782222319.699907:0:17206:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782222319.699923:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f074744c800/0xe2b7cc26e681256b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812572 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222319.699964:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f074744c800/0xe2b7cc26e681256b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812572 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1782222320.108673:0:17940:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1782222320.430206:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782222320.618552:0:3652:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782222305/real 1782222305] req@ffff8f0747ef4a80 x1868795081840256/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782222320 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222320.618598:0:3652:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f0747ef4a80 x1868795081840256/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782222320 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222320.618609:0:3652:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782222305/real 1782222305] req@ffff8f0747ef4700 x1868795081840384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782222320 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222320.618621:0:3652:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f0747ef4700 x1868795081840384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782222320 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1782222320.618647:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f085294e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782222320.618660:0:3652:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1782222320.618665:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081840256:0@lo:8:kworker.0 00000100:00080000:1.0:1782222320.618671:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f07472a5800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782222320.618677:0:3652:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1782222320.618680:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081840384:0@lo:8:kworker.0 00000100:00080000:2.0:1782222320.619095:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782222320.619101:0:491:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1782222320.619104:0:491:0:(import.c:65:import_set_state_nolock()) ffff8f085294e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782222320.619109:0:491:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 504 00000100:00080000:2.0:1782222320.619116:0:491:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1782222320.619125:0:491:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f085294e000 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:2.0:1782222320.619148:0:491:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f074561dc00 x1868795081849728/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782222320.619163:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782222320.619166:0:491:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1782222320.619168:0:491:0:(import.c:65:import_set_state_nolock()) ffff8f07472a5800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782222320.619172:0:491:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 504 00000100:00080000:2.0:1782222320.619191:0:491:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1782222320.619196:0:491:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f07472a5800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:2.0:1782222320.619208:0:491:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f074561e680 x1868795081849856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782222320.619253:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782222320.619257:0:491:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782222320.619260:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782222320.619263:0:491:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1782222320.619307:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081850112:0@lo:400:kworker.0 00000100:00100000:2.0:1782222320.619399:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222320.619441:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782222320.619448:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0873f67-836f-4221-9522-aadc54ad715e:3653:1868795081849472:0@lo:400:kworker.0 00000100:00100000:2.0:1782222320.619478:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222320.619507:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1868795081850240:0@lo:400:kworker.0 00000100:00100000:2.0:1782222320.619531:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222320.619558:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081849600:0@lo:400:kworker.0 00000100:00100000:2.0:1782222320.619586:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222320.619602:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782222320.619606:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1868795081849984:0@lo:400:kworker.0 00000100:00100000:2.0:1782222320.619626:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222320.619658:0:18230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081850112 00000100:00100000:2.0:1782222320.619666:0:18230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081850112 00000100:00100000:2.0:1782222320.619707:0:18230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081849600 00000100:00100000:2.0:1782222320.619710:0:18230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081849600 00000100:00100000:2.0:1782222320.619725:0:18230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782222320.619741:0:18230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081850112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222320.619798:0:18230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081850112:12345-0@lo:400:kworker.0 Request processed in 57us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222320.619805:0:18230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782222320.619821:0:18230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782222320.619826:0:18230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081849600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222320.619850:0:18230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081849600:12345-0@lo:400:kworker.0 Request processed in 24us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222320.619856:0:18230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782222320.619883:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081849472 00000100:00100000:2.0:1782222320.619886:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081849472 00000100:00100000:2.0:1782222320.619909:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1782222320.619914:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087eecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+18:3653:x1868795081849472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222320.619942:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087eecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+18:3653:x1868795081849472:12345-0@lo:400:kworker.0 Request processed in 27us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222320.619947:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1782222320.619977:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081850240 00000100:00100000:2.0:1782222320.619980:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081850240 00000100:00100000:2.0:1782222320.620002:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081849984 00000100:00100000:2.0:1782222320.620005:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081849984 00000100:00100000:2.0:1782222320.620017:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782222320.620024:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1868795081850240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222320.620053:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1868795081850240:12345-0@lo:400:kworker.0 Request processed in 29us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222320.620060:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782222320.620070:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782222320.620075:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1868795081849984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222320.620110:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1868795081849984:12345-0@lo:400:kworker.0 Request processed in 35us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222320.620116:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1782222320.620150:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f074561ce00 x1868795081849984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222320.620164:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1868795081849984:0@lo:400:kworker.0 00000100:00100000:2.0:1782222320.620173:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081849600:0@lo:400:kworker.0 00000100:00100000:2.0:1782222320.620192:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081849728:0@lo:8:kworker.0 00000400:00000100:2.0:1782222320.620217:0:3652:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868795081849728 offset 0 length 520: 4 00000100:00100000:2.0:1782222320.620228:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081849856:0@lo:8:kworker.0 00000400:00000100:2.0:1782222320.620266:0:3652:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868795081849856 offset 0 length 520: 4 00000100:00100000:2.0:1782222320.620289:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0873f67-836f-4221-9522-aadc54ad715e:3653:1868795081849472:0@lo:400:kworker.0 00010000:00080000:2.0:1782222320.620299:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0849b14380 x1868795081850240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222320.620308:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1868795081850240:0@lo:400:kworker.0 00000100:00100000:2.0:1782222320.620316:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081850112:0@lo:400:kworker.0 00010000:00010000:1.0:1782222321.450495:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782222321.579373:0:17966:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1782222322.486379:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222323.502324:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222324.530380:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782222324.715388:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747531880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081850368:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782222324.715486:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222324.715589:0:18230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081850368 00000100:00100000:1.0:1782222324.715598:0:18230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081850368 00000100:00100000:1.0:1782222324.715657:0:18230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782222324.715666:0:18230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081850368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782222324.715733:0:18230:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1782222324.715786:0:18230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081850368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222324.715794:0:18230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782222324.715873:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747531880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081850368:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782222324.716523:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081850496:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782222324.716572:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222324.716653:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081850496 00000100:00100000:0.0:1782222324.716659:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081850496 00000100:00100000:0.0:1782222324.716702:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782222324.716712:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081850496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782222324.716741:0:17214:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1782222324.716790:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081850496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222324.716798:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782222324.716883:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081850496:0@lo:41:osp-pre-0-1.0 00000020:01000004:2.0:1782222325.465671:0:18709:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1782222325.465675:0:18709:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1782222325.465676:0:18709:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1782222325.465787:0:18709:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8f08815e5000 00000020:01000004:2.0:1782222325.465806:0:18709:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1782222325.465822:0:18709:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1782222325.465855:0:18709:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8f087805b380) 00000020:00000080:2.0:1782222325.465873:0:18709:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1782222325.527329:0:18709:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1782222325.528511:0:18709:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1782222325.528717:0:18709:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1782222325.529093:0:18709:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1782222325.529393:0:18709:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1782222325.529590:0:18709:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1782222325.529788:0:18709:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:2.0:1782222325.532187:0:18709:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1782222325.532507:0:18709:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1782222325.532522:0:18709:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1782222325.532535:0:18709:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe2b7cc26e6812580 00000020:01000004:2.0:1782222325.532541:0:18709:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1782222325.532563:0:18709:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.127@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1782222325.532567:0:18709:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1782222325.532572:0:18709:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1782222325.532577:0:18709:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1782222325.532589:0:18709:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8f0878058000) 00000020:00000080:2.0:1782222325.532602:0:18709:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1782222325.535739:0:18709:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782222325.535916:0:18709:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1782222325.535922:0:18709:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1782222325.537594:0:18709:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1782222325.537605:0:18709:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1782222325.538067:0:18709:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1782222325.538074:0:18709:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1782222325.540206:0:18709:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782222325.540546:0:18709:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1782222325.540553:0:18709:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00010000:00010000:1.0:1782222325.547514:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222325.549492:0:18709:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1782222325.549510:0:18709:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1782222325.573680:0:18709:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782222325.573911:0:18709:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1782222325.573917:0:18709:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1782222325.576172:0:18709:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1782222325.576186:0:18709:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1782222325.577331:0:18709:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1782222325.577341:0:18709:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1782222325.579268:0:18709:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782222325.579447:0:18709:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1782222325.579453:0:18709:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1782222325.580211:0:18709:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1782222325.580219:0:18709:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1782222325.621749:0:18709:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782222325.622203:0:18709:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1782222325.622210:0:18709:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1782222325.623715:0:18709:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1782222325.623726:0:18709:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1782222325.627297:0:18709:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1782222325.627329:0:18709:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1782222325.627335:0:18709:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.127@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1782222325.642411:0:18709:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.127@tcp ctxt 0 is initialized 00000020:01000004:2.0:1782222325.642450:0:18709:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.127@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1782222325.642454:0:18709:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1782222325.642456:0:18709:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782222325.642463:0:18709:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782222325.642464:0:18709:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782222325.642465:0:18709:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782222325.642466:0:18709:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782222325.642468:0:18709:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782222325.642469:0:18709:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782222325.642470:0:18709:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782222325.642474:0:18709:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1782222325.642475:0:18709:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782222325.642476:0:18709:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782222325.642477:0:18709:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782222325.642478:0:18709:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782222325.642479:0:18709:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782222325.642480:0:18709:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782222325.642481:0:18709:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782222325.642482:0:18709:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782222325.642482:0:18709:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782222325.642508:0:18709:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1782222325.642528:0:18709:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:18709:1868795081850624:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1782222325.642598:0:18709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222325.642704:0:18709:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746158000 going to sleep for 11 seconds 00000100:00100000:0.0:1782222325.643159:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081850624 00000100:00100000:0.0:1782222325.643168:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081850624 00000100:00100000:0.0:1782222325.643298:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1782222325.643307:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+18:18709:x1868795081850624:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1782222325.643341:0:17202:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1782222325.643343:0:17202:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1782222325.643347:0:17202:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1782222325.643651:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+18:18709:x1868795081850624:12345-0@lo:253:mount.lustre.0 Request processed in 344us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222325.643660:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782222325.644101:0:18709:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:18709:1868795081850624:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1782222325.644114:0:18709:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1782222325.644117:0:18709:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782222325.644119:0:18709:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1782222325.644120:0:18709:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782222325.644121:0:18709:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782222325.644122:0:18709:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782222325.644123:0:18709:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782222325.644124:0:18709:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782222325.644126:0:18709:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782222325.644127:0:18709:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1782222325.644145:0:18709:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f08815e5000 from lustre-OST0000 10000000:01000000:1.0:1782222325.644175:0:18709:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1782222325.644178:0:18709:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1782222325.644187:0:18709:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f087fb94d40 local copy 00010000:00010000:1.0:1782222325.644198:0:18709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fcb9400/0xe2b7cc26e681233b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812342 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222325.644321:0:18709:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747531f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:18709:1868795081850752:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782222325.644369:0:18709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222325.644399:0:18709:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747482600 going to sleep for 11 seconds 00000100:00100000:2.0:1782222325.644467:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081850752 00000100:00100000:2.0:1782222325.644473:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081850752 00000100:00100000:2.0:1782222325.644513:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1782222325.644522:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+18:18709:x1868795081850752:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782222325.644595:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+18:18709:x1868795081850752:12345-0@lo:501:mount.lustre.0 Request processed in 75us (226us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782222325.644602:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782222325.644715:0:18709:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747531f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:18709:1868795081850752:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1782222325.644729:0:18709:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1782222325.644747:0:18709:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1782222325.644752:0:18709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fcb9400/0xe2b7cc26e681233b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812342 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222325.644761:0:18709:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f087fcb9400/0xe2b7cc26e681233b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812342 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782222325.644787:0:18709:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f08815e5000 10000000:01000000:1.0:1782222325.644792:0:18709:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1782222325.644797:0:18709:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1782222325.644799:0:18709:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782222325.644803:0:18709:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1782222325.644806:0:18709:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1782222325.644842:0:18709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f074744d400/0xe2b7cc26e681258e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222325.644851:0:18709:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f074744d400/0xe2b7cc26e681258e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222325.644858:0:18709:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f074744d400/0xe2b7cc26e681258e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222325.644871:0:18709:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747531f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:18709:1868795081850880:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782222325.644896:0:18709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222325.644930:0:18709:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747482600 going to sleep for 11 seconds 00000100:00100000:2.0:1782222325.645111:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081850880 00000100:00100000:2.0:1782222325.645116:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081850880 00000100:00100000:2.0:1782222325.645153:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1782222325.645160:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+18:18709:x1868795081850880:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782222325.645172:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222325.645190:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f087fb82c00/0xe2b7cc26e6812595 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e681258e expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222325.645211:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fb82c00/0xe2b7cc26e6812595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e681258e expref: 19 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222325.645222:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f087fb82c00/0xe2b7cc26e6812595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e681258e expref: 19 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222325.645231:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb82c00, rc 0) 00000100:00100000:2.0:1782222325.645290:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+19:18709:x1868795081850880:12345-0@lo:101:mount.lustre.0 Request processed in 131us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222325.645298:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1782222325.645405:0:18709:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747531f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:18709:1868795081850880:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782222325.645418:0:18709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f074744d400/0xe2b7cc26e681258e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812595 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222325.645426:0:18709:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f074744d400/0xe2b7cc26e681258e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6812595 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782222325.647161:0:18709:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1782222325.648081:0:18709:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782222325.652765:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1782222325.652821:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1782222325.652848:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1782222325.652864:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1782222325.652877:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1782222325.652890:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1782222325.652917:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1782222325.652923:0:18709:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1782222325.653044:0:18709:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b786a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:18709:1868795081851008:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782222325.653120:0:18709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222325.653172:0:18709:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08492a1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782222325.653281:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081851008 00000100:00100000:2.0:1782222325.653290:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081851008 00000100:00100000:2.0:1782222325.653332:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1782222325.653341:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+19:18709:x1868795081851008:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782222325.653493:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+19:18709:x1868795081851008:12345-0@lo:501:mount.lustre.0 Request processed in 152us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222325.653501:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1782222325.653626:0:18709:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b786a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:18709:1868795081851008:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782222325.653662:0:18709:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b786a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:18709:1868795081851136:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782222325.653701:0:18709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222325.653729:0:18709:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08492a1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782222325.653774:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081851136 00000100:00100000:2.0:1782222325.653778:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081851136 00000100:00100000:2.0:1782222325.653811:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1782222325.653817:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+19:18709:x1868795081851136:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782222325.654719:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+19:18709:x1868795081851136:12345-0@lo:503:mount.lustre.0 Request processed in 898us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222325.654729:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1782222325.654821:0:18709:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b786a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:18709:1868795081851136:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1782222325.655278:0:18709:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782222325.655358:0:18709:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b786a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:18709:1868795081851264:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782222325.655401:0:18709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222325.655431:0:18709:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08492a1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782222325.655549:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081851264 00000100:00100000:2.0:1782222325.655562:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081851264 00000100:00100000:2.0:1782222325.655591:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1782222325.655598:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+19:18709:x1868795081851264:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782222325.656083:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+19:18709:x1868795081851264:12345-0@lo:502:mount.lustre.0 Request processed in 483us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222325.656091:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1782222325.656228:0:18709:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b786a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:18709:1868795081851264:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782222325.656547:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1782222325.656575:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1782222325.656589:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1782222325.656601:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1782222325.656614:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1782222325.656634:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1782222325.656650:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1782222325.656665:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1782222325.656678:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1782222325.656691:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1782222325.656703:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1782222325.656716:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1782222325.656745:0:18709:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b786a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:18709:1868795081851392:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782222325.656788:0:18709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222325.656871:0:18709:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08492a1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782222325.657196:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081851392 00000100:00100000:2.0:1782222325.657202:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081851392 00000100:00100000:2.0:1782222325.657269:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1782222325.657278:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+19:18709:x1868795081851392:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782222325.657367:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+19:18709:x1868795081851392:12345-0@lo:502:mount.lustre.0 Request processed in 90us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222325.657374:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1782222325.657454:0:18709:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b786a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:18709:1868795081851392:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782222325.657498:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1782222325.657506:0:18709:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1782222325.658715:0:18726:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1782222325.658724:0:18726:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1782222325.658732:0:18726:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782222325.658734:0:18726:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1782222325.658740:0:18726:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782222325.658754:0:18726:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8f07460f4d40) 00000020:00000080:0.0:1782222325.658782:0:18726:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1782222325.658788:0:18726:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1782222325.658891:0:18726:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f08815e5000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1782222325.658902:0:18726:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1782222325.658914:0:18726:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe2b7cc26e68125a3 00010000:00010000:0.0:1782222325.663973:0:18726:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1782222325.664752:0:18726:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:0.0:1782222325.668281:0:18726:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1782222325.669458:0:18726:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1782222325.669470:0:18726:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782222325.669476:0:18726:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222325.669478:0:18726:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1782222325.669481:0:18726:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1782222325.669491:0:18726:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1782222325.669493:0:18726:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782222325.669494:0:18726:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782222325.669496:0:18726:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1782222325.669499:0:18726:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222325.669500:0:18726:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1782222325.669503:0:18726:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782222325.669506:0:18726:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222325.669507:0:18726:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782222325.669510:0:18726:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782222325.669511:0:18726:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1782222325.669513:0:18726:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782222325.669515:0:18726:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222325.669517:0:18726:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1782222325.669518:0:18726:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782222325.669520:0:18726:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222325.669522:0:18726:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1782222325.669525:0:18726:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1782222325.669560:0:18726:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782222325.669563:0:18726:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222325.669565:0:18726:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1782222325.669567:0:18726:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1782222325.669772:0:18709:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1782222325.669803:0:18709:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1782222325.669818:0:18709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f074744d400/0xe2b7cc26e681258e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812595 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222325.669847:0:18709:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f074744d400/0xe2b7cc26e681258e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812595 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782222325.669855:0:18709:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f08815e5000 from 1 10000000:01000000:2.0:1782222325.669858:0:18709:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782222325.669891:0:18709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb82200/0xe2b7cc26e68125aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222325.669899:0:18709:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f087fb82200/0xe2b7cc26e68125aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222325.669920:0:18709:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f087fb82200/0xe2b7cc26e68125aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222325.669941:0:18709:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:18709:1868795081851520:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1782222325.670020:0:18709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222325.670066:0:18709:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746158f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782222325.671114:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081851520 00000100:00100000:1.0:1782222325.671124:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081851520 00000100:00100000:1.0:1782222325.671167:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1782222325.671175:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+19:18709:x1868795081851520:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782222325.671189:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222325.671204:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f074744dc00/0xe2b7cc26e68125b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e68125aa expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222325.671228:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f074744dc00/0xe2b7cc26e68125b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e68125aa expref: 20 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222325.671257:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f074744dc00/0xe2b7cc26e68125b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68125aa expref: 20 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222325.671266:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744dc00, rc 0) 00000100:00100000:1.0:1782222325.671332:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+20:18709:x1868795081851520:12345-0@lo:101:mount.lustre.0 Request processed in 157us (1312us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222325.671339:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1782222325.671457:0:18709:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:18709:1868795081851520:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782222325.671478:0:18709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f087fb82200/0xe2b7cc26e68125aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68125b1 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222325.671502:0:18709:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f087fb82200/0xe2b7cc26e68125aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e68125b1 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782222325.679784:0:18709:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1782222325.680095:0:18709:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782222325.680301:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1782222325.680327:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1782222325.680345:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1782222325.680350:0:18709:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1782222325.680420:0:18709:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747531f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:18709:1868795081851648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782222325.680483:0:18709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222325.680527:0:18709:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747482000 going to sleep for 11 seconds 00000100:00100000:3.0:1782222325.680831:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081851648 00000100:00100000:3.0:1782222325.680847:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081851648 00000100:00100000:3.0:1782222325.680895:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1782222325.680904:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+20:18709:x1868795081851648:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782222325.681015:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+20:18709:x1868795081851648:12345-0@lo:501:mount.lustre.0 Request processed in 112us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222325.681022:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782222325.681204:0:18709:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747531f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:18709:1868795081851648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782222325.681371:0:18709:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747531f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:18709:1868795081851776:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782222325.681562:0:18709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222325.681593:0:18709:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747482000 going to sleep for 11 seconds 00000100:00100000:0.0:1782222325.681641:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081851776 00000100:00100000:0.0:1782222325.681647:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081851776 00000100:00100000:0.0:1782222325.681680:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1782222325.681688:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+20:18709:x1868795081851776:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782222325.681783:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+20:18709:x1868795081851776:12345-0@lo:503:mount.lustre.0 Request processed in 95us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222325.681790:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782222325.681864:0:18709:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747531f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:18709:1868795081851776:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1782222325.682231:0:18709:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782222325.682322:0:18709:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747531f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:18709:1868795081851904:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782222325.682359:0:18709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222325.682377:0:18709:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747482000 going to sleep for 11 seconds 00000100:00100000:0.0:1782222325.682502:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081851904 00000100:00100000:0.0:1782222325.682508:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081851904 00000100:00100000:0.0:1782222325.682543:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1782222325.682551:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+20:18709:x1868795081851904:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782222325.682632:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+20:18709:x1868795081851904:12345-0@lo:502:mount.lustre.0 Request processed in 81us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222325.682639:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1782222325.682755:0:18709:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747531f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:18709:1868795081851904:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782222325.682927:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1782222325.682950:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1782222325.682977:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1782222325.683062:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1782222325.683078:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1782222325.683089:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1782222325.683101:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1782222325.683112:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1782222325.683125:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1782222325.683138:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1782222325.683150:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1782222325.683173:0:18709:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747531f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:18709:1868795081852032:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782222325.683208:0:18709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222325.683263:0:18709:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0747482000 going to sleep for 11 seconds 00000100:00100000:0.0:1782222325.683361:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081852032 00000100:00100000:0.0:1782222325.683366:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081852032 00000100:00100000:0.0:1782222325.683434:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1782222325.683442:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+20:18709:x1868795081852032:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782222325.683520:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+20:18709:x1868795081852032:12345-0@lo:502:mount.lustre.0 Request processed in 77us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222325.683526:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1782222325.683640:0:18709:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747531f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:18709:1868795081852032:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782222325.683678:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1782222325.683686:0:18709:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1782222325.684370:0:18730:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782222325.684378:0:18730:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222325.684380:0:18730:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1782222325.684385:0:18730:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f08815e5000 00000020:00000080:1.0:1782222325.684388:0:18730:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782222325.684395:0:18730:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782222325.684397:0:18730:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222325.684398:0:18730:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1782222325.684400:0:18730:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782222325.684401:0:18730:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222325.684402:0:18730:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1782222325.684405:0:18730:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f08815e5000 00000020:00000080:1.0:1782222325.684406:0:18730:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782222325.684452:0:18730:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782222325.684455:0:18730:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222325.684456:0:18730:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1782222325.684459:0:18730:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782222325.684461:0:18730:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222325.684462:0:18730:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1782222325.684465:0:18730:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f08815e5000 00000020:00000080:1.0:1782222325.684467:0:18730:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782222325.684484:0:18730:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782222325.684486:0:18730:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222325.684487:0:18730:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1782222325.684490:0:18730:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782222325.684492:0:18730:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222325.684493:0:18730:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1782222325.684496:0:18730:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f08815e5000 00000020:00000080:1.0:1782222325.684498:0:18730:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782222325.684517:0:18730:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782222325.684519:0:18730:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782222325.684520:0:18730:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1782222325.684523:0:18730:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1782222325.684639:0:18709:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1782222325.684664:0:18709:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782222325.684684:0:18709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb82200/0xe2b7cc26e68125aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68125b1 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222325.684695:0:18709:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f087fb82200/0xe2b7cc26e68125aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68125b1 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782222325.684745:0:18709:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1782222325.684748:0:18709:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f08815e5000 10000000:01000000:2.0:1782222325.684751:0:18709:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f08815e5000 10000000:01000000:2.0:1782222325.684755:0:18709:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782222325.684760:0:18709:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8f08815e5000 from 1 10000000:01000000:2.0:1782222325.684763:0:18709:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782222325.684793:0:18709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb83400/0xe2b7cc26e68125b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222325.684801:0:18709:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f087fb83400/0xe2b7cc26e68125b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222325.684810:0:18709:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f087fb83400/0xe2b7cc26e68125b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222325.684852:0:18709:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b15c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:18709:1868795081852160:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1782222325.684897:0:18709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222325.685067:0:18709:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746158480 going to sleep for 11 seconds 00000100:00100000:3.0:1782222325.685186:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081852160 00000100:00100000:3.0:1782222325.685193:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081852160 00000100:00100000:3.0:1782222325.685225:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1782222325.685246:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+20:18709:x1868795081852160:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782222325.685257:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222325.685269:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0746431200/0xe2b7cc26e68125bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e68125b8 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222325.685291:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0746431200/0xe2b7cc26e68125bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e68125b8 expref: 21 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222325.685302:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0746431200/0xe2b7cc26e68125bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68125b8 expref: 21 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222325.685310:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0746431200, rc 0) 00000100:00100000:3.0:1782222325.685361:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+21:18709:x1868795081852160:12345-0@lo:101:mount.lustre.0 Request processed in 128us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222325.685367:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1782222325.686145:0:18709:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b15c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:18709:1868795081852160:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782222325.686164:0:18709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f087fb83400/0xe2b7cc26e68125b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68125bf expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222325.686173:0:18709:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f087fb83400/0xe2b7cc26e68125b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e68125bf expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782222325.693896:0:18709:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1782222325.694202:0:18709:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782222325.694426:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1782222325.694451:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1782222325.694464:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1782222325.694477:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1782222325.694489:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1782222325.694500:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1782222325.694512:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1782222325.694523:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1782222325.694550:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1782222325.694564:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1782222325.694575:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1782222325.694588:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1782222325.694601:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1782222325.694614:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1782222325.694627:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1782222325.694640:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1782222325.694652:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1782222325.694678:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1782222325.694693:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1782222325.694706:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1782222325.694719:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1782222325.694732:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1782222325.694746:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1782222325.694760:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1782222325.694787:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1782222325.694804:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1782222325.694818:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1782222325.694831:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1782222325.694857:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1782222325.694870:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1782222325.694881:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1782222325.694892:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1782222325.694905:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1782222325.694917:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1782222325.694930:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1782222325.694942:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1782222325.694954:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1782222325.694971:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1782222325.694976:0:18709:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1782222325.695058:0:18709:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b15c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:18709:1868795081852288:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782222325.695119:0:18709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222325.695168:0:18709:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746158840 going to sleep for 11 seconds 00000100:00100000:3.0:1782222325.695344:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081852288 00000100:00100000:3.0:1782222325.695351:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081852288 00000100:00100000:3.0:1782222325.695399:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1782222325.695408:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+21:18709:x1868795081852288:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782222325.695517:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+21:18709:x1868795081852288:12345-0@lo:501:mount.lustre.0 Request processed in 110us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222325.695524:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1782222325.696115:0:18709:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b15c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:18709:1868795081852288:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782222325.696155:0:18709:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b15c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:18709:1868795081852416:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782222325.696198:0:18709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222325.696231:0:18709:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746158840 going to sleep for 11 seconds 00000100:00100000:1.0:1782222325.696312:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081852416 00000100:00100000:1.0:1782222325.696322:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081852416 00000100:00100000:1.0:1782222325.697549:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1782222325.697566:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+21:18709:x1868795081852416:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782222325.697714:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+21:18709:x1868795081852416:12345-0@lo:503:mount.lustre.0 Request processed in 152us (1514us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222325.697721:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1782222325.697812:0:18709:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b15c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:18709:1868795081852416:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1782222325.698280:0:18709:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782222325.698359:0:18709:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:18709:1868795081852544:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782222325.698403:0:18709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222325.698617:0:18709:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746406180 going to sleep for 11 seconds 00000100:00100000:2.0:1782222325.698651:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081852544 00000100:00100000:2.0:1782222325.698662:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081852544 00000100:00100000:2.0:1782222325.698692:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1782222325.698699:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+21:18709:x1868795081852544:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782222325.698831:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+21:18709:x1868795081852544:12345-0@lo:502:mount.lustre.0 Request processed in 132us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222325.698847:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1782222325.700912:0:18709:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:18709:1868795081852544:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782222325.702073:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1782222325.702126:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1782222325.702141:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1782222325.702169:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1782222325.702184:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1782222325.702198:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1782222325.702212:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1782222325.702225:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1782222325.702312:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1782222325.702329:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1782222325.702344:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1782222325.702358:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1782222325.702383:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1782222325.702398:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1782222325.702411:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1782222325.702425:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1782222325.702438:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1782222325.702452:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1782222325.702464:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1782222325.702490:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1782222325.702504:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1782222325.702515:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1782222325.702528:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1782222325.702541:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1782222325.702554:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1782222325.702565:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1782222325.702577:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1782222325.702589:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1782222325.702601:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1782222325.702613:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1782222325.702625:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1782222325.702638:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1782222325.702650:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1782222325.702663:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1782222325.702677:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1782222325.702704:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1782222325.702720:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1782222325.702733:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1782222325.702745:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1782222325.702756:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1782222325.702769:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1782222325.702780:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1782222325.702792:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1782222325.702805:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1782222325.702817:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1782222325.702852:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1782222325.702868:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1782222325.702882:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1782222325.702937:0:18709:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:18709:1868795081852672:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782222325.705926:0:18709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222325.706062:0:18709:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746406180 going to sleep for 11 seconds 00000100:00100000:3.0:1782222325.706304:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081852672 00000100:00100000:3.0:1782222325.706314:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081852672 00000100:00100000:3.0:1782222325.706362:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1782222325.706371:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+21:18709:x1868795081852672:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782222325.706577:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+21:18709:x1868795081852672:12345-0@lo:502:mount.lustre.0 Request processed in 206us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222325.706584:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1782222325.710311:0:18709:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:18709:1868795081852672:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782222325.710534:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1782222325.710561:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1782222325.710599:0:18709:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b786a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:18709:1868795081852800:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782222325.710666:0:18709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222325.710712:0:18709:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0845260cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782222325.713291:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081852800 00000100:00100000:0.0:1782222325.713303:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081852800 00000100:00100000:0.0:1782222325.713363:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1782222325.713371:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+21:18709:x1868795081852800:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782222325.713521:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+21:18709:x1868795081852800:12345-0@lo:502:mount.lustre.0 Request processed in 149us (2854us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222325.713529:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1782222325.715394:0:18709:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b786a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:18709:1868795081852800:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782222325.715493:0:18709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1782222325.715509:0:18709:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1782222325.716553:0:18735:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1782222325.716570:0:18735:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8f08780599c0) 00000020:00000080:2.0:1782222325.716594:0:18735:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1782222325.716805:0:18735:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f08815e5000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1782222325.716810:0:18735:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f08815e5000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1782222325.716812:0:18735:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8f08815e5000 3 00010000:00080000:2.0:1782222325.716853:0:18735:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f07471e0800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.127@tcp at head 00010000:00010000:2.0:1782222325.719321:0:18735:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1782222325.719425:0:18735:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1782222325.719473:0:18735:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1782222325.719485:0:18735:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xe2b7cc26e68125cd 00000100:00080000:2.0:1782222325.719495:0:18735:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782222325.719501:0:18735:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8f07471e0800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:2.0:1782222325.719536:0:18735:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0849b16d80 x1868795081852928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782222325.719622:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3652:1868795081852928:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1782222325.719707:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222325.719903:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081852928 00000100:00100000:2.0:1782222325.719910:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081852928 00000100:00100000:2.0:1782222325.719940:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782222325.719947:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b786a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3652:x1868795081852928:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1782222325.719987:0:17208:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 524 last 0 00000020:00000080:2.0:1782222325.720026:0:17208:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xe2b7cc26e68125d4 00000004:00100000:2.0:1782222325.720040:0:17208:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1782222325.720068:0:17208:0:(import.c:65:import_set_state_nolock()) ffff8f07471e4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782222325.720776:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b786a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1868795081852928:12345-0@lo:38:llog_process_th.0 Request processed in 823us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222325.720785:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1782222325.720808:0:18735:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1782222325.720884:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782222325.720889:0:491:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782222325.720891:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782222325.720894:0:491:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782222325.720920:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782222325.720923:0:491:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782222325.720926:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782222325.720929:0:491:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1782222325.720959:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081853056:0@lo:400:kworker.0 00000100:00100000:2.0:1782222325.720995:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222325.721018:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782222325.721024:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081853184:0@lo:400:kworker.0 00000100:00100000:2.0:1782222325.721046:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222325.721074:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081853312:0@lo:400:kworker.0 00000100:00100000:2.0:1782222325.721095:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222325.721120:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782222325.721126:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1868795081853440:0@lo:400:kworker.0 00000100:00100000:2.0:1782222325.721147:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222325.721178:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081853056 00000100:00100000:2.0:1782222325.721183:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081853056 00000100:00100000:2.0:1782222325.721210:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081853312 00000100:00100000:2.0:1782222325.721214:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081853312 00000100:00100000:2.0:1782222325.721228:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782222325.721253:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081853056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222325.721297:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081853056:12345-0@lo:400:kworker.0 Request processed in 62us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222325.721304:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782222325.721316:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782222325.721322:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081853312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222325.721351:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081853312:12345-0@lo:400:kworker.0 Request processed in 30us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222325.721357:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782222325.721375:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081853184 00000100:00100000:2.0:1782222325.721379:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081853184 00000100:00100000:2.0:1782222325.721399:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081853440 00000100:00100000:2.0:1782222325.721402:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081853440 00000100:00100000:2.0:1782222325.721413:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782222325.721418:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081853184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222325.721446:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081853184:12345-0@lo:400:kworker.0 Request processed in 28us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222325.721452:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782222325.721463:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782222325.721468:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1868795081853440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222325.721498:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1868795081853440:12345-0@lo:400:kworker.0 Request processed in 30us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222325.721503:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1782222325.721542:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0849b15880 x1868795081853440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222325.721554:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1868795081853440:0@lo:400:kworker.0 00000100:00100000:2.0:1782222325.721564:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081853312:0@lo:400:kworker.0 00010000:00080000:2.0:1782222325.721588:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0849b14a80 x1868795081853184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222325.721597:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081853184:0@lo:400:kworker.0 00000100:00100000:2.0:1782222325.721606:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081853056:0@lo:400:kworker.0 00010000:00080000:0.0:1782222325.723439:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0849b16d80 x1868795081852928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782222335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222325.723454:0:3652:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782222325.723462:0:3652:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1782222325.723470:0:3652:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1782222325.723475:0:3652:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1782222325.723478:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f07471e0800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1782222325.723485:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3652:1868795081852928:0@lo:38:llog_process_th.0 00000020:01000004:2.0:1782222325.723894:0:18735:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1782222325.723924:0:18735:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8f07471e99c0) 00000020:00000080:2.0:1782222325.723948:0:18735:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1782222325.724269:0:18735:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f08815e5000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1782222325.724274:0:18735:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f08815e5000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1782222325.724277:0:18735:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8f08815e5000 3 00010000:00080000:2.0:1782222325.724303:0:18735:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f07471e1000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.127@tcp at head 00010000:00010000:2.0:1782222325.725938:0:18735:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1782222325.726036:0:18735:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1782222325.726077:0:18735:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1782222325.726089:0:18735:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xe2b7cc26e68125e2 00000100:00080000:2.0:1782222325.726098:0:18735:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782222325.726104:0:18735:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8f07471e1000 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:2.0:1782222325.726137:0:18735:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0849b17800 x1868795081853568/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782222325.726170:0:18735:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1782222325.726205:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782222325.726210:0:491:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782222325.726212:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782222325.726215:0:491:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782222325.726219:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782222325.726222:0:491:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782222325.726224:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782222325.726227:0:491:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1782222325.726683:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3652:1868795081853568:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1782222325.726752:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222325.730767:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081853568 00000100:00100000:2.0:1782222325.730782:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081853568 00000100:00100000:2.0:1782222325.730840:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782222325.730848:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b784e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3652:x1868795081853568:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1782222325.730878:0:17210:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 524 last 0 00000020:00000080:2.0:1782222325.730916:0:17210:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xe2b7cc26e68125e9 00000004:00100000:2.0:1782222325.730931:0:17210:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1782222325.730963:0:17210:0:(import.c:65:import_set_state_nolock()) ffff8f07471e7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782222325.731046:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b784e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1868795081853568:12345-0@lo:38:llog_process_th.0 Request processed in 196us (4292us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222325.731053:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1782222325.731101:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f0849b17800 x1868795081853568/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782222335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222325.731125:0:3652:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782222325.731132:0:3652:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1782222325.731139:0:3652:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1782222325.731145:0:3652:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1782222325.731147:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f07471e1000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1782222325.731153:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3652:1868795081853568:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1782222325.731876:0:18735:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1782222325.736410:0:18709:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1782222325.736454:0:18709:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782222325.736478:0:18709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb83400/0xe2b7cc26e68125b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68125bf expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222325.736490:0:18709:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f087fb83400/0xe2b7cc26e68125b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68125bf expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1782222325.736543:0:18709:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1782222325.736545:0:18709:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782222325.736547:0:18709:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782222325.736548:0:18709:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782222325.736549:0:18709:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782222325.736550:0:18709:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782222325.736552:0:18709:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782222325.736553:0:18709:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782222325.736554:0:18709:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782222325.736558:0:18709:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1782222325.736561:0:18709:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782222325.736562:0:18709:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782222325.736568:0:18709:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782222325.736569:0:18709:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782222325.736570:0:18709:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782222325.736571:0:18709:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782222325.736572:0:18709:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782222325.736573:0:18709:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782222325.736574:0:18709:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782222325.736600:0:18709:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1782222325.736619:0:18709:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b786300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:18709:1868795081853696:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1782222325.736689:0:18709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222325.736764:0:18709:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0844c0c480 going to sleep for 11 seconds 00000100:00100000:2.0:1782222325.736919:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081853696 00000100:00100000:2.0:1782222325.736927:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081853696 00000100:00100000:2.0:1782222325.736981:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1782222325.737065:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+21:18709:x1868795081853696:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1782222325.737092:0:17202:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1782222325.737105:0:17202:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1782222325.739895:0:17202:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1782222325.739941:0:17202:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1782222325.740466:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+21:18709:x1868795081853696:12345-0@lo:253:mount.lustre.0 Request processed in 3399us (3770us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222325.740480:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1782222325.740571:0:18709:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b786300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:18709:1868795081853696:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1782222325.740585:0:18709:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1782222325.740588:0:18709:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782222325.740590:0:18709:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1782222325.740591:0:18709:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782222325.740593:0:18709:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782222325.740594:0:18709:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782222325.740595:0:18709:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782222325.740597:0:18709:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782222325.740599:0:18709:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782222325.740600:0:18709:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1782222325.740616:0:18709:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1782222325.742038:0:17224:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1782222325.742046:0:17224:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1782222325.742069:0:17224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f0746430800/0xe2b7cc26e68125f0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222325.742086:0:17224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0746431600/0xe2b7cc26e681253a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6812533 expref: 20 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222325.742094:0:17224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e6812548 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6812541 expref: 20 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222325.742102:0:17224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f0746430800/0xe2b7cc26e68125f0 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222325.742139:0:17224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e6812548 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e6812541 expref: 20 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222325.742171:0:17224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e6812548 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e6812541 expref: 20 pid: 17201 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222325.742185:0:17224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef4e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17224:1868795081853824:0@lo:104: 00000100:00100000:3.0:1782222325.743202:0:17224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782222325.743354:0:17224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0746431600/0xe2b7cc26e681253a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e6812533 expref: 20 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222325.743366:0:17224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f0746431600/0xe2b7cc26e681253a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e6812533 expref: 20 pid: 17201 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222325.743378:0:17224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17224:1868795081853952:0@lo:104: 00000100:00100000:3.0:1782222325.743416:0:17224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222325.746587:0:17224:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746406c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782222325.746692:0:17192:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782222325.746717:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081853824 00000100:00100000:2.0:1782222325.746726:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081853824 00000100:00100000:2.0:1782222325.746761:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081853952 00000100:00100000:2.0:1782222325.746765:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081853952 00000100:00100000:2.0:1782222325.746784:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782222325.746792:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0873f67-836f-4221-9522-aadc54ad715e+4:17224:x1868795081853824:12345-0@lo:104: 00010000:00010000:2.0:1782222325.746810:0:17192:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f087fcb9600/0xe2b7cc26e6812541 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6812548 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222325.747066:0:17192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782222325.747073:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0873f67-836f-4221-9522-aadc54ad715e+4:17224:x1868795081853824:12345-0@lo:104: Request processed in 282us (4840us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222325.747080:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782222325.747098:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782222325.747104:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0848d0c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0873f67-836f-4221-9522-aadc54ad715e+3:17224:x1868795081853952:12345-0@lo:104: 00010000:00010000:2.0:1782222325.747112:0:17192:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f087fb83800/0xe2b7cc26e6812533 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e681253a expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222325.747146:0:17192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782222325.747151:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0848d0c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0873f67-836f-4221-9522-aadc54ad715e+3:17224:x1868795081853952:12345-0@lo:104: Request processed in 48us (3735us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222325.747157:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1782222325.747192:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782222325.747198:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f087fcb9600/0xe2b7cc26e6812541 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6812548 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222325.747205:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb9600 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:2.0:1782222325.747210:0:17197:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f087fcb9600/0xe2b7cc26e6812541 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e6812548 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222325.747218:0:17197:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f087fcb9600/0xe2b7cc26e6812541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e6812548 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782222325.747225:0:17197:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f087fcb9600/0xe2b7cc26e6812541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e6812548 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782222325.747231:0:17197:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1782222325.747307:0:17197:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f087fcb9600/0xe2b7cc26e6812541 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6812548 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222325.747313:0:17197:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782222325.747333:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f087fcb9600/0xe2b7cc26e6812541 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6812548 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222325.747339:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f087fcb9600/0xe2b7cc26e6812541 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6812548 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222325.747353:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782222325.747356:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f087fb83800/0xe2b7cc26e6812533 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e681253a expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222325.747362:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83800 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:2.0:1782222325.747364:0:17197:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f087fb83800/0xe2b7cc26e6812533 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e681253a expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222325.747371:0:17197:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f087fb83800/0xe2b7cc26e6812533 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e681253a expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782222325.747377:0:17197:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f087fb83800/0xe2b7cc26e6812533 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e681253a expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782222325.747383:0:17197:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1782222325.747395:0:17197:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f087fb83800/0xe2b7cc26e6812533 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e681253a expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222325.747401:0:17197:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782222325.747406:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f087fb83800/0xe2b7cc26e6812533 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e681253a expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222325.747423:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f087fb83800/0xe2b7cc26e6812533 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e681253a expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222325.747436:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222325.747438:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222325.747439:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222325.747447:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222325.747467:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0873f67-836f-4221-9522-aadc54ad715e:3653:1868795081854080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782222325.747502:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222325.747526:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782222325.747532:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0873f67-836f-4221-9522-aadc54ad715e:3653:1868795081854208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782222325.747555:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222325.747586:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081854080 00000100:00100000:2.0:1782222325.747589:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081854080 00010000:00010000:2.0:1782222325.747609:0:17195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e6812548 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6812541 expref: 21 pid: 17201 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222325.747630:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081854208 00000100:00100000:2.0:1782222325.747633:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081854208 00010000:00010000:2.0:1782222325.747643:0:17195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0746431600/0xe2b7cc26e681253a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6812533 expref: 22 pid: 17201 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222325.747655:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782222325.747660:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0873f67-836f-4221-9522-aadc54ad715e+22:3653:x1868795081854080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782222325.747671:0:17195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782222325.747675:0:17195:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e6812548 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6812541 expref: 22 pid: 17201 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222325.747695:0:17195:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e6812548 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e6812541 expref: 22 pid: 17201 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222325.747710:0:17195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782222325.747738:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0873f67-836f-4221-9522-aadc54ad715e+22:3653:x1868795081854080:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222325.747745:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782222325.747757:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782222325.747763:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087eec9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0873f67-836f-4221-9522-aadc54ad715e+21:3653:x1868795081854208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782222325.747770:0:17195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782222325.747774:0:17195:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0746431600/0xe2b7cc26e681253a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6812533 expref: 21 pid: 17201 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222325.747782:0:17195:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0746431600/0xe2b7cc26e681253a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e6812533 expref: 21 pid: 17201 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222325.747792:0:17195:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f0746430800/0xe2b7cc26e68125f0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222325.747798:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0746430800/0xe2b7cc26e68125f0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1782222325.747809:0:17195:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007046334s 00010000:00010000:2.0:1782222325.747814:0:17195:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f0746430800/0xe2b7cc26e68125f0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222325.747820:0:17195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f0746430800/0xe2b7cc26e68125f0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222325.747849:0:17195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f0746430800/0xe2b7cc26e68125f0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222325.747855:0:17195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f0746430800/0xe2b7cc26e68125f0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222325.747860:0:17195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746430800 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:2.0:1782222325.747864:0:17195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f0746430800/0xe2b7cc26e68125f0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222325.747870:0:17195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f0746430800/0xe2b7cc26e68125f0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222325.747878:0:17195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f0746430800/0xe2b7cc26e68125f0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222325.747887:0:17195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782222325.747910:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087eec9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0873f67-836f-4221-9522-aadc54ad715e+21:3653:x1868795081854208:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222325.747916:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782222325.747971:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0873f67-836f-4221-9522-aadc54ad715e:3653:1868795081854208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782222325.747981:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0873f67-836f-4221-9522-aadc54ad715e:3653:1868795081854080:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782222325.748737:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f087fb83200/0xe2b7cc26e6812548 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e6812541 expref: 20 pid: 17201 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222325.748750:0:17224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef4e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17224:1868795081853824:0@lo:104: 00010000:00010000:3.0:1782222325.748761:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0746431600/0xe2b7cc26e681253a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e6812533 expref: 19 pid: 17201 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222325.748769:0:17224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17224:1868795081853952:0@lo:104: 00010000:00010000:3.0:1782222325.748784:0:17224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f0746430800/0xe2b7cc26e68125f0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222325.748793:0:17224:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f0746430800/0xe2b7cc26e68125f0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222325.748809:0:17224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f0746430800/0xe2b7cc26e68125f0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222325.748814:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0746430800/0xe2b7cc26e68125f0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1782222325.750227:0:18709:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1782222325.752626:0:17191:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00002000:00080000:0.0:1782222325.754050:0:18709:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1782222325.754058:0:18709:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1782222325.754095:0:18709:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1782222325.754138:0:18709:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.127@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1782222325.754154:0:18709:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1782222325.754179:0:18709:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1782222325.754950:0:18709:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782222325.755204:0:18709:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1782222326.572081:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1782222326.606654:0:18788:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782222326.606956:0:18788:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:0.0:1782222327.146904:0:17242:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1782222327.594927:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782222327.724544:0:17206:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1782222327.724553:0:17206:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8f08516c3800 from 9 10000000:01000000:1.0:1782222327.724558:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782222327.724608:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f074744ca00/0xe2b7cc26e68125f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222327.724620:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f074744ca00/0xe2b7cc26e68125f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222327.724630:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f074744ca00/0xe2b7cc26e68125f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222327.724654:0:17206:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747531f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081854336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782222327.724733:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222327.724781:0:17206:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0842d519c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782222327.725144:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081854336 00000100:00100000:2.0:1782222327.725153:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081854336 00000100:00100000:2.0:1782222327.725215:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1782222327.725224:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+19:17206:x1868795081854336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782222327.725263:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222327.725278:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f087fb82600/0xe2b7cc26e68125fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e68125f7 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222327.725301:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fb82600/0xe2b7cc26e68125fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e68125f7 expref: 20 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222327.725313:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f087fb82600/0xe2b7cc26e68125fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68125f7 expref: 20 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222327.725321:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb82600, rc 0) 00000100:00100000:2.0:1782222327.725365:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+20:17206:x1868795081854336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222327.725371:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1782222327.727668:0:17206:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747531f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081854336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782222327.727693:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f074744ca00/0xe2b7cc26e68125f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68125fe expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222327.727705:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f074744ca00/0xe2b7cc26e68125f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e68125fe expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222327.727776:0:17206:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747531f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081854464:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1782222327.727857:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222327.727934:0:17206:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0842d519c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782222327.734012:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081854464 00000100:00100000:2.0:1782222327.734028:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081854464 00000100:00100000:3.0:1782222327.735133:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1782222327.735145:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+20:17206:x1868795081854464:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1782222327.735170:0:17202:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1782222327.735192:0:17202:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1782222327.735195:0:17202:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1782222327.735360:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+20:17206:x1868795081854464:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 216us (7501us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222327.735368:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1782222327.735992:0:17206:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747531f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081854464:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1782222327.736082:0:17206:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1782222327.736093:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f074744ca00/0xe2b7cc26e68125f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68125fe expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222327.736106:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f074744ca00/0xe2b7cc26e68125f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68125fe expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782222327.736117:0:17206:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1782222327.736120:0:17206:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8f0748460800 from 9 10000000:01000000:2.0:1782222327.736122:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782222327.736160:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb82800/0xe2b7cc26e6812605 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222327.736169:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f087fb82800/0xe2b7cc26e6812605 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222327.736179:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f087fb82800/0xe2b7cc26e6812605 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222327.736199:0:17206:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b17800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081854592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782222327.742090:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222327.742162:0:17206:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f07461660c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782222327.742192:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081854592 00000100:00100000:2.0:1782222327.742200:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081854592 00000100:00100000:2.0:1782222327.742269:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1782222327.742279:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+20:17206:x1868795081854592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782222327.742296:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222327.742314:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f087fb82a00/0xe2b7cc26e681260c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6812605 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222327.742342:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fb82a00/0xe2b7cc26e681260c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6812605 expref: 21 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222327.742353:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f087fb82a00/0xe2b7cc26e681260c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6812605 expref: 21 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222327.742362:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb82a00, rc 0) 00000100:00100000:2.0:1782222327.742430:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+21:17206:x1868795081854592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222327.742436:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1782222327.742499:0:17206:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b17800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081854592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782222327.742515:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f087fb82800/0xe2b7cc26e6812605 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681260c expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222327.742525:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f087fb82800/0xe2b7cc26e6812605 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e681260c expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222327.742582:0:17206:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b17800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081854720:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1782222327.742615:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222327.742637:0:17206:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f07461660c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782222327.742867:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081854720 00000100:00100000:3.0:1782222327.742873:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081854720 00000100:00100000:3.0:1782222327.742909:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1782222327.742917:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+21:17206:x1868795081854720:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1782222327.742932:0:17202:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1782222327.742948:0:17202:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1782222327.742951:0:17202:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1782222327.743038:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+21:17206:x1868795081854720:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 122us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222327.743044:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1782222327.743411:0:17206:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b17800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081854720:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1782222327.743466:0:17206:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1782222327.743473:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb82800/0xe2b7cc26e6812605 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681260c expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222327.743482:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f087fb82800/0xe2b7cc26e6812605 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681260c expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222328.619325:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222329.642609:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222329.837505:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b784a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081854848:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782222329.837574:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222329.837630:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081854848 00000100:00100000:0.0:1782222329.837637:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081854848 00000100:00100000:0.0:1782222329.837684:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782222329.837692:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081854848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782222329.837730:0:17213:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1782222329.837775:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081854848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222329.837782:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782222329.837837:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b784a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081854848:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782222329.839475:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081854976:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782222329.839540:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222329.839641:0:18230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081854976 00000100:00100000:2.0:1782222329.839648:0:18230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081854976 00000100:00100000:2.0:1782222329.839695:0:18230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782222329.839704:0:18230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081854976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782222329.839737:0:18230:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1782222329.839795:0:18230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081854976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222329.839822:0:18230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782222329.839897:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081854976:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1782222330.667435:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782222330.859076:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782222330.859084:0:491:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782222330.859087:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782222330.859090:0:491:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782222330.859121:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782222330.859124:0:491:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782222330.859126:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782222330.859129:0:491:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1782222330.859171:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1868795081855360:0@lo:400:kworker.0 00000100:00100000:3.0:1782222330.859281:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222330.859315:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1868795081855872:0@lo:400:kworker.0 00000100:00100000:3.0:1782222330.859341:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222330.859364:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782222330.859514:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081855488:0@lo:400:kworker.0 00000100:00100000:3.0:1782222330.859542:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222330.859581:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081855360 00000100:00100000:3.0:1782222330.859590:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081855360 00000100:00100000:3.0:1782222330.859633:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081855872 00000100:00100000:3.0:1782222330.859637:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081855872 00000100:00100000:3.0:1782222330.859662:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782222330.859670:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1868795081855360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222330.859720:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1868795081855360:12345-0@lo:400:kworker.0 Request processed in 50us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222330.859739:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782222330.859756:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782222330.859762:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1868795081855872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222330.859791:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1868795081855872:12345-0@lo:400:kworker.0 Request processed in 29us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222330.859808:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782222330.859833:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081855488 00000100:00100000:3.0:1782222330.859837:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081855488 00000100:00100000:3.0:1782222330.859861:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782222330.859867:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081855488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222330.859898:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081855488:12345-0@lo:400:kworker.0 Request processed in 31us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222330.859904:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782222330.859939:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081855488:0@lo:400:kworker.0 00010000:00080000:3.0:1782222330.859950:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0747ef5f80 x1868795081855360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222330.859962:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1868795081855360:0@lo:400:kworker.0 00010000:00080000:3.0:1782222330.859971:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0747ef4380 x1868795081855872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222330.859977:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1868795081855872:0@lo:400:kworker.0 00000100:00100000:1.0:1782222330.860477:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081855232:0@lo:400:kworker.0 00000100:00100000:1.0:1782222330.860521:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222330.860559:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1868795081855744:0@lo:400:kworker.0 00000100:00100000:1.0:1782222330.860585:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222330.860607:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782222330.860613:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0873f67-836f-4221-9522-aadc54ad715e:3654:1868795081855104:0@lo:400:kworker.0 00000100:00100000:1.0:1782222330.860640:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222330.860659:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1868795081855616:0@lo:400:kworker.0 00000100:00100000:1.0:1782222330.860679:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222330.860705:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081855232 00000100:00100000:1.0:1782222330.860710:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081855232 00000100:00100000:1.0:1782222330.860735:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782222330.860741:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081855232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222330.860776:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081855232:12345-0@lo:400:kworker.0 Request processed in 35us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222330.860998:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081855104 00000100:00100000:3.0:1782222330.861004:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081855104 00000100:00100000:3.0:1782222330.861036:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1782222330.861043:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+21:3654:x1868795081855104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222330.861084:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+21:3654:x1868795081855104:12345-0@lo:400:kworker.0 Request processed in 41us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222330.861091:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1782222330.861124:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081855744 00000100:00100000:3.0:1782222330.861128:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081855744 00000100:00100000:3.0:1782222330.861150:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081855616 00000100:00100000:3.0:1782222330.861153:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081855616 00000100:00100000:3.0:1782222330.861167:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782222330.861173:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1868795081855744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222330.861202:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1868795081855744:12345-0@lo:400:kworker.0 Request processed in 29us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222330.861208:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782222330.861220:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782222330.861225:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1868795081855616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222330.861355:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782222330.861463:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0873f67-836f-4221-9522-aadc54ad715e:3654:1868795081855104:0@lo:400:kworker.0 00000100:00100000:1.0:1782222330.861477:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081855232:0@lo:400:kworker.0 00010000:00080000:1.0:1782222330.861488:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0747ef5180 x1868795081855744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222330.861496:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1868795081855744:0@lo:400:kworker.0 00000100:00080000:0.0:1782222330.861600:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782222330.861604:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782222330.862734:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1868795081855616:12345-0@lo:400:kworker.0 Request processed in 1503us (2048us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222330.862746:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1782222330.862896:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0747ef5880 x1868795081855616/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222330.862909:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1868795081855616:0@lo:400:kworker.0 00010000:00010000:1.0:1782222331.690544:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782222331.819088:0:17966:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:2.0:1782222332.683386:0:19078:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1782222332.715273:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1782222333.641885:0:19130:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782222333.642140:0:19130:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1782222333.742044:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1782222334.549973:0:19180:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782222334.550184:0:19180:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1782222334.765593:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222334.955824:0:3652:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782222319/real 1782222319] req@ffff8f074561d500 x1868795081848448/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782222334 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222334.955854:0:3652:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f074561d500 x1868795081848448/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782222334 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222334.955864:0:3652:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782222319/real 1782222319] req@ffff8f074561c700 x1868795081848576/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782222334 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222334.955874:0:3652:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f074561c700 x1868795081848576/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782222334 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782222334.955893:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f08672fb000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782222334.955909:0:3652:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1782222334.955913:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1868795081848448:0@lo:8:kworker.0 00000100:00080000:0.0:1782222334.955928:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f08450bd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782222334.955934:0:3652:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1782222334.955937:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1868795081848576:0@lo:8:kworker.0 00000100:00080000:0.0:1782222334.956214:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782222334.956218:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782222334.956221:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782222334.956224:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782222334.956262:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782222334.956276:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1782222334.956278:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f08672fb000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782222334.956283:0:8:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 518 00000100:00080000:0.0:1782222334.956288:0:8:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1782222334.956295:0:8:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8f08672fb000 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:0.0:1782222334.956316:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f07474bf480 x1868795081856512/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782222334.956330:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782222334.956332:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1782222334.956334:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f08450bd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782222334.956337:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 518 00000100:00080000:0.0:1782222334.956339:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1782222334.956343:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f08450bd800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:0.0:1782222334.956352:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f07474bca80 x1868795081856640/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782222334.956608:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b785880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0873f67-836f-4221-9522-aadc54ad715e:3656:1868795081856000:0@lo:400:kworker.0 00000100:00100000:1.0:1782222334.956866:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1868795081856256:0@lo:400:kworker.0 00000100:00100000:1.0:1782222334.956940:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222334.956988:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1868795081857024:0@lo:400:kworker.0 00000100:00100000:1.0:1782222334.957026:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222334.957047:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782222334.957053:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f086b786300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081856128:0@lo:400:kworker.0 00000100:00100000:1.0:1782222334.957077:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222334.957100:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1868795081856896:0@lo:400:kworker.0 00000100:00100000:1.0:1782222334.957120:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222334.957158:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081856256 00000100:00100000:1.0:1782222334.957164:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081856256 00000100:00100000:1.0:1782222334.957197:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081857024 00000100:00100000:1.0:1782222334.957199:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081857024 00000100:00100000:1.0:1782222334.957221:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081856896 00000100:00100000:1.0:1782222334.957224:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081856896 00000100:00100000:1.0:1782222334.957263:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782222334.957271:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1868795081856256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222334.957322:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1868795081856256:12345-0@lo:400:kworker.0 Request processed in 51us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222334.957329:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782222334.957346:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782222334.957352:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1868795081857024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222334.957377:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1868795081857024:12345-0@lo:400:kworker.0 Request processed in 26us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222334.957383:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782222334.957393:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782222334.957398:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1868795081856896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222334.957419:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1868795081856896:12345-0@lo:400:kworker.0 Request processed in 21us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222334.957425:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782222334.957444:0:18230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081856128 00000100:00100000:1.0:1782222334.957448:0:18230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081856128 00000100:00100000:1.0:1782222334.957468:0:18230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782222334.957474:0:18230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081856128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222334.957501:0:18230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081856128:12345-0@lo:400:kworker.0 Request processed in 27us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222334.957515:0:18230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782222334.957550:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b786300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081856128:0@lo:400:kworker.0 00010000:00080000:1.0:1782222334.957561:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f07474bc380 x1868795081856896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222334.957570:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1868795081856896:0@lo:400:kworker.0 00010000:00080000:1.0:1782222334.957578:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f07474be300 x1868795081856256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222334.957587:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1868795081856256:0@lo:400:kworker.0 00010000:00080000:1.0:1782222334.957595:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f07474bed80 x1868795081857024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222334.957603:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1868795081857024:0@lo:400:kworker.0 00000100:00100000:1.0:1782222334.957895:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081856384:0@lo:400:kworker.0 00000100:00100000:1.0:1782222334.957925:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222334.957956:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081856384 00000100:00100000:1.0:1782222334.957960:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081856384 00000100:00100000:1.0:1782222334.957982:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782222334.957989:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081856384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222334.958021:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081856384:12345-0@lo:400:kworker.0 Request processed in 32us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222334.958026:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782222334.958051:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081856384:0@lo:400:kworker.0 00000100:00080000:1.0:1782222334.958086:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782222334.958096:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782222334.958108:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1868795081856512:0@lo:8:kworker.0 00000100:00100000:1.0:1782222334.958134:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222334.958155:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1868795081856640:0@lo:8:kworker.0 00000100:00100000:1.0:1782222334.958175:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222334.958483:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081856512 00000100:00100000:2.0:1782222334.958487:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081856512 00000100:00100000:2.0:1782222334.958505:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081856640 00000100:00100000:2.0:1782222334.958508:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081856640 00000100:00100000:2.0:1782222334.958518:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782222334.958524:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b786300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3652:x1868795081856512:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1782222334.958550:0:18714:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:2.0:1782222334.958583:0:18714:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe2b7cc26e6812613 00002000:00100000:2.0:1782222334.958596:0:18714:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8f07471e3800 ocd_connect_flags: 0xe044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1782222334.958601:0:18714:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1782222334.958603:0:18714:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1782222334.959149:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222334.959184:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1868795081856768:0@lo:400:kworker.0 00000100:00100000:0.0:1782222334.959210:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222334.959231:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782222334.959254:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081857152:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782222334.959279:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222334.959308:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081856000 00000100:00100000:0.0:1782222334.959312:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081856000 00000100:00100000:0.0:1782222334.959343:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1782222334.959359:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+21:3656:x1868795081856000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222334.959398:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+21:3656:x1868795081856000:12345-0@lo:400:kworker.0 Request processed in 40us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222334.959405:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1782222334.959435:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081856768 00000100:00100000:0.0:1782222334.959438:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081856768 00000100:00100000:0.0:1782222334.959461:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782222334.959467:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1868795081856768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222334.959496:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1868795081856768:12345-0@lo:400:kworker.0 Request processed in 29us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222334.959502:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782222334.959517:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081857152 00000100:00100000:0.0:1782222334.959521:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081857152 00000100:00100000:0.0:1782222334.959541:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782222334.959547:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081857152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782222334.959583:0:17213:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00002000:00080000:2.0:1782222334.960111:0:18714:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1782222334.960141:0:18714:0:(import.c:65:import_set_state_nolock()) ffff8f07471e6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782222334.960189:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b786300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3652:x1868795081856512:12345-0@lo:8:kworker.0 Request processed in 1663us (2053us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222334.960197:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782222334.960217:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782222334.960221:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088159bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3652:x1868795081856640:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1782222334.960257:0:18714:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1782222334.960783:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081857152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222334.960793:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782222334.960868:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081857152:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782222334.960880:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f086b785880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0873f67-836f-4221-9522-aadc54ad715e:3656:1868795081856000:0@lo:400:kworker.0 00010000:00080000:0.0:1782222334.960891:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f07474bd880 x1868795081856768/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222334.960901:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1868795081856768:0@lo:400:kworker.0 00000100:00100000:1.0:1782222334.963977:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782222334.964007:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081857280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782222334.964075:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222334.964118:0:18230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081857280 00000100:00100000:1.0:1782222334.964125:0:18230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081857280 00000100:00100000:1.0:1782222334.964170:0:18230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782222334.964179:0:18230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088159aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081857280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782222334.964214:0:18230:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1782222334.964280:0:18230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088159aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081857280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222334.964288:0:18230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782222334.964335:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081857280:0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1782222334.973923:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f07474bf480 x1868795081856512/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782222354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222334.973952:0:3652:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782222334.973962:0:3652:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1782222334.973972:0:3652:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xe040401443000026 00000100:00080000:2.0:1782222334.973978:0:3652:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1782222334.973982:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f08672fb000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1782222334.974105:0:17949:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000004:00080000:2.0:1782222334.974111:0:3652:0:(osp_dev.c:1650:osp_import_event()) got connected 00000100:00100000:2.0:1782222334.974118:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1868795081856512:0@lo:8:kworker.0 00000100:00100000:0.0:1782222334.974134:0:17949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474be680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17949:1868795081857536:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1782222334.974187:0:17949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222334.974198:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088159bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3652:x1868795081856640:12345-0@lo:8:kworker.0 Request processed in 13976us (16022us total) trans 0 rc -19/-19 00000100:00100000:0.0:1782222334.974207:0:17949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074725fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1782222334.974208:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782222334.974230:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081857536 00000100:00100000:0.0:1782222334.974253:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081857536 00000100:00080000:2.0:1782222334.974269:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f08450bd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782222334.974274:0:3652:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1782222334.974277:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1868795081856640:0@lo:8:kworker.0 00000100:00100000:0.0:1782222334.974293:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782222334.974301:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17949:x1868795081857536:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1782222334.974540:0:17948:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1782222334.974689:0:17948:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 534003453833ns, next at 0ns, rc = 0 00080000:00080000:1.0:1782222334.974697:0:17948:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1782222334.974753:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081857408:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782222334.974794:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1782222334.974840:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782222334.974868:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081857408 00000100:00100000:1.0:1782222334.974872:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081857408 00000100:00100000:1.0:1782222334.974896:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782222334.974902:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088159b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3653:x1868795081857408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782222334.974928:0:18717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1782222334.974975:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088159b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3653:x1868795081857408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222334.974982:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1782222334.975038:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f07474bd880 x1868795081857408/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222350 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222334.975053:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081857408:0@lo:13:osp-pre-0-1.0 00000004:00080000:2.0:1782222334.977744:0:17940:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:1.0:1782222334.980349:0:18715:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1782222334.980360:0:18715:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1782222334.980503:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17949:x1868795081857536:12345-0@lo:7:osp-pre-0-1.0 Request processed in 6197us (6310us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222334.980521:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1782222334.981131:0:17949:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f07474be680 x1868795081857536/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782222350 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222334.981146:0:17949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474be680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17949:1868795081857536:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1782222334.981159:0:17949:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:0.0:1782222334.981199:0:17949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474be680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17949:1868795081857664:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1782222334.981263:0:17949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222334.981289:0:17949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074725fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1782222334.981345:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081857664 00000100:00100000:3.0:1782222334.981351:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081857664 00000100:00100000:3.0:1782222334.981399:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782222334.981409:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17949:x1868795081857664:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1782222334.981440:0:18716:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1782222334.981475:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17949:x1868795081857664:12345-0@lo:5:osp-pre-0-1.0 Request processed in 67us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222334.981481:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1782222334.981496:0:17949:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f07474be680 x1868795081857664/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782222350 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222334.981505:0:17949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474be680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17949:1868795081857664:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1782222334.981513:0:17949:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1782222334.981536:0:17949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474be680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17949:1868795081857792:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1782222334.981558:0:17949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222334.981576:0:17949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f074725fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1782222334.981669:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081857792 00000100:00100000:1.0:1782222334.981673:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081857792 00000100:00100000:1.0:1782222334.981711:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782222334.981719:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17949:x1868795081857792:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1782222334.981745:0:18715:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:3.0:1782222335.008198:0:18710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1782222335.008213:0:18710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1782222335.008617:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17949:x1868795081857792:12345-0@lo:5:osp-pre-0-1.0 Request processed in 26891us (27050us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1782222335.008629:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1782222335.008881:0:17949:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f07474be680 x1868795081857792/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782222350 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222335.008894:0:17949:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1782222335.008901:0:17949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474be680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17949:1868795081857792:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1782222335.008915:0:17949:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1782222335.009456:0:17949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b16680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17949:1868795081857920:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1782222335.009495:0:17949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222335.009550:0:17949:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746166300 going to sleep for 11 seconds 00000100:00100000:3.0:1782222335.009596:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081857920 00000100:00100000:3.0:1782222335.009601:0:17219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081857920 00000100:00100000:3.0:1782222335.009642:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782222335.009651:0:17219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17949:x1868795081857920:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1782222335.009882:0:17219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17949:x1868795081857920:12345-0@lo:900:osp-pre-0-1.0 Request processed in 231us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222335.009889:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1782222335.010415:0:17949:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0849b16680 x1868795081857920/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1782222351 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222335.010428:0:17949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b16680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17949:1868795081857920:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1782222335.788109:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222336.812117:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782222337.451098:0:17242:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1782222337.835459:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222338.859195:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222339.886100:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222340.074355:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782222340.074377:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081858176:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1782222340.074381:0:15024:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782222340.074385:0:15024:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782222340.074388:0:15024:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782222340.074390:0:15024:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782222340.074406:0:15024:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782222340.074409:0:15024:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1782222340.074412:0:15024:0:(import.c:65:import_set_state_nolock()) ffff8f08450bd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782222340.074416:0:15024:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 533 00000100:00080000:0.0:1782222340.074421:0:15024:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1782222340.074427:0:15024:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f08450bd800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:3.0:1782222340.074440:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222340.074445:0:15024:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f07474be680 x1868795081858944/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782222340.074485:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081858048:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782222340.074485:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081858688:0@lo:400:kworker.0 00000100:00100000:3.0:1782222340.074509:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222340.074513:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0873f67-836f-4221-9522-aadc54ad715e:3655:1868795081858304:0@lo:400:kworker.0 00000100:00100000:3.0:1782222340.074532:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081858560:0@lo:400:kworker.0 00000100:00100000:0.0:1782222340.074614:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222340.076974:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222340.076974:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081858816:0@lo:400:kworker.0 00000100:00100000:0.0:1782222340.077007:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222340.077012:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1868795081859200:0@lo:400:kworker.0 00000100:00100000:3.0:1782222340.077051:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222340.077092:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081858176 00000100:00100000:3.0:1782222340.077100:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081858176 00000100:00100000:3.0:1782222340.077152:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782222340.077161:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081858176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782222340.077193:0:18717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1782222340.077209:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081859456:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782222340.077249:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081858176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (2793us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222340.077253:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222340.077256:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782222340.077273:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782222340.077279:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081858048 00000100:00100000:0.0:1782222340.077279:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081858432:0@lo:400:kworker.0 00000100:00100000:3.0:1782222340.077282:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081858048 00000100:00100000:0.0:1782222340.077300:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222340.077304:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081859456 00000100:00100000:3.0:1782222340.077307:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081859456 00000100:00100000:3.0:1782222340.077318:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081858432 00000100:00100000:0.0:1782222340.077319:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1868795081859072:0@lo:400:kworker.0 00000100:00100000:3.0:1782222340.077320:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081858432 00000100:00100000:3.0:1782222340.077330:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782222340.077336:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081858048:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782222340.077339:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:3.0:1782222340.077360:0:17214:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1782222340.077370:0:3652:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782222320/real 1782222320] req@ffff8f074561dc00 x1868795081849728/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782222340 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222340.077388:0:3652:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f074561dc00 x1868795081849728/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782222340 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222340.077392:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081858048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (2882us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222340.077398:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782222340.077399:0:3652:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782222320/real 1782222320] req@ffff8f074561e680 x1868795081849856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782222340 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222340.077410:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1782222340.077410:0:3652:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f074561e680 x1868795081849856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782222340 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222340.077415:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3655:x1868795081859456:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782222340.077422:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1868795081858944:0@lo:8:kworker.0 00000004:00000024:3.0:1782222340.077431:0:17214:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1782222340.077444:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222340.077457:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3655:x1868795081859456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 42us (204us total) trans 0 rc 0/0 00000100:00080000:0.0:1782222340.077461:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f085294e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1782222340.077463:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1782222340.077470:0:3652:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1782222340.077474:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081849728:0@lo:8:kworker.0 00000100:00080000:0.0:1782222340.077479:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f07472a5800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1782222340.077481:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1782222340.077483:0:3652:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1782222340.077486:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081858432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222340.077486:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081849856:0@lo:8:kworker.0 00000100:00100000:3.0:1782222340.077515:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081858432:12345-0@lo:400:kworker.0 Request processed in 29us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222340.077515:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081858560 00000100:00100000:0.0:1782222340.077518:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081858560 00000100:00100000:3.0:1782222340.077521:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782222340.077537:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081858304 00000100:00100000:3.0:1782222340.077541:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081858304 00000100:00100000:3.0:1782222340.077564:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1782222340.077570:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+21:3655:x1868795081858304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222340.077599:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+21:3655:x1868795081858304:12345-0@lo:400:kworker.0 Request processed in 29us (2986us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222340.077606:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1782222340.077610:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081859200 00000100:00100000:0.0:1782222340.077613:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081859200 00000100:00100000:0.0:1782222340.077630:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081859072 00000100:00100000:3.0:1782222340.077631:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081858816 00000100:00100000:3.0:1782222340.077633:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081858816 00000100:00100000:0.0:1782222340.077633:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081859072 00000100:00100000:0.0:1782222340.077644:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782222340.077649:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081858944 00000100:00100000:3.0:1782222340.077651:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081858944 00000100:00100000:3.0:1782222340.077661:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782222340.077667:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081858816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222340.077694:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081858816:12345-0@lo:400:kworker.0 Request processed in 27us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222340.077700:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782222340.077711:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782222340.077715:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3652:x1868795081858944:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1782222340.077725:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081858560:12345-0@lo:400:kworker.0 00010000:00020000:3.0:1782222340.077741:0:18716:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1782222340.077765:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081858560:12345-0@lo:400:kworker.0 Request processed in 41us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222340.077767:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3652:x1868795081858944:12345-0@lo:8:kworker.0 Request processed in 51us (323us total) trans 0 rc -19/-19 00000100:00100000:3.0:1782222340.077772:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782222340.077772:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782222340.077786:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782222340.077791:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1868795081859200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222340.077792:0:17209:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1782222340.077798:0:17209:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:3.0:1782222340.077812:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782222340.077816:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782222340.077817:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1868795081859200:12345-0@lo:400:kworker.0 Request processed in 25us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222340.077822:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782222340.077833:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782222340.077834:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222340.077839:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1868795081859072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222340.077854:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1868795081859328:0@lo:400:kworker.0 00000100:00100000:0.0:1782222340.077861:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1868795081859072:12345-0@lo:400:kworker.0 Request processed in 23us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222340.077867:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782222340.077873:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222340.077877:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081859328 00000100:00100000:0.0:1782222340.077880:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081859328 00000100:00100000:0.0:1782222340.077902:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782222340.077906:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1868795081859328:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1782222340.077908:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f08450bd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782222340.077911:0:3652:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1782222340.077914:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1868795081858944:0@lo:8:kworker.0 00000100:00100000:0.0:1782222340.077936:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1868795081859328:12345-0@lo:400:kworker.0 Request processed in 29us (62us total) trans 0 rc 0/0 00010000:00080000:3.0:1782222340.077937:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f07474bf100 x1868795081858560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222340.077943:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782222340.077948:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081858560:0@lo:400:kworker.0 00010000:00080000:3.0:1782222340.077957:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f07474bf480 x1868795081859200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222340.077965:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1868795081859200:0@lo:400:kworker.0 00010000:00080000:3.0:1782222340.077975:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f07474bdc00 x1868795081858176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222356 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222340.077986:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081858176:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782222340.077998:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081858048:0@lo:41:osp-pre-0-1.0 00010000:00080000:3.0:1782222340.078022:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f07474bce00 x1868795081859328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222340.078029:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1868795081859328:0@lo:400:kworker.0 00000100:00100000:3.0:1782222340.078046:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081858432:0@lo:400:kworker.0 00010000:00080000:3.0:1782222340.078069:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f07474bca80 x1868795081859072/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222340.078077:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1868795081859072:0@lo:400:kworker.0 00000100:00100000:3.0:1782222340.078089:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081859456:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782222340.078096:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0873f67-836f-4221-9522-aadc54ad715e:3655:1868795081858304:0@lo:400:kworker.0 00010000:00080000:3.0:1782222340.078105:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f07474bdf80 x1868795081858816/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782222356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222340.078112:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081858816:0@lo:400:kworker.0 00000100:00100000:0.0:1782222340.078199:0:18230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081858688 00000100:00100000:0.0:1782222340.078204:0:18230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081858688 00000100:00100000:0.0:1782222340.078228:0:18230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1782222340.078252:0:18230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081858688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222340.078290:0:18230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081858688:12345-0@lo:400:kworker.0 Request processed in 56us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222340.078300:0:18230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1782222340.078315:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782222340.078331:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081858688:0@lo:400:kworker.0 00000100:00080000:0.0:1782222340.078612:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782222340.078617:0:491:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1782222340.078619:0:491:0:(import.c:65:import_set_state_nolock()) ffff8f085294e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782222340.078624:0:491:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 519 00000100:00080000:0.0:1782222340.078628:0:491:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1782222340.078633:0:491:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f085294e000 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:0.0:1782222340.083140:0:491:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0747781500 x1868795081859584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782222340.083173:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782222340.083177:0:491:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1782222340.083180:0:491:0:(import.c:65:import_set_state_nolock()) ffff8f07472a5800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782222340.083185:0:491:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 519 00000100:00080000:0.0:1782222340.083190:0:491:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1782222340.083197:0:491:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f07472a5800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:0.0:1782222340.083215:0:491:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0747781180 x1868795081859712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782222340.083327:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081859584:0@lo:8:kworker.0 00000100:00100000:2.0:1782222340.083399:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222340.083442:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081859712:0@lo:8:kworker.0 00000100:00100000:2.0:1782222340.083464:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222340.083498:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081859584 00000100:00100000:2.0:1782222340.083507:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081859584 00000100:00100000:2.0:1782222340.083536:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081859712 00000100:00100000:2.0:1782222340.083538:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081859712 00000100:00100000:2.0:1782222340.083551:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782222340.083558:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3652:x1868795081859584:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1782222340.083586:0:18716:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 539 last 0 00000020:00000080:2.0:1782222340.083612:0:18716:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe2b7cc26e681261a 00002000:00100000:2.0:1782222340.083627:0:18716:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8f07464a2000 ocd_connect_flags: 0xe044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1782222340.083631:0:18716:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1782222340.083634:0:18716:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1782222340.083709:0:18716:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1782222340.083742:0:18716:0:(import.c:65:import_set_state_nolock()) ffff8f07464a1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782222340.083788:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3652:x1868795081859584:12345-0@lo:8:kworker.0 Request processed in 230us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222340.083796:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782222340.083812:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782222340.083816:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3652:x1868795081859712:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1782222340.083827:0:18716:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1782222340.083852:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3652:x1868795081859712:12345-0@lo:8:kworker.0 Request processed in 35us (387us total) trans 0 rc -19/-19 00000100:00100000:2.0:1782222340.083866:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1782222340.083907:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0747781500 x1868795081859584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782222365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222340.083916:0:3652:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782222340.083924:0:3652:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1782222340.083931:0:3652:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xe040401443000026 00000100:00080000:2.0:1782222340.083936:0:3652:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1782222340.083938:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f085294e000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1782222340.083960:0:3652:0:(osp_dev.c:1650:osp_import_event()) got connected 00000100:00100000:2.0:1782222340.083965:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081859584:0@lo:8:kworker.0 00000100:00080000:2.0:1782222340.083976:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f07472a5800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782222340.083981:0:3652:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1782222340.083984:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081859712:0@lo:8:kworker.0 00000004:00080000:2.0:1782222340.084037:0:17233:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:2.0:1782222340.084055:0:17233:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b14a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17233:1868795081859968:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1782222340.084081:0:17233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222340.084095:0:17233:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08429b06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782222340.084107:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081859840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782222340.084130:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222340.084167:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081859840 00000100:00100000:2.0:1782222340.084171:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081859840 00000100:00100000:2.0:1782222340.084205:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782222340.084212:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3656:x1868795081859840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782222340.084227:0:18717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1782222340.084282:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3656:x1868795081859840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222340.084294:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1782222340.084310:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782222340.084332:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0849b16a00 x1868795081859840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222356 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222340.084347:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081859840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782222340.084363:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081859968 00000100:00100000:2.0:1782222340.084367:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081859968 00000100:00100000:2.0:1782222340.084387:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782222340.084394:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17233:x1868795081859968:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1782222340.085936:0:18716:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1782222340.085945:0:18716:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1782222340.085950:0:18716:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000004:00080000:0.0:1782222340.087845:0:17232:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1782222340.087943:0:17232:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 539116707608ns, next at 0ns, rc = 0 00080000:00080000:0.0:1782222340.087952:0:17232:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1782222340.090201:0:17188:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1782222340.114743:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782222340.114754:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001741ebcd/0xe2b7cc26e6812621 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.114771:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1782222340.114776:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782222340.114783:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001741ebcd/0xe2b7cc26e6812621 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.114800:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001741ebcd/0xe2b7cc26e6812621 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.114810:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001741ebcd/0xe2b7cc26e6812621 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.114826:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001741ebcd/0xe2b7cc26e6812621 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.114846:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782222340.114858:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782222340.114864:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001741ebcd/0xe2b7cc26e6812621 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.114872:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746430800 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:3.0:1782222340.114876:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001741ebcd/0xe2b7cc26e6812621 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.114898:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001741ebcd/0xe2b7cc26e6812621 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.114915:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001741ebcd/0xe2b7cc26e6812621 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.114923:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001741ebcd/0xe2b7cc26e6812621 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.114944:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222340.114947:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222340.114950:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782222340.115617:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782222340.115631:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e2073a3/0xe2b7cc26e6812628 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.115641:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1782222340.115644:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782222340.115648:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e2073a3/0xe2b7cc26e6812628 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.115658:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e2073a3/0xe2b7cc26e6812628 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.115666:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e2073a3/0xe2b7cc26e6812628 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.115673:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e2073a3/0xe2b7cc26e6812628 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.115691:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782222340.115700:0:17196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782222340.115705:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e2073a3/0xe2b7cc26e6812628 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.115713:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746431600 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:3.0:1782222340.115716:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e2073a3/0xe2b7cc26e6812628 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.115724:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e2073a3/0xe2b7cc26e6812628 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.115756:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e2073a3/0xe2b7cc26e6812628 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.115764:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e2073a3/0xe2b7cc26e6812628 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.115779:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222340.115780:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222340.115782:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782222340.116692:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782222340.116702:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021dcff7d/0xe2b7cc26e681262f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.116713:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1782222340.116716:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782222340.116721:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021dcff7d/0xe2b7cc26e681262f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.116745:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021dcff7d/0xe2b7cc26e681262f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.116755:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021dcff7d/0xe2b7cc26e681262f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.116763:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021dcff7d/0xe2b7cc26e681262f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.116791:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782222340.116802:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782222340.116807:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021dcff7d/0xe2b7cc26e681262f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.116814:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746430a00 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:3.0:1782222340.116818:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021dcff7d/0xe2b7cc26e681262f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.116826:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021dcff7d/0xe2b7cc26e681262f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.116839:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021dcff7d/0xe2b7cc26e681262f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.116847:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021dcff7d/0xe2b7cc26e681262f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.116862:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222340.116864:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222340.116866:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782222340.117394:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782222340.117401:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095dfe7ce/0xe2b7cc26e6812636 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.117411:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1782222340.117419:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782222340.117423:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095dfe7ce/0xe2b7cc26e6812636 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.117433:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095dfe7ce/0xe2b7cc26e6812636 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.117442:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095dfe7ce/0xe2b7cc26e6812636 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.117448:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095dfe7ce/0xe2b7cc26e6812636 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.117462:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782222340.117471:0:17196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782222340.117475:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095dfe7ce/0xe2b7cc26e6812636 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.117482:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746431000 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:3.0:1782222340.117486:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095dfe7ce/0xe2b7cc26e6812636 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.117494:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095dfe7ce/0xe2b7cc26e6812636 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.117505:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095dfe7ce/0xe2b7cc26e6812636 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.117521:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095dfe7ce/0xe2b7cc26e6812636 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.117697:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222340.117700:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222340.117702:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782222340.118019:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782222340.118025:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b946c4f2/0xe2b7cc26e681263d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.118034:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1782222340.118168:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782222340.118173:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b946c4f2/0xe2b7cc26e681263d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.118184:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b946c4f2/0xe2b7cc26e681263d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.118192:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b946c4f2/0xe2b7cc26e681263d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.118199:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b946c4f2/0xe2b7cc26e681263d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.118222:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782222340.118508:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782222340.118514:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b946c4f2/0xe2b7cc26e681263d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.118523:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746430000 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:2.0:1782222340.118527:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b946c4f2/0xe2b7cc26e681263d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.118609:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b946c4f2/0xe2b7cc26e681263d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.118628:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b946c4f2/0xe2b7cc26e681263d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.118648:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b946c4f2/0xe2b7cc26e681263d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.118666:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222340.118668:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222340.118670:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782222340.118758:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782222340.118769:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b37133f/0xe2b7cc26e6812644 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.118778:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1782222340.118781:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782222340.118785:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b37133f/0xe2b7cc26e6812644 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.118794:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b37133f/0xe2b7cc26e6812644 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.118802:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b37133f/0xe2b7cc26e6812644 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.118808:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b37133f/0xe2b7cc26e6812644 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.118860:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1782222340.119353:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782222340.119359:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4a9d095/0xe2b7cc26e681264b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.119368:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1782222340.119371:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782222340.119374:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4a9d095/0xe2b7cc26e681264b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.119384:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4a9d095/0xe2b7cc26e681264b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.119398:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4a9d095/0xe2b7cc26e681264b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.119406:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4a9d095/0xe2b7cc26e681264b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.119450:0:17196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782222340.119456:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b37133f/0xe2b7cc26e6812644 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.119463:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0746431a00 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:2.0:1782222340.119466:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b37133f/0xe2b7cc26e6812644 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.119474:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b37133f/0xe2b7cc26e6812644 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.119486:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b37133f/0xe2b7cc26e6812644 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.119493:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b37133f/0xe2b7cc26e6812644 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.119619:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782222340.119628:0:17196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782222340.119632:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4a9d095/0xe2b7cc26e681264b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.119640:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08413d3c00 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:3.0:1782222340.119643:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4a9d095/0xe2b7cc26e681264b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.119652:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4a9d095/0xe2b7cc26e681264b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.119663:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4a9d095/0xe2b7cc26e681264b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.119671:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4a9d095/0xe2b7cc26e681264b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.119685:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222340.119692:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222340.119694:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222340.119969:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782222340.120320:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782222340.120327:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000014082bb/0xe2b7cc26e6812652 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.120336:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1782222340.120339:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782222340.120344:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000014082bb/0xe2b7cc26e6812652 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.120354:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000014082bb/0xe2b7cc26e6812652 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.120362:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000014082bb/0xe2b7cc26e6812652 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.120370:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000014082bb/0xe2b7cc26e6812652 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.120419:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1782222340.121103:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782222340.121111:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006682cc42/0xe2b7cc26e6812659 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.121120:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1782222340.121124:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782222340.121128:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006682cc42/0xe2b7cc26e6812659 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.121148:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006682cc42/0xe2b7cc26e6812659 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.121157:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006682cc42/0xe2b7cc26e6812659 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.121165:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006682cc42/0xe2b7cc26e6812659 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.121303:0:17196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782222340.121310:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000014082bb/0xe2b7cc26e6812652 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.121326:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08413d3400 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:2.0:1782222340.121330:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000014082bb/0xe2b7cc26e6812652 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.121338:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000014082bb/0xe2b7cc26e6812652 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.121351:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000014082bb/0xe2b7cc26e6812652 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.121358:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000014082bb/0xe2b7cc26e6812652 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.121376:0:17196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782222340.121379:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006682cc42/0xe2b7cc26e6812659 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.121384:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08413d3e00 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:2.0:1782222340.121387:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006682cc42/0xe2b7cc26e6812659 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.121393:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006682cc42/0xe2b7cc26e6812659 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.121401:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006682cc42/0xe2b7cc26e6812659 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.121414:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222340.121415:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222340.121417:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222340.122918:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1782222340.122931:0:18716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006682cc42/0xe2b7cc26e6812659 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.123379:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782222340.123823:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782222340.123832:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6515f7c/0xe2b7cc26e6812660 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.123846:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1782222340.123850:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782222340.123855:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6515f7c/0xe2b7cc26e6812660 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.123866:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6515f7c/0xe2b7cc26e6812660 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.123876:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6515f7c/0xe2b7cc26e6812660 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.123896:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6515f7c/0xe2b7cc26e6812660 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.123918:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782222340.124058:0:17196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782222340.124064:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6515f7c/0xe2b7cc26e6812660 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.124072:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83000 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:3.0:1782222340.124077:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6515f7c/0xe2b7cc26e6812660 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.124094:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6515f7c/0xe2b7cc26e6812660 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.124111:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6515f7c/0xe2b7cc26e6812660 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.124124:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6515f7c/0xe2b7cc26e6812660 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.124140:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222340.124142:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222340.124143:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782222340.124802:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782222340.124809:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcfed754/0xe2b7cc26e6812667 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.124830:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1782222340.124834:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782222340.124838:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcfed754/0xe2b7cc26e6812667 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.124848:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcfed754/0xe2b7cc26e6812667 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.124857:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcfed754/0xe2b7cc26e6812667 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.124865:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcfed754/0xe2b7cc26e6812667 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.124892:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782222340.125226:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782222340.125253:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcfed754/0xe2b7cc26e6812667 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.125262:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83e00 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:3.0:1782222340.125267:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcfed754/0xe2b7cc26e6812667 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.125274:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcfed754/0xe2b7cc26e6812667 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.125287:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcfed754/0xe2b7cc26e6812667 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.125295:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcfed754/0xe2b7cc26e6812667 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.125310:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222340.125312:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222340.125313:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782222340.125485:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782222340.125491:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055a306da/0xe2b7cc26e681266e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.125498:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1782222340.125501:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782222340.125505:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055a306da/0xe2b7cc26e681266e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.125514:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055a306da/0xe2b7cc26e681266e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.125530:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055a306da/0xe2b7cc26e681266e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.125602:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055a306da/0xe2b7cc26e681266e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.125620:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782222340.125747:0:17196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782222340.125752:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055a306da/0xe2b7cc26e681266e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.125761:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83800 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:3.0:1782222340.125764:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055a306da/0xe2b7cc26e681266e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.125772:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055a306da/0xe2b7cc26e681266e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.125784:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055a306da/0xe2b7cc26e681266e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.125791:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055a306da/0xe2b7cc26e681266e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.125804:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222340.125806:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222340.125808:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782222340.126107:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782222340.126113:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4f5f40c/0xe2b7cc26e6812675 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.126121:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1782222340.126124:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782222340.126128:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4f5f40c/0xe2b7cc26e6812675 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.126136:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4f5f40c/0xe2b7cc26e6812675 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.126143:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4f5f40c/0xe2b7cc26e6812675 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.126149:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4f5f40c/0xe2b7cc26e6812675 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.126180:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782222340.126509:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782222340.126515:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4f5f40c/0xe2b7cc26e6812675 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.126522:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83200 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:3.0:1782222340.126525:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4f5f40c/0xe2b7cc26e6812675 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.126554:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4f5f40c/0xe2b7cc26e6812675 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.126568:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4f5f40c/0xe2b7cc26e6812675 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.126575:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4f5f40c/0xe2b7cc26e6812675 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.126593:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222340.126596:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222340.126598:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782222340.126842:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782222340.126848:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001679169b/0xe2b7cc26e681267c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.126857:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1782222340.126860:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782222340.126864:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001679169b/0xe2b7cc26e681267c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.126872:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001679169b/0xe2b7cc26e681267c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.126893:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001679169b/0xe2b7cc26e681267c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.126907:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001679169b/0xe2b7cc26e681267c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.126926:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782222340.127306:0:17196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782222340.127311:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001679169b/0xe2b7cc26e681267c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.127319:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08413d2600 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:2.0:1782222340.127322:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001679169b/0xe2b7cc26e681267c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.127330:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001679169b/0xe2b7cc26e681267c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.127341:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001679169b/0xe2b7cc26e681267c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.127349:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001679169b/0xe2b7cc26e681267c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.127366:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222340.127368:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222340.127370:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782222340.127473:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782222340.127480:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a75257f/0xe2b7cc26e6812683 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.127488:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1782222340.127491:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782222340.127495:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a75257f/0xe2b7cc26e6812683 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.127505:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a75257f/0xe2b7cc26e6812683 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.127512:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a75257f/0xe2b7cc26e6812683 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.127519:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a75257f/0xe2b7cc26e6812683 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.127600:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782222340.127939:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782222340.127944:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a75257f/0xe2b7cc26e6812683 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.127952:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08413d2800 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:2.0:1782222340.127963:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a75257f/0xe2b7cc26e6812683 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.127970:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a75257f/0xe2b7cc26e6812683 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.127982:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a75257f/0xe2b7cc26e6812683 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.127989:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a75257f/0xe2b7cc26e6812683 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.128003:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222340.128005:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222340.128007:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782222340.128223:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782222340.128229:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a3ed614/0xe2b7cc26e681268a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.128300:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1782222340.128303:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782222340.128307:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a3ed614/0xe2b7cc26e681268a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.128317:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a3ed614/0xe2b7cc26e681268a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.128324:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a3ed614/0xe2b7cc26e681268a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.128332:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a3ed614/0xe2b7cc26e681268a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.128344:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782222340.128454:0:17196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782222340.128459:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a3ed614/0xe2b7cc26e681268a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.128466:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08413d2c00 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:2.0:1782222340.128469:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a3ed614/0xe2b7cc26e681268a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.128477:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a3ed614/0xe2b7cc26e681268a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.128487:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a3ed614/0xe2b7cc26e681268a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.128500:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a3ed614/0xe2b7cc26e681268a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.128516:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222340.128518:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222340.128519:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782222340.129350:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782222340.129359:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084970dd5/0xe2b7cc26e6812691 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.129368:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1782222340.129371:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782222340.129376:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084970dd5/0xe2b7cc26e6812691 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.129386:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084970dd5/0xe2b7cc26e6812691 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.129404:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084970dd5/0xe2b7cc26e6812691 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.129411:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084970dd5/0xe2b7cc26e6812691 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.129455:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1782222340.130977:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782222340.130988:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa6e1968/0xe2b7cc26e6812698 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.131001:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1782222340.131005:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782222340.131010:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa6e1968/0xe2b7cc26e6812698 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.131022:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa6e1968/0xe2b7cc26e6812698 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.131032:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa6e1968/0xe2b7cc26e6812698 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.131052:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa6e1968/0xe2b7cc26e6812698 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.131511:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782222340.131519:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084970dd5/0xe2b7cc26e6812691 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.131528:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08483ec200 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:2.0:1782222340.131532:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084970dd5/0xe2b7cc26e6812691 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.132312:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084970dd5/0xe2b7cc26e6812691 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.132330:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084970dd5/0xe2b7cc26e6812691 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.132338:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084970dd5/0xe2b7cc26e6812691 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.132460:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782222340.132474:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782222340.132478:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa6e1968/0xe2b7cc26e6812698 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.132486:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08483eca00 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:3.0:1782222340.132490:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa6e1968/0xe2b7cc26e6812698 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.132498:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa6e1968/0xe2b7cc26e6812698 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.132509:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa6e1968/0xe2b7cc26e6812698 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.132516:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa6e1968/0xe2b7cc26e6812698 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.132531:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222340.132532:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222340.132695:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222340.135071:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782222340.135697:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782222340.135707:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008114ad6c/0xe2b7cc26e681269f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.135722:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1782222340.135744:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782222340.135751:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008114ad6c/0xe2b7cc26e681269f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.135766:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008114ad6c/0xe2b7cc26e681269f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.135778:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008114ad6c/0xe2b7cc26e681269f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.135786:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008114ad6c/0xe2b7cc26e681269f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.135811:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782222340.135989:0:17196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782222340.135997:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008114ad6c/0xe2b7cc26e681269f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.136014:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08483ed800 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:2.0:1782222340.136019:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008114ad6c/0xe2b7cc26e681269f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.136028:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008114ad6c/0xe2b7cc26e681269f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.136046:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008114ad6c/0xe2b7cc26e681269f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.136054:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008114ad6c/0xe2b7cc26e681269f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.136073:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222340.136075:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222340.136077:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782222340.137413:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782222340.137425:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ba83b84/0xe2b7cc26e68126a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.137438:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1782222340.137443:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782222340.137449:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ba83b84/0xe2b7cc26e68126a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.137461:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ba83b84/0xe2b7cc26e68126a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.137471:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ba83b84/0xe2b7cc26e68126a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.137486:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ba83b84/0xe2b7cc26e68126a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.137502:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782222340.137512:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782222340.137517:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ba83b84/0xe2b7cc26e68126a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.137524:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08483ecc00 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:3.0:1782222340.137528:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ba83b84/0xe2b7cc26e68126a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.137668:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ba83b84/0xe2b7cc26e68126a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.137685:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ba83b84/0xe2b7cc26e68126a6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.137692:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ba83b84/0xe2b7cc26e68126a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.137709:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222340.137712:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222340.137714:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782222340.138499:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782222340.138514:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba00db47/0xe2b7cc26e68126ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.138526:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1782222340.138530:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782222340.138867:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba00db47/0xe2b7cc26e68126ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.138890:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba00db47/0xe2b7cc26e68126ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.138900:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba00db47/0xe2b7cc26e68126ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.138907:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba00db47/0xe2b7cc26e68126ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.138929:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782222340.139600:0:17196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782222340.139609:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba00db47/0xe2b7cc26e68126ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.139707:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08483ede00 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:0.0:1782222340.139712:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba00db47/0xe2b7cc26e68126ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.139721:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba00db47/0xe2b7cc26e68126ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.140778:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba00db47/0xe2b7cc26e68126ad lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.140792:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba00db47/0xe2b7cc26e68126ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.140815:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222340.140818:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222340.140820:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782222340.143635:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782222340.143649:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa6e1968/0xe2b7cc26e68126b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.143666:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1782222340.143669:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782222340.143675:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa6e1968/0xe2b7cc26e68126b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.143688:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa6e1968/0xe2b7cc26e68126b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.143706:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa6e1968/0xe2b7cc26e68126b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.143715:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa6e1968/0xe2b7cc26e68126b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.143747:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782222340.143812:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782222340.143818:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa6e1968/0xe2b7cc26e68126b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.143827:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08483eca00 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:0.0:1782222340.143831:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa6e1968/0xe2b7cc26e68126b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.143839:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa6e1968/0xe2b7cc26e68126b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.143861:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa6e1968/0xe2b7cc26e68126b4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.143868:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa6e1968/0xe2b7cc26e68126b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.143883:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222340.143885:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222340.143887:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782222340.146271:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782222340.146285:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023652900/0xe2b7cc26e68126bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.146301:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1782222340.146306:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782222340.146311:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023652900/0xe2b7cc26e68126bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.146324:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023652900/0xe2b7cc26e68126bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.146334:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023652900/0xe2b7cc26e68126bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.146342:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023652900/0xe2b7cc26e68126bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.146372:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782222340.146390:0:17196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782222340.146406:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023652900/0xe2b7cc26e68126bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.146414:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08483ed400 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:0.0:1782222340.146418:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023652900/0xe2b7cc26e68126bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.146427:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023652900/0xe2b7cc26e68126bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.146442:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023652900/0xe2b7cc26e68126bb lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.146449:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023652900/0xe2b7cc26e68126bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.146477:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222340.146479:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222340.146481:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782222340.147254:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782222340.147264:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000342883c2/0xe2b7cc26e68126c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.147276:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1782222340.147280:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782222340.147284:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000342883c2/0xe2b7cc26e68126c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.147295:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000342883c2/0xe2b7cc26e68126c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.147305:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000342883c2/0xe2b7cc26e68126c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.147313:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000342883c2/0xe2b7cc26e68126c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.147331:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782222340.147772:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782222340.147778:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000342883c2/0xe2b7cc26e68126c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.147786:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08483eda00 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:0.0:1782222340.147791:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000342883c2/0xe2b7cc26e68126c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.147799:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000342883c2/0xe2b7cc26e68126c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.147814:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000342883c2/0xe2b7cc26e68126c2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782222340.147815:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782222340.147821:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fcfd83b/0xe2b7cc26e68126c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.147822:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000342883c2/0xe2b7cc26e68126c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.147830:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1782222340.147839:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782222340.147840:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222340.147842:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222340.147843:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fcfd83b/0xe2b7cc26e68126c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.147844:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222340.147853:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fcfd83b/0xe2b7cc26e68126c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.147860:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fcfd83b/0xe2b7cc26e68126c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.147868:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fcfd83b/0xe2b7cc26e68126c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.147944:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782222340.147993:0:17196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782222340.147999:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fcfd83b/0xe2b7cc26e68126c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.148016:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08483ec600 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:0.0:1782222340.148020:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fcfd83b/0xe2b7cc26e68126c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.148028:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fcfd83b/0xe2b7cc26e68126c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.148041:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fcfd83b/0xe2b7cc26e68126c9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.148049:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fcfd83b/0xe2b7cc26e68126c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.148064:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222340.148066:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222340.148068:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782222340.148749:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782222340.148757:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f515445/0xe2b7cc26e68126d0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.148766:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1782222340.148769:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782222340.148774:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f515445/0xe2b7cc26e68126d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.148785:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f515445/0xe2b7cc26e68126d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.148793:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f515445/0xe2b7cc26e68126d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.148808:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f515445/0xe2b7cc26e68126d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.148830:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1782222340.149284:0:18716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782222340.149291:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016b7db3e/0xe2b7cc26e68126d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.149300:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1782222340.149303:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782222340.149307:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016b7db3e/0xe2b7cc26e68126d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.149317:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016b7db3e/0xe2b7cc26e68126d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.149326:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016b7db3e/0xe2b7cc26e68126d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.149334:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016b7db3e/0xe2b7cc26e68126d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222340.149347:0:18716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:3.0:1782222340.149379:0:18716:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:3.0:1782222340.149465:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17233:x1868795081859968:12345-0@lo:5:osp-pre-0-0.0 Request processed in 65068us (65379us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222340.149481:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782222340.149621:0:17233:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b14a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17233:1868795081859968:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1782222340.149637:0:17233:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:3.0:1782222340.149679:0:17233:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17233:1868795081860096:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1782222340.149713:0:17233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222340.149751:0:17233:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746415300 going to sleep for 11 seconds 00000100:00100000:3.0:1782222340.149770:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081860096 00000100:00100000:3.0:1782222340.149776:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081860096 00000100:00100000:3.0:1782222340.149820:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782222340.149828:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17233:x1868795081860096:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1782222340.149868:0:18715:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:0.0:1782222340.152978:0:17196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782222340.152990:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f515445/0xe2b7cc26e68126d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.153004:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08483ec800 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:0.0:1782222340.153008:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f515445/0xe2b7cc26e68126d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.153021:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f515445/0xe2b7cc26e68126d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.153049:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f515445/0xe2b7cc26e68126d0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.153057:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f515445/0xe2b7cc26e68126d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.153078:0:17196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782222340.153082:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016b7db3e/0xe2b7cc26e68126d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.153089:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08483ed600 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:0.0:1782222340.153092:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016b7db3e/0xe2b7cc26e68126d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.153099:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016b7db3e/0xe2b7cc26e68126d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.153107:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016b7db3e/0xe2b7cc26e68126d7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.153120:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016b7db3e/0xe2b7cc26e68126d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.153131:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222340.153133:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222340.153139:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222340.153145:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782222340.170740:0:18710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1782222340.170783:0:18710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1782222340.175533:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17233:x1868795081860096:12345-0@lo:5:osp-pre-0-0.0 Request processed in 25698us (25812us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1782222340.175547:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782222340.176686:0:17233:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1782222340.176699:0:17233:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17233:1868795081860096:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1782222340.176716:0:17233:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000020:01000004:0.0:1782222340.867404:0:19526:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1782222340.867408:0:19526:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1782222340.867409:0:19526:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1782222340.867555:0:19526:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8f0746531000 00000020:01000004:0.0:1782222340.867571:0:19526:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1782222340.867585:0:19526:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1782222340.867599:0:19526:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8f07460f19c0) 00000020:00000080:0.0:1782222340.867615:0:19526:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00010000:00010000:0.0:1782222340.906518:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1782222340.929788:0:19526:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1782222340.932823:0:19526:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1782222340.933134:0:19526:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1782222340.933386:0:19526:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1782222340.933991:0:19526:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1782222340.934305:0:19526:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1782222340.934514:0:19526:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:3.0:1782222340.936524:0:19526:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1782222340.936756:0:19526:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1782222340.936770:0:19526:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1782222340.936782:0:19526:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe2b7cc26e68126e5 00000020:01000004:3.0:1782222340.936789:0:19526:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1782222340.936810:0:19526:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.127@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1782222340.936814:0:19526:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1782222340.936820:0:19526:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1782222340.936854:0:19526:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1782222340.936858:0:19526:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.127@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1782222340.953429:0:19526:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.127@tcp ctxt 0 is initialized 00000020:01000004:0.0:1782222340.953470:0:19526:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.127@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1782222340.953476:0:19526:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1782222340.953478:0:19526:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782222340.953479:0:19526:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782222340.953480:0:19526:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782222340.953481:0:19526:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782222340.953482:0:19526:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782222340.953484:0:19526:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782222340.953485:0:19526:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782222340.953486:0:19526:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782222340.953491:0:19526:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1782222340.953493:0:19526:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782222340.953495:0:19526:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782222340.953496:0:19526:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782222340.953497:0:19526:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782222340.953498:0:19526:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782222340.953499:0:19526:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782222340.953500:0:19526:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782222340.953501:0:19526:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782222340.953502:0:19526:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782222340.953529:0:19526:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1782222340.953556:0:19526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747780a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:19526:1868795081860224:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1782222340.953626:0:19526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222340.953713:0:19526:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0845260cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782222340.953794:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081860224 00000100:00100000:3.0:1782222340.953802:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081860224 00000100:00100000:3.0:1782222340.953948:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1782222340.953963:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+21:19526:x1868795081860224:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1782222340.953994:0:17202:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1782222340.953997:0:17202:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1782222340.954000:0:17202:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1782222340.954624:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+21:19526:x1868795081860224:12345-0@lo:253:mount.lustre.0 Request processed in 662us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222340.954633:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1782222340.955028:0:19526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747780a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:19526:1868795081860224:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1782222340.955041:0:19526:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1782222340.955043:0:19526:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782222340.955045:0:19526:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782222340.955046:0:19526:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782222340.955047:0:19526:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782222340.955048:0:19526:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782222340.955050:0:19526:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782222340.955051:0:19526:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782222340.955053:0:19526:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782222340.955055:0:19526:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1782222340.955076:0:19526:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f0746531000 from lustre-OST0001 10000000:01000000:3.0:1782222340.955105:0:19526:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1782222340.955108:0:19526:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1782222340.955116:0:19526:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f087fb94d40 local copy 00010000:00010000:3.0:1782222340.955129:0:19526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fcb9400/0xe2b7cc26e681233b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812342 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222340.955437:0:19526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:19526:1868795081860352:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782222340.955472:0:19526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222340.955539:0:19526:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746415c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782222340.955586:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081860352 00000100:00100000:0.0:1782222340.955592:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081860352 00000100:00100000:0.0:1782222340.955710:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1782222340.955719:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+21:19526:x1868795081860352:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782222340.955845:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+21:19526:x1868795081860352:12345-0@lo:501:mount.lustre.0 Request processed in 126us (370us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782222340.955853:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1782222340.957478:0:19526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:19526:1868795081860352:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1782222340.957503:0:19526:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1782222340.957549:0:19526:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1782222340.957558:0:19526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fcb9400/0xe2b7cc26e681233b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812342 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222340.957568:0:19526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f087fcb9400/0xe2b7cc26e681233b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812342 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782222340.957600:0:19526:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f0746531000 10000000:01000000:1.0:1782222340.957605:0:19526:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1782222340.957610:0:19526:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1782222340.957614:0:19526:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782222340.957631:0:19526:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1782222340.957633:0:19526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1782222340.957664:0:19526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f074744c000/0xe2b7cc26e68126ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222340.957672:0:19526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f074744c000/0xe2b7cc26e68126ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222340.957681:0:19526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f074744c000/0xe2b7cc26e68126ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222340.957702:0:19526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:19526:1868795081860480:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782222340.957762:0:19526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222340.957865:0:19526:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0850939180 going to sleep for 11 seconds 00000100:00100000:0.0:1782222340.958173:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081860480 00000100:00100000:0.0:1782222340.958179:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081860480 00000100:00100000:0.0:1782222340.958257:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1782222340.958266:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+21:19526:x1868795081860480:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782222340.958279:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222340.958291:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f087fcb8600/0xe2b7cc26e68126f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e68126ec expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.958314:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fcb8600/0xe2b7cc26e68126f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e68126ec expref: 22 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.958326:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f087fcb8600/0xe2b7cc26e68126f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68126ec expref: 22 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.958333:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fcb8600, rc 0) 00000100:00100000:0.0:1782222340.958391:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+22:19526:x1868795081860480:12345-0@lo:101:mount.lustre.0 Request processed in 125us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222340.958397:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1782222340.958482:0:19526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:19526:1868795081860480:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782222340.958495:0:19526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f074744c000/0xe2b7cc26e68126ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68126f3 expref: -99 pid: 19526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222340.958515:0:19526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f074744c000/0xe2b7cc26e68126ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e68126f3 expref: -99 pid: 19526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782222340.959733:0:19526:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1782222340.961303:0:19526:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782222340.967087:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1782222340.967151:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1782222340.967168:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1782222340.967181:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1782222340.967404:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1782222340.967426:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1782222340.967452:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1782222340.967457:0:19526:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1782222340.967565:0:19526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b16a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:19526:1868795081860608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782222340.967629:0:19526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222340.967741:0:19526:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b72af00 going to sleep for 11 seconds 00000100:00100000:0.0:1782222340.968031:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081860608 00000100:00100000:0.0:1782222340.968038:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081860608 00000100:00100000:0.0:1782222340.968119:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1782222340.968130:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+22:19526:x1868795081860608:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782222340.968320:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+22:19526:x1868795081860608:12345-0@lo:501:mount.lustre.0 Request processed in 191us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222340.968328:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1782222340.968420:0:19526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b16a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:19526:1868795081860608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782222340.968455:0:19526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b16a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:19526:1868795081860736:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782222340.968496:0:19526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222340.968786:0:19526:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b72af00 going to sleep for 11 seconds 00000100:00100000:1.0:1782222340.968840:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081860736 00000100:00100000:1.0:1782222340.968845:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081860736 00000100:00100000:1.0:1782222340.969005:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1782222340.969014:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+22:19526:x1868795081860736:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782222340.969919:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+22:19526:x1868795081860736:12345-0@lo:503:mount.lustre.0 Request processed in 903us (1418us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222340.969929:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1782222340.972860:0:19526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b16a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:19526:1868795081860736:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1782222340.973490:0:19526:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782222340.973590:0:19526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b16a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:19526:1868795081860864:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782222340.973978:0:19526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222340.974075:0:19526:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b72af00 going to sleep for 11 seconds 00000100:00100000:3.0:1782222340.974255:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081860864 00000100:00100000:3.0:1782222340.974269:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081860864 00000100:00100000:1.0:1782222340.974499:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1782222340.974511:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+22:19526:x1868795081860864:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782222340.975017:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+22:19526:x1868795081860864:12345-0@lo:502:mount.lustre.0 Request processed in 508us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222340.975025:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1782222340.975176:0:19526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b16a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:19526:1868795081860864:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782222340.975522:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1782222340.975554:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1782222340.975566:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1782222340.975578:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1782222340.975591:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1782222340.975603:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1782222340.975616:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1782222340.975645:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1782222340.977704:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1782222340.977766:0:19526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:19526:1868795081860992:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782222340.977842:0:19526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222340.977995:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081860992 00000100:00100000:1.0:1782222340.978001:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081860992 00000100:00100000:1.0:1782222340.978056:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1782222340.978065:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+22:19526:x1868795081860992:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782222340.978165:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+22:19526:x1868795081860992:12345-0@lo:502:mount.lustre.0 Request processed in 101us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222340.978173:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1782222340.978341:0:19526:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b63ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782222340.978364:0:19526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:19526:1868795081860992:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782222340.978408:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1782222340.978417:0:19526:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1782222340.979169:0:19530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1782222340.979185:0:19530:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1782222340.979192:0:19530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782222340.979702:0:19530:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1782222340.979714:0:19530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782222340.979738:0:19530:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8f07471e8000) 00000020:00000080:2.0:1782222340.979762:0:19530:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1782222340.979770:0:19530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1782222340.979862:0:19530:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f0746531000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1782222340.979871:0:19530:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1782222340.980016:0:19530:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe2b7cc26e6812701 00010000:00010000:2.0:1782222340.985411:0:19530:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1782222340.987555:0:19530:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:2.0:1782222340.989952:0:19530:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1782222340.991737:0:19530:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1782222340.991749:0:19530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782222340.991756:0:19530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782222340.991758:0:19530:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1782222340.991761:0:19530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782222340.991765:0:19530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782222340.991767:0:19530:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1782222340.991770:0:19530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782222340.991771:0:19530:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1782222340.991773:0:19530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782222340.991776:0:19530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782222340.991776:0:19530:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1782222340.991779:0:19530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782222340.991781:0:19530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782222340.991782:0:19530:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1782222340.991786:0:19530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1782222340.991812:0:19530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782222340.991816:0:19530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782222340.991817:0:19530:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1782222340.991820:0:19530:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1782222340.999049:0:19526:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1782222340.999107:0:19526:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1782222340.999173:0:19526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f074744c000/0xe2b7cc26e68126ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68126f3 expref: -99 pid: 19526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.999186:0:19526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f074744c000/0xe2b7cc26e68126ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68126f3 expref: -99 pid: 19526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782222340.999206:0:19526:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f0746531000 from 1 10000000:01000000:0.0:1782222340.999210:0:19526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782222340.999298:0:19526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fcb8e00/0xe2b7cc26e6812708 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.999307:0:19526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f087fcb8e00/0xe2b7cc26e6812708 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222340.999318:0:19526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f087fcb8e00/0xe2b7cc26e6812708 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222340.999342:0:19526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:19526:1868795081861120:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782222340.999403:0:19526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222340.999441:0:19526:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b63ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782222341.000330:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081861120 00000100:00100000:1.0:1782222341.000341:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081861120 00000100:00100000:1.0:1782222341.000398:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1782222341.000408:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+22:19526:x1868795081861120:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782222341.000423:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222341.000437:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f074744d600/0xe2b7cc26e681270f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6812708 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222341.000460:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f074744d600/0xe2b7cc26e681270f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6812708 expref: 23 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222341.000471:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f074744d600/0xe2b7cc26e681270f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6812708 expref: 23 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222341.000479:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f074744d600, rc 0) 00000100:00100000:1.0:1782222341.000526:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+23:19526:x1868795081861120:12345-0@lo:101:mount.lustre.0 Request processed in 121us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222341.000533:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1782222341.001444:0:19526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:19526:1868795081861120:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782222341.001466:0:19526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f087fcb8e00/0xe2b7cc26e6812708 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681270f expref: -99 pid: 19526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222341.001476:0:19526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f087fcb8e00/0xe2b7cc26e6812708 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e681270f expref: -99 pid: 19526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782222341.004735:0:19526:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1782222341.005128:0:19526:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782222341.005996:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1782222341.006037:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1782222341.006061:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1782222341.006067:0:19526:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1782222341.006151:0:19526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:19526:1868795081861248:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782222341.006216:0:19526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222341.006326:0:19526:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b63e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782222341.006371:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081861248 00000100:00100000:3.0:1782222341.006379:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081861248 00000100:00100000:3.0:1782222341.006611:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1782222341.006702:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+23:19526:x1868795081861248:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782222341.006892:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+23:19526:x1868795081861248:12345-0@lo:501:mount.lustre.0 Request processed in 193us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222341.006901:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1782222341.007085:0:19526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:19526:1868795081861248:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782222341.007120:0:19526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:19526:1868795081861376:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782222341.007162:0:19526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222341.007185:0:19526:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b63e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782222341.007400:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081861376 00000100:00100000:2.0:1782222341.007405:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081861376 00000100:00100000:2.0:1782222341.007439:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1782222341.007446:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+23:19526:x1868795081861376:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782222341.007539:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+23:19526:x1868795081861376:12345-0@lo:503:mount.lustre.0 Request processed in 92us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222341.007547:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1782222341.007719:0:19526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:19526:1868795081861376:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1782222341.008221:0:19526:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782222341.008331:0:19526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:19526:1868795081861504:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782222341.008374:0:19526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222341.008397:0:19526:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b63ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782222341.009110:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081861504 00000100:00100000:3.0:1782222341.009118:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081861504 00000100:00100000:3.0:1782222341.009165:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1782222341.009175:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+23:19526:x1868795081861504:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782222341.009313:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+23:19526:x1868795081861504:12345-0@lo:502:mount.lustre.0 Request processed in 138us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222341.009320:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1782222341.009544:0:19526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:19526:1868795081861504:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782222341.010091:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1782222341.010129:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1782222341.010145:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1782222341.010159:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1782222341.010171:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1782222341.010185:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1782222341.010198:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1782222341.010211:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1782222341.010224:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1782222341.010500:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1782222341.010529:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1782222341.010565:0:19526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:19526:1868795081861632:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782222341.010695:0:19526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222341.010788:0:19526:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b63ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782222341.010826:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081861632 00000100:00100000:1.0:1782222341.010833:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081861632 00000100:00100000:1.0:1782222341.011276:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1782222341.011287:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+23:19526:x1868795081861632:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782222341.011403:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+23:19526:x1868795081861632:12345-0@lo:502:mount.lustre.0 Request processed in 117us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222341.011429:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1782222341.011530:0:19526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:19526:1868795081861632:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782222341.011583:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1782222341.011592:0:19526:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1782222341.012482:0:19534:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782222341.012493:0:19534:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782222341.012496:0:19534:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1782222341.012503:0:19534:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f0746531000 00000020:00000080:0.0:1782222341.012506:0:19534:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782222341.012515:0:19534:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782222341.012518:0:19534:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782222341.012519:0:19534:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1782222341.012522:0:19534:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782222341.012525:0:19534:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782222341.012527:0:19534:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1782222341.012531:0:19534:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f0746531000 00000020:00000080:0.0:1782222341.012533:0:19534:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782222341.012589:0:19534:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782222341.012593:0:19534:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782222341.012594:0:19534:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1782222341.012597:0:19534:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782222341.012600:0:19534:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782222341.012601:0:19534:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1782222341.012605:0:19534:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f0746531000 00000020:00000080:0.0:1782222341.012607:0:19534:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782222341.015208:0:19534:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782222341.015216:0:19534:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782222341.015218:0:19534:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1782222341.015221:0:19534:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782222341.015231:0:19534:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782222341.015247:0:19534:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1782222341.015253:0:19534:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f0746531000 00000020:00000080:0.0:1782222341.015256:0:19534:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782222341.015301:0:19534:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782222341.015304:0:19534:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782222341.015306:0:19534:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1782222341.015309:0:19534:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1782222341.019538:0:19526:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1782222341.019592:0:19526:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782222341.019713:0:19526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fcb8e00/0xe2b7cc26e6812708 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681270f expref: -99 pid: 19526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222341.019735:0:19526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f087fcb8e00/0xe2b7cc26e6812708 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681270f expref: -99 pid: 19526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782222341.019801:0:19526:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1782222341.019804:0:19526:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f0746531000 10000000:01000000:3.0:1782222341.019807:0:19526:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f0746531000 10000000:01000000:3.0:1782222341.019811:0:19526:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782222341.019817:0:19526:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8f0746531000 from 1 10000000:01000000:3.0:1782222341.019821:0:19526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782222341.019975:0:19526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f08483edc00/0xe2b7cc26e6812716 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222341.019984:0:19526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f08483edc00/0xe2b7cc26e6812716 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222341.019995:0:19526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f08483edc00/0xe2b7cc26e6812716 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222341.020018:0:19526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:19526:1868795081861760:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782222341.020080:0:19526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222341.020761:0:19526:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f07464150c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782222341.028169:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081861760 00000100:00100000:0.0:1782222341.028183:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081861760 00000100:00100000:0.0:1782222341.028250:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1782222341.028260:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+23:19526:x1868795081861760:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782222341.028277:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222341.028293:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f087fcb8800/0xe2b7cc26e681271d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6812716 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222341.028319:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fcb8800/0xe2b7cc26e681271d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6812716 expref: 24 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222341.028330:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f087fcb8800/0xe2b7cc26e681271d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6812716 expref: 24 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222341.028338:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fcb8800, rc 0) 00000100:00100000:0.0:1782222341.028419:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+24:19526:x1868795081861760:12345-0@lo:101:mount.lustre.0 Request processed in 151us (8330us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222341.028427:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1782222341.028508:0:19526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:19526:1868795081861760:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782222341.028526:0:19526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f08483edc00/0xe2b7cc26e6812716 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681271d expref: -99 pid: 19526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222341.028545:0:19526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f08483edc00/0xe2b7cc26e6812716 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e681271d expref: -99 pid: 19526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782222341.033990:0:19526:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1782222341.034278:0:19526:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782222341.034489:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1782222341.034513:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1782222341.034528:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1782222341.034541:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1782222341.034553:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1782222341.034566:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1782222341.034578:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1782222341.034591:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1782222341.034603:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1782222341.034940:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1782222341.034962:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1782222341.034989:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1782222341.035002:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1782222341.035015:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1782222341.035029:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1782222341.035043:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1782222341.035055:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1782222341.035065:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1782222341.035075:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1782222341.035086:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1782222341.035097:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1782222341.035109:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1782222341.035123:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1782222341.035138:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1782222341.035150:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1782222341.035162:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1782222341.035173:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1782222341.035196:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1782222341.035217:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1782222341.035231:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1782222341.035304:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1782222341.035317:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1782222341.035329:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1782222341.035340:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1782222341.035353:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1782222341.035366:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1782222341.035381:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1782222341.035395:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1782222341.035407:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:2.0:1782222341.036279:0:17966:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1782222341.037003:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1782222341.037025:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1782222341.037040:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1782222341.037055:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1782222341.037084:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1782222341.037100:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1782222341.037114:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1782222341.037138:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1782222341.037143:0:19526:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1782222341.038089:0:19526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:19526:1868795081861888:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782222341.038162:0:19526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222341.038212:0:19526:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0841254300 going to sleep for 11 seconds 00000100:00100000:2.0:1782222341.038298:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081861888 00000100:00100000:2.0:1782222341.038305:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081861888 00000100:00100000:2.0:1782222341.038355:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1782222341.038364:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+24:19526:x1868795081861888:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782222341.043169:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+24:19526:x1868795081861888:12345-0@lo:501:mount.lustre.0 Request processed in 4798us (4999us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222341.043182:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1782222341.043441:0:19526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:19526:1868795081861888:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782222341.043491:0:19526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:19526:1868795081862016:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782222341.043537:0:19526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222341.043578:0:19526:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0841254300 going to sleep for 11 seconds 00000100:00100000:2.0:1782222341.044421:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081862016 00000100:00100000:2.0:1782222341.044430:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081862016 00000100:00100000:2.0:1782222341.044490:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1782222341.044499:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f4f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+24:19526:x1868795081862016:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782222341.044617:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f4f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+24:19526:x1868795081862016:12345-0@lo:503:mount.lustre.0 Request processed in 119us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222341.044625:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1782222341.044895:0:19526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:19526:1868795081862016:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1782222341.045972:0:19526:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782222341.046080:0:19526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:19526:1868795081862144:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782222341.046143:0:19526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222341.046202:0:19526:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f07464156c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782222341.046938:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081862144 00000100:00100000:1.0:1782222341.046946:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081862144 00000100:00100000:1.0:1782222341.046995:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1782222341.047014:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f4f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+24:19526:x1868795081862144:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782222341.047135:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f4f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+24:19526:x1868795081862144:12345-0@lo:502:mount.lustre.0 Request processed in 123us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222341.047144:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1782222341.047391:0:19526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:19526:1868795081862144:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782222341.047612:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1782222341.047640:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1782222341.047654:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1782222341.047667:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1782222341.047680:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1782222341.047694:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1782222341.047875:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1782222341.047901:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1782222341.047917:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1782222341.047935:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1782222341.047951:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1782222341.047986:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1782222341.048000:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1782222341.048013:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1782222341.048029:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1782222341.048045:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1782222341.048061:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1782222341.048076:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1782222341.048095:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1782222341.048110:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1782222341.048120:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1782222341.048130:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1782222341.048145:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1782222341.051108:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1782222341.051131:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1782222341.051146:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1782222341.051159:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1782222341.051190:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1782222341.051212:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1782222341.051228:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1782222341.051262:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1782222341.051278:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1782222341.051293:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1782222341.051307:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1782222341.051322:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1782222341.051338:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1782222341.051353:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1782222341.051370:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1782222341.051384:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1782222341.051400:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1782222341.051415:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1782222341.051431:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1782222341.051447:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1782222341.051478:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1782222341.051507:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1782222341.051525:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1782222341.051541:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1782222341.051557:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1782222341.051614:0:19526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:19526:1868795081862272:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782222341.051689:0:19526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222341.051751:0:19526:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f07464156c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782222341.051766:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081862272 00000100:00100000:0.0:1782222341.051775:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081862272 00000100:00100000:0.0:1782222341.051839:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1782222341.051849:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f4f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+24:19526:x1868795081862272:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782222341.051980:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f4f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+24:19526:x1868795081862272:12345-0@lo:502:mount.lustre.0 Request processed in 133us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222341.051988:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1782222341.053338:0:19526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:19526:1868795081862272:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782222341.053554:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1782222341.053582:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1782222341.053616:0:19526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:19526:1868795081862400:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782222341.053669:0:19526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222341.053711:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081862400 00000100:00100000:0.0:1782222341.053717:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081862400 00000100:00100000:3.0:1782222341.053734:0:19526:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f07464156c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782222341.053772:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1782222341.053781:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f4f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+24:19526:x1868795081862400:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782222341.053886:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f4f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+24:19526:x1868795081862400:12345-0@lo:502:mount.lustre.0 Request processed in 105us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222341.053893:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1782222341.054942:0:19526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:19526:1868795081862400:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782222341.055011:0:19526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1782222341.055022:0:19526:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1782222341.057924:0:19540:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1782222341.057943:0:19540:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8f07475699c0) 00000020:00000080:3.0:1782222341.057969:0:19540:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1782222341.058166:0:19540:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f0746531000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1782222341.058171:0:19540:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f0746531000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1782222341.058173:0:19540:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8f0746531000 3 00010000:00080000:3.0:1782222341.058204:0:19540:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f07466db000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.127@tcp at head 00010000:00010000:2.0:1782222341.062893:0:19540:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1782222341.063005:0:19540:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1782222341.063077:0:19540:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1782222341.063092:0:19540:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xe2b7cc26e681272b 00000100:00080000:2.0:1782222341.063105:0:19540:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782222341.063118:0:19540:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f07466db000 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:2.0:1782222341.063156:0:19540:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0849b15c00 x1868795081862528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782222341.063186:0:19540:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000020:01000004:3.0:1782222341.063414:0:19540:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1782222341.063430:0:19540:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8f086b788000) 00000020:00000080:3.0:1782222341.063448:0:19540:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000100:00100000:0.0:1782222341.063456:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1868795081862528:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1782222341.063531:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1782222341.063585:0:19540:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f0746531000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1782222341.063590:0:19540:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f0746531000 from lustre-OST0001, refs=3 00000100:00100000:0.0:1782222341.063591:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081862528 00000100:00100000:0.0:1782222341.063599:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081862528 00000020:01000004:3.0:1782222341.063600:0:19540:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8f0746531000 3 00010000:00080000:3.0:1782222341.063632:0:19540:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f07466d8800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.127@tcp at head 00000100:00100000:3.0:1782222341.063761:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081862656:0@lo:400:kworker.0 00000100:00080000:1.0:1782222341.063767:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782222341.063774:0:491:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1782222341.063777:0:491:0:(import.c:65:import_set_state_nolock()) ffff8f07472a5800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782222341.063782:0:491:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 539 00000100:00080000:1.0:1782222341.063786:0:491:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1782222341.063791:0:491:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f07472a5800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:1.0:1782222341.063804:0:491:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f088159a680 x1868795081862912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782222341.063837:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782222341.063840:0:491:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1782222341.063842:0:491:0:(import.c:65:import_set_state_nolock()) ffff8f08450bd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782222341.063845:0:491:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 539 00000100:00080000:1.0:1782222341.063847:0:491:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1782222341.063850:0:491:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f08450bd800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:1.0:1782222341.063859:0:491:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0881599c00 x1868795081863424/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782222341.063927:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1868795081863040:0@lo:400:kworker.0 00000100:00100000:2.0:1782222341.063956:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222341.063975:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1868795081863680:0@lo:400:kworker.0 00000100:00100000:2.0:1782222341.063999:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222341.064037:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222341.064069:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782222341.064077:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081863296:0@lo:400:kworker.0 00000100:00100000:2.0:1782222341.064080:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081863168:0@lo:400:kworker.0 00000100:00100000:3.0:1782222341.064115:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222341.064121:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222341.064140:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782222341.064146:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1868795081863808:0@lo:400:kworker.0 00000100:00100000:3.0:1782222341.064150:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081862784:0@lo:400:kworker.0 00000100:00100000:2.0:1782222341.064182:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222341.064188:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222341.064206:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1868795081863552:0@lo:400:kworker.0 00000100:00100000:3.0:1782222341.064333:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081862656 00000100:00100000:3.0:1782222341.064338:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081862656 00000100:00100000:3.0:1782222341.064372:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081863168 00000100:00100000:3.0:1782222341.064375:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081863168 00000100:00100000:3.0:1782222341.064392:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782222341.064401:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081862656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222341.064457:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081862656:12345-0@lo:400:kworker.0 Request processed in 56us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222341.064464:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782222341.064478:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1782222341.064484:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081863168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222341.064514:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081863168:12345-0@lo:400:kworker.0 Request processed in 30us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222341.064520:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1782222341.064537:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081863296 00000100:00100000:3.0:1782222341.064540:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081863296 00000100:00100000:3.0:1782222341.064562:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081862784 00000100:00100000:3.0:1782222341.064572:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081862784 00000100:00100000:3.0:1782222341.064590:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782222341.064596:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081863296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222341.064640:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081863296:12345-0@lo:400:kworker.0 Request processed in 44us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222341.064647:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782222341.064659:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782222341.065694:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081862784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222341.066207:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081862784:12345-0@lo:400:kworker.0 Request processed in 1540us (2021us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222341.066217:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782222341.067548:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081863040 00000100:00100000:1.0:1782222341.067560:0:19481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081863040 00000100:00100000:1.0:1782222341.067608:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081863680 00000100:00100000:1.0:1782222341.067612:0:19481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081863680 00000100:00100000:1.0:1782222341.067635:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081863808 00000100:00100000:1.0:1782222341.067639:0:19481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081863808 00000100:00100000:1.0:1782222341.067670:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782222341.067678:0:19481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1868795081863040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222341.067752:0:19481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1868795081863040:12345-0@lo:400:kworker.0 Request processed in 75us (3795us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222341.067759:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782222341.067775:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782222341.067781:0:19481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1868795081863680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222341.067808:0:19481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1868795081863680:12345-0@lo:400:kworker.0 Request processed in 28us (3809us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222341.067815:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782222341.067826:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1782222341.067831:0:19481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1868795081863808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222341.067857:0:19481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1868795081863808:12345-0@lo:400:kworker.0 Request processed in 26us (3675us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222341.067863:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1782222341.067874:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782222341.067879:0:19481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3652:x1868795081862528:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1782222341.067900:0:19481:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:1.0:1782222341.067930:0:19481:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xe2b7cc26e6812739 00000004:00100000:1.0:1782222341.067946:0:19481:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782222341.067976:0:19481:0:(import.c:65:import_set_state_nolock()) ffff8f0847069000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782222341.068012:0:19481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1868795081862528:12345-0@lo:38:llog_process_th.0 Request processed in 132us (4481us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222341.068019:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782222341.068737:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081862912:0@lo:8:kworker.0 00000100:00100000:0.0:1782222341.068782:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222341.068818:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1868795081863424:0@lo:8:kworker.0 00000100:00100000:0.0:1782222341.068839:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1782222341.068848:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0881598a80 x1868795081863808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1782222341.068872:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0849b15c00 x1868795081862528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782222351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222341.068884:0:3652:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782222341.068892:0:3652:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1782222341.068899:0:3652:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1782222341.068904:0:3652:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1782222341.068907:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f07466db000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1782222341.068913:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1868795081862528:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1782222341.068942:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081862912 00000100:00100000:0.0:1782222341.068946:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081862912 00000100:00100000:0.0:1782222341.068965:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081863424 00000100:00100000:0.0:1782222341.068967:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081863424 00000100:00100000:2.0:1782222341.068972:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1868795081863808:0@lo:400:kworker.0 00000100:00100000:0.0:1782222341.068977:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782222341.068982:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747782d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3652:x1868795081862912:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1782222341.068986:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0881599180 x1868795081863040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222341.068993:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1868795081863040:0@lo:400:kworker.0 00010000:00080000:2.0:1782222341.069003:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0881598000 x1868795081863680/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222341.069011:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1868795081863680:0@lo:400:kworker.0 00000100:00100000:0.0:1782222341.069022:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747782d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3652:x1868795081862912:12345-0@lo:8:kworker.0 Request processed in 39us (239us total) trans 0 rc -11/-11 00000100:00100000:0.0:1782222341.069028:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782222341.069033:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081863168:0@lo:400:kworker.0 00000100:00100000:0.0:1782222341.069038:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782222341.069042:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3652:x1868795081863424:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1782222341.069070:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3652:x1868795081863424:12345-0@lo:8:kworker.0 Request processed in 26us (230us total) trans 0 rc -11/-11 00000100:00100000:0.0:1782222341.069077:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782222341.069099:0:3652:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782222341.069103:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f07472a5800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782222341.069107:0:3652:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1782222341.069110:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081862912:0@lo:8:kworker.0 00000100:00100000:0.0:1782222341.069118:0:3652:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782222341.069126:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f08450bd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782222341.069130:0:3652:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1782222341.069132:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1868795081863424:0@lo:8:kworker.0 00000100:00100000:0.0:1782222341.069327:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222341.069406:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081863296:0@lo:400:kworker.0 00000100:00100000:0.0:1782222341.069419:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081862656:0@lo:400:kworker.0 00000100:00100000:0.0:1782222341.069437:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081862784:0@lo:400:kworker.0 00000100:00100000:2.0:1782222341.069438:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081863552 00000100:00100000:2.0:1782222341.069442:0:19481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081863552 00000100:00100000:2.0:1782222341.069478:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782222341.069484:0:19481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1868795081863552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222341.069525:0:19481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1868795081863552:12345-0@lo:400:kworker.0 Request processed in 42us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222341.069532:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1782222341.069534:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0881598e00 x1868795081863552/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222341.069542:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1868795081863552:0@lo:400:kworker.0 00010000:00010000:2.0:1782222341.076892:0:19540:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1782222341.077176:0:19540:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1782222341.077262:0:19540:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1782222341.077276:0:19540:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xe2b7cc26e6812740 00000100:00080000:2.0:1782222341.077287:0:19540:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782222341.077293:0:19540:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8f07466d8800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:2.0:1782222341.077326:0:19540:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f0849b15c00 x1868795081863936/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782222341.077398:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3652:1868795081863936:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1782222341.077485:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782222341.077833:0:19540:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:2.0:1782222341.078541:0:19540:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000100:00100000:0.0:1782222341.079038:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081863936 00000100:00100000:0.0:1782222341.079048:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081863936 00000100:00100000:0.0:1782222341.079137:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782222341.079149:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3652:x1868795081863936:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1782222341.079184:0:17208:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:0.0:1782222341.079230:0:17208:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xe2b7cc26e6812747 00000004:00100000:0.0:1782222341.079265:0:17208:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1782222341.079299:0:17208:0:(import.c:65:import_set_state_nolock()) ffff8f074560e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782222341.079380:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1868795081863936:12345-0@lo:38:llog_process_th.0 Request processed in 231us (1893us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222341.079389:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1782222341.079846:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f0849b15c00 x1868795081863936/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782222351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222341.079876:0:3652:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782222341.079885:0:3652:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1782222341.079892:0:3652:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1782222341.079898:0:3652:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1782222341.079900:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f07466d8800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1782222341.079908:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3652:1868795081863936:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1782222341.079952:0:19526:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1782222341.081711:0:19526:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782222341.081747:0:19526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f08483edc00/0xe2b7cc26e6812716 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681271d expref: -99 pid: 19526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222341.081761:0:19526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f08483edc00/0xe2b7cc26e6812716 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681271d expref: -99 pid: 19526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1782222341.081890:0:19526:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1782222341.081893:0:19526:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782222341.081894:0:19526:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782222341.081896:0:19526:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782222341.081897:0:19526:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782222341.081899:0:19526:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782222341.081901:0:19526:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782222341.081903:0:19526:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782222341.081904:0:19526:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782222341.081908:0:19526:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1782222341.081911:0:19526:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782222341.081913:0:19526:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782222341.081914:0:19526:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782222341.081915:0:19526:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782222341.081920:0:19526:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782222341.081922:0:19526:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782222341.081922:0:19526:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782222341.081924:0:19526:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782222341.081924:0:19526:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782222341.081947:0:19526:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1782222341.081966:0:19526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b15c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:19526:1868795081864064:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1782222341.082027:0:19526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222341.082074:0:19526:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08492a1900 going to sleep for 11 seconds 00000100:00100000:1.0:1782222341.082125:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081864064 00000100:00100000:1.0:1782222341.082138:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081864064 00000100:00100000:1.0:1782222341.082187:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1782222341.082196:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f4f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+24:19526:x1868795081864064:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1782222341.082222:0:17201:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1782222341.082265:0:17201:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1782222341.086161:0:17201:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1782222341.086180:0:17201:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1782222341.086528:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f4f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+24:19526:x1868795081864064:12345-0@lo:253:mount.lustre.0 Request processed in 4328us (4496us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222341.086539:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 20000000:01000000:3.0:1782222341.086632:0:17224:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1782222341.086638:0:17224:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1782222341.086656:0:17224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f08483ecc00/0xe2b7cc26e681274e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222341.086669:0:17224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f087fb82600/0xe2b7cc26e68125fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68125f7 expref: 23 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222341.086675:0:17224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f087fb82a00/0xe2b7cc26e681260c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6812605 expref: 23 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222341.086683:0:17224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f08483ecc00/0xe2b7cc26e681274e lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222341.086700:0:19526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b15c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0873f67-836f-4221-9522-aadc54ad715e:19526:1868795081864064:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1782222341.086713:0:19526:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1782222341.086717:0:19526:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782222341.086729:0:19526:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00010000:00010000:3.0:1782222341.086730:0:17224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f087fb82a00/0xe2b7cc26e681260c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e6812605 expref: 23 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1782222341.086732:0:19526:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782222341.086734:0:19526:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782222341.086737:0:19526:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782222341.086740:0:19526:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782222341.086743:0:19526:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782222341.086745:0:19526:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782222341.086746:0:19526:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:3.0:1782222341.086751:0:17224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f087fb82a00/0xe2b7cc26e681260c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e6812605 expref: 23 pid: 17203 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:2.0:1782222341.086764:0:19526:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1782222341.086782:0:17224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef4380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17224:1868795081864192:0@lo:104: 00000100:00100000:3.0:1782222341.086906:0:17224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782222341.086963:0:17224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f087fb82600/0xe2b7cc26e68125fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e68125f7 expref: 23 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222341.086974:0:17224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f087fb82600/0xe2b7cc26e68125fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e68125f7 expref: 23 pid: 17203 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222341.086984:0:17224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474bdf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17224:1868795081864320:0@lo:104: 00000100:00100000:3.0:1782222341.087009:0:17224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222341.087078:0:17224:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746415600 going to sleep for 11 seconds 00000001:00000004:3.0:1782222341.091487:0:19526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1782222341.091984:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081864192 00000100:00100000:1.0:1782222341.091994:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081864192 00000100:00100000:1.0:1782222341.092031:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081864320 00000100:00100000:1.0:1782222341.092034:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081864320 00000100:00100000:1.0:1782222341.092049:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782222341.092058:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0873f67-836f-4221-9522-aadc54ad715e+4:17224:x1868795081864192:12345-0@lo:104: 00010000:00010000:1.0:1782222341.092077:0:17192:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f087fb82800/0xe2b7cc26e6812605 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e681260c expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222341.092177:0:17192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782222341.092184:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0873f67-836f-4221-9522-aadc54ad715e+4:17224:x1868795081864192:12345-0@lo:104: Request processed in 127us (5279us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222341.092192:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782222341.092210:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782222341.092216:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0873f67-836f-4221-9522-aadc54ad715e+3:17224:x1868795081864320:12345-0@lo:104: 00010000:00010000:1.0:1782222341.092224:0:17192:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f074744ca00/0xe2b7cc26e68125f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e68125fe expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222341.092358:0:17192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782222341.092372:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0873f67-836f-4221-9522-aadc54ad715e+3:17224:x1868795081864320:12345-0@lo:104: Request processed in 156us (5362us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222341.092378:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1782222341.092449:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782222341.092457:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f087fb82800/0xe2b7cc26e6812605 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e681260c expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222341.092465:0:17224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef4380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17224:1868795081864192:0@lo:104: 00010000:00010000:0.0:1782222341.092476:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb82800 already unused, calling callback (ffffffffc138ac20) 00000100:00100000:3.0:1782222341.092477:0:17224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474bdf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17224:1868795081864320:0@lo:104: 10000000:00010000:0.0:1782222341.092482:0:17197:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f087fb82800/0xe2b7cc26e6812605 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e681260c expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222341.092493:0:17197:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f087fb82800/0xe2b7cc26e6812605 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e681260c expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782222341.092501:0:17197:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f087fb82800/0xe2b7cc26e6812605 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e681260c expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222341.092503:0:17224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f08483ecc00/0xe2b7cc26e681274e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782222341.092528:0:17197:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1782222341.092567:0:17197:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f087fb82800/0xe2b7cc26e6812605 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e681260c expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222341.092574:0:17197:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782222341.092600:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f087fb82800/0xe2b7cc26e6812605 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e681260c expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222341.092607:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f087fb82800/0xe2b7cc26e6812605 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e681260c expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222341.092619:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782222341.092621:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f074744ca00/0xe2b7cc26e68125f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e68125fe expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222341.092626:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744ca00 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:0.0:1782222341.092629:0:17197:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f074744ca00/0xe2b7cc26e68125f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e68125fe expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222341.092634:0:17197:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f074744ca00/0xe2b7cc26e68125f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e68125fe expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782222341.092639:0:17197:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f074744ca00/0xe2b7cc26e68125f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e68125fe expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782222341.092644:0:17197:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1782222341.092740:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222341.092809:0:17197:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f074744ca00/0xe2b7cc26e68125f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e68125fe expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222341.092816:0:17197:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782222341.092829:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f074744ca00/0xe2b7cc26e68125f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e68125fe expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222341.092836:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f074744ca00/0xe2b7cc26e68125f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e68125fe expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222341.092850:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222341.092852:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222341.092853:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222341.093032:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0873f67-836f-4221-9522-aadc54ad715e:3653:1868795081864448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782222341.093075:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222341.093128:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782222341.093135:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0873f67-836f-4221-9522-aadc54ad715e:3653:1868795081864576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782222341.093157:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222341.093200:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081864448 00000100:00100000:3.0:1782222341.093205:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081864448 00010000:00010000:3.0:1782222341.093228:0:17194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f087fb82a00/0xe2b7cc26e681260c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6812605 expref: 24 pid: 17203 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222341.093281:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081864576 00000100:00100000:0.0:1782222341.093286:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081864576 00010000:00010000:0.0:1782222341.093306:0:17193:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f087fb82600/0xe2b7cc26e68125fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e68125f7 expref: 25 pid: 17203 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222341.093347:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782222341.093360:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0873f67-836f-4221-9522-aadc54ad715e+25:3653:x1868795081864576:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782222341.093369:0:17194:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:0.0:1782222341.093373:0:17193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1782222341.093379:0:17194:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1782222341.093380:0:17193:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f087fb82600/0xe2b7cc26e68125fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e68125f7 expref: 25 pid: 17203 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222341.093390:0:17193:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f087fb82600/0xe2b7cc26e68125fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e68125f7 expref: 25 pid: 17203 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222341.093403:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f087fb82600/0xe2b7cc26e68125fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e68125f7 expref: 25 pid: 17203 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222341.093415:0:17193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782222341.093456:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0873f67-836f-4221-9522-aadc54ad715e+24:3653:x1868795081864576:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222341.093463:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782222341.093497:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782222341.093519:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0873f67-836f-4221-9522-aadc54ad715e+23:3653:x1868795081864448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782222341.093528:0:17193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222341.093533:0:17193:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f087fb82a00/0xe2b7cc26e681260c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6812605 expref: 23 pid: 17203 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222341.093541:0:17193:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f087fb82a00/0xe2b7cc26e681260c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e6812605 expref: 23 pid: 17203 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222341.093550:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f087fb82a00/0xe2b7cc26e681260c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e6812605 expref: 23 pid: 17203 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222341.093560:0:17193:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f08483ecc00/0xe2b7cc26e681274e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222341.093567:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f08483ecc00/0xe2b7cc26e681274e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782222341.093580:0:17193:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007046334s 00010000:00010000:0.0:1782222341.093585:0:17193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f08483ecc00/0xe2b7cc26e681274e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222341.093593:0:17193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f08483ecc00/0xe2b7cc26e681274e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222341.093605:0:17193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f08483ecc00/0xe2b7cc26e681274e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222341.093611:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f08483ecc00/0xe2b7cc26e681274e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222341.093616:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08483ecc00 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:0.0:1782222341.093628:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f08483ecc00/0xe2b7cc26e681274e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222341.093636:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f08483ecc00/0xe2b7cc26e681274e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222341.093940:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f08483ecc00/0xe2b7cc26e681274e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222341.093952:0:17193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782222341.093980:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0873f67-836f-4221-9522-aadc54ad715e+22:3653:x1868795081864448:12345-0@lo:103:ldlm_bl.0 Request processed in 462us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222341.093987:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782222341.094024:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0873f67-836f-4221-9522-aadc54ad715e:3653:1868795081864576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782222341.094034:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0873f67-836f-4221-9522-aadc54ad715e:3653:1868795081864448:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782222341.094295:0:17224:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f08483ecc00/0xe2b7cc26e681274e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222341.094305:0:17224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f08483ecc00/0xe2b7cc26e681274e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222341.094312:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f08483ecc00/0xe2b7cc26e681274e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1782222341.096456:0:19526:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1782222341.096465:0:19526:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1782222341.096582:0:19526:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1782222341.096627:0:19526:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.127@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1782222341.096650:0:19526:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1782222341.096679:0:19526:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1782222341.098000:0:19526:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782222341.098296:0:19526:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1782222341.930738:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1782222341.939420:0:19594:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782222341.939675:0:19594:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1782222342.251307:0:17206:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1782222342.251315:0:17206:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8f08516c3800 from 10 10000000:01000000:1.0:1782222342.251320:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782222342.251361:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f074744da00/0xe2b7cc26e6812755 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222342.251372:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f074744da00/0xe2b7cc26e6812755 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222342.251383:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f074744da00/0xe2b7cc26e6812755 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222342.251406:0:17206:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081864704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782222342.251460:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222342.251499:0:17206:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746444240 going to sleep for 11 seconds 00000100:00100000:2.0:1782222342.251575:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081864704 00000100:00100000:2.0:1782222342.251582:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081864704 00000100:00100000:2.0:1782222342.251641:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1782222342.251651:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f4f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+22:17206:x1868795081864704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782222342.251664:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222342.251684:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f087fb83e00/0xe2b7cc26e681275c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6812755 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222342.251709:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fb83e00/0xe2b7cc26e681275c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6812755 expref: 23 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222342.251728:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f087fb83e00/0xe2b7cc26e681275c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6812755 expref: 23 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222342.251737:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb83e00, rc 0) 00000100:00100000:2.0:1782222342.251783:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f4f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+23:17206:x1868795081864704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222342.251790:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1782222342.252091:0:17206:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081864704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782222342.252105:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f074744da00/0xe2b7cc26e6812755 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681275c expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222342.252115:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f074744da00/0xe2b7cc26e6812755 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e681275c expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222342.252165:0:17206:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081864832:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1782222342.252197:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222342.252226:0:17206:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746444240 going to sleep for 11 seconds 00000100:00100000:2.0:1782222342.252304:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081864832 00000100:00100000:2.0:1782222342.252309:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081864832 00000100:00100000:2.0:1782222342.252342:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1782222342.252350:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f4f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+23:17206:x1868795081864832:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1782222342.252363:0:17201:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1782222342.252379:0:17201:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1782222342.252382:0:17201:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1782222342.252467:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f4f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+23:17206:x1868795081864832:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 117us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222342.252473:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1782222342.252542:0:17206:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081864832:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1782222342.252594:0:17206:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782222342.252600:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f074744da00/0xe2b7cc26e6812755 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681275c expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222342.252609:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f074744da00/0xe2b7cc26e6812755 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681275c expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782222342.252618:0:17206:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1782222342.252620:0:17206:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8f0748460800 from 10 10000000:01000000:1.0:1782222342.252631:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782222342.252648:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f074744ce00/0xe2b7cc26e6812763 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222342.252655:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f074744ce00/0xe2b7cc26e6812763 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222342.252663:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f074744ce00/0xe2b7cc26e6812763 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222342.252675:0:17206:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081864960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782222342.252700:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222342.252738:0:17206:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746444240 going to sleep for 11 seconds 00000100:00100000:3.0:1782222342.252794:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081864960 00000100:00100000:3.0:1782222342.252799:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081864960 00000100:00100000:3.0:1782222342.252829:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1782222342.252836:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f4f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+23:17206:x1868795081864960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782222342.252843:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222342.252853:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f08483ec400/0xe2b7cc26e681276a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6812763 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222342.252881:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f08483ec400/0xe2b7cc26e681276a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6812763 expref: 24 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222342.252890:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f08483ec400/0xe2b7cc26e681276a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6812763 expref: 24 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222342.252898:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f08483ec400, rc 0) 00000100:00100000:3.0:1782222342.252925:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f4f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+24:17206:x1868795081864960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222342.253083:0:17206:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081864960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782222342.253094:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f074744ce00/0xe2b7cc26e6812763 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681276a expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222342.253101:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f074744ce00/0xe2b7cc26e6812763 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e681276a expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222342.253140:0:17206:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081865088:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1782222342.253166:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222342.253178:0:17206:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746444240 going to sleep for 11 seconds 00000100:00100000:1.0:1782222342.253189:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081865088 00000100:00100000:1.0:1782222342.253191:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081865088 00000100:00100000:3.0:1782222342.253277:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1782222342.255443:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1782222342.255462:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f4f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+24:17206:x1868795081865088:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1782222342.255486:0:17201:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1782222342.255504:0:17201:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1782222342.255507:0:17201:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1782222342.255631:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f4f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+24:17206:x1868795081865088:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 167us (2454us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222342.255640:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1782222342.255734:0:17206:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081865088:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1782222342.255791:0:17206:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1782222342.255802:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f074744ce00/0xe2b7cc26e6812763 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681276a expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222342.255812:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f074744ce00/0xe2b7cc26e6812763 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e681276a expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222342.955361:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222343.980276:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222345.004499:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222345.196949:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081865216:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782222345.197029:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222345.197087:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081865216 00000100:00100000:3.0:1782222345.197094:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081865216 00000100:00100000:3.0:1782222345.197150:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782222345.197159:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081865216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782222345.197189:0:18717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1782222345.197374:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081865344:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782222345.197410:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222345.197756:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081865472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782222345.197788:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222345.197925:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081865216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222345.197936:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782222345.197955:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081865472 00000100:00100000:3.0:1782222345.197958:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081865472 00000100:00100000:3.0:1782222345.197980:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782222345.197987:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081865472:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782222345.198003:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1782222345.198011:0:18717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1782222345.198055:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081865472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222345.198070:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782222345.198116:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081865216:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782222345.198126:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081865472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782222345.198146:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081865344 00000100:00100000:3.0:1782222345.198151:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081865344 00000100:00100000:3.0:1782222345.198188:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782222345.198195:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081865344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782222345.198217:0:17213:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1782222345.198420:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081865344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 225us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222345.198427:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782222345.198455:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081865344:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782222345.198570:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081865600:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782222345.198603:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222345.198645:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081865600 00000100:00100000:1.0:1782222345.198649:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081865600 00000100:00100000:1.0:1782222345.198674:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782222345.198680:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088159b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081865600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782222345.198707:0:17214:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1782222345.198739:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088159b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081865600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222345.198744:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782222345.198771:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081865600:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1782222346.026739:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782222346.223777:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782222346.223783:0:491:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1782222346.223787:0:491:0:(import.c:65:import_set_state_nolock()) ffff8f07472a5800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782222346.223800:0:491:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f07472a5800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:2.0:1782222346.223824:0:491:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f074561ea00 x1868795081866112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782222346.223857:0:491:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782222346.223860:0:491:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1782222346.223861:0:491:0:(import.c:65:import_set_state_nolock()) ffff8f08450bd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782222346.223866:0:491:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f08450bd800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:2.0:1782222346.223876:0:491:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f074561c000 x1868795081866624/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782222346.223926:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1868795081866240:0@lo:400:kworker.0 00000100:00100000:2.0:1782222346.223998:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222346.224031:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1868795081866880:0@lo:400:kworker.0 00000100:00100000:2.0:1782222346.224054:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222346.224082:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1782222346.224088:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081865984:0@lo:400:kworker.0 00000100:00100000:2.0:1782222346.224112:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222346.224127:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1868795081866752:0@lo:400:kworker.0 00000100:00100000:2.0:1782222346.224145:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222346.224175:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1868795081867264:0@lo:400:kworker.0 00000100:00100000:2.0:1782222346.224202:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222346.224226:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081866112:0@lo:8:kworker.0 00000100:00100000:2.0:1782222346.224284:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222346.224302:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1868795081866624:0@lo:8:kworker.0 00000100:00100000:2.0:1782222346.224320:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222346.224351:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081866240 00000100:00100000:2.0:1782222346.224358:0:19481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081866240 00000100:00100000:2.0:1782222346.224392:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081866880 00000100:00100000:2.0:1782222346.224395:0:19481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081866880 00000100:00100000:2.0:1782222346.224419:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081866752 00000100:00100000:2.0:1782222346.224421:0:19481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081866752 00000100:00100000:2.0:1782222346.224431:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081867264 00000100:00100000:2.0:1782222346.224433:0:19481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081867264 00000100:00100000:2.0:1782222346.224447:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782222346.224454:0:19481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1868795081866240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222346.224504:0:19481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1868795081866240:12345-0@lo:400:kworker.0 Request processed in 50us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222346.224511:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782222346.224526:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782222346.224531:0:19481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1868795081866880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222346.224555:0:19481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1868795081866880:12345-0@lo:400:kworker.0 Request processed in 24us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222346.224561:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782222346.224570:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782222346.224575:0:19481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1868795081866752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222346.224597:0:19481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1868795081866752:12345-0@lo:400:kworker.0 Request processed in 22us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222346.224608:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782222346.224619:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782222346.224625:0:19481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1868795081867264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222346.224650:0:19481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1868795081867264:12345-0@lo:400:kworker.0 Request processed in 26us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222346.224655:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782222346.224681:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081865984 00000100:00100000:2.0:1782222346.224697:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081865984 00000100:00100000:2.0:1782222346.224715:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081866112 00000100:00100000:2.0:1782222346.224717:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081866112 00000100:00100000:2.0:1782222346.224725:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081866624 00000100:00100000:2.0:1782222346.224728:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081866624 00000100:00100000:2.0:1782222346.224735:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782222346.224740:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081865984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222346.224769:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081865984:12345-0@lo:400:kworker.0 Request processed in 28us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222346.224774:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782222346.224785:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782222346.224789:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3652:x1868795081866112:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1782222346.224812:0:18715:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:2.0:1782222346.224838:0:18715:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe2b7cc26e6812771 00002000:00100000:2.0:1782222346.224852:0:18715:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8f07470ff000 ocd_connect_flags: 0xe044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1782222346.224856:0:18715:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1782222346.224859:0:18715:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1782222346.225024:0:18715:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1782222346.225050:0:18715:0:(import.c:65:import_set_state_nolock()) ffff8f07470fc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782222346.225094:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3652:x1868795081866112:12345-0@lo:8:kworker.0 Request processed in 303us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222346.225100:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782222346.225114:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782222346.225118:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3652:x1868795081866624:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1782222346.225132:0:18715:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:2.0:1782222346.225150:0:18715:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe2b7cc26e6812778 00002000:00100000:2.0:1782222346.225155:0:18715:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8f07470f8000 ocd_connect_flags: 0xe044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1782222346.225159:0:18715:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1782222346.225161:0:18715:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1782222346.225183:0:18715:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1782222346.225196:0:18715:0:(import.c:65:import_set_state_nolock()) ffff8f07470fb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782222346.225222:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3652:x1868795081866624:12345-0@lo:8:kworker.0 Request processed in 102us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222346.225227:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1782222346.225275:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782222346.225280:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782222346.225305:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074561ea00 x1868795081866112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782222371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1782222346.225319:0:3652:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1782222346.225326:0:3652:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xe040401443000026 00000100:00080000:2.0:1782222346.225331:0:3652:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1782222346.225334:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f07472a5800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1782222346.225346:0:3652:0:(osp_dev.c:1650:osp_import_event()) got connected 00000100:00100000:2.0:1782222346.225350:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1868795081866112:0@lo:8:kworker.0 00010000:00080000:2.0:1782222346.225363:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074561c000 x1868795081866624/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782222371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1782222346.225379:0:3652:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1782222346.225384:0:3652:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xe040401443000026 00000100:00080000:2.0:1782222346.225387:0:3652:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1782222346.225389:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8f08450bd800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1782222346.225397:0:3652:0:(osp_dev.c:1650:osp_import_event()) got connected 00000100:00100000:2.0:1782222346.225402:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1868795081866624:0@lo:8:kworker.0 00000100:00100000:2.0:1782222346.225444:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081865984:0@lo:400:kworker.0 00010000:00080000:2.0:1782222346.225454:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074561df80 x1868795081866752/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222346.225464:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1868795081866752:0@lo:400:kworker.0 00010000:00080000:2.0:1782222346.225473:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474d2680 x1868795081867264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222346.225480:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1868795081867264:0@lo:400:kworker.0 00010000:00080000:2.0:1782222346.225489:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074561ca80 x1868795081866240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222346.225497:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1868795081866240:0@lo:400:kworker.0 00010000:00080000:2.0:1782222346.225506:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074561ce00 x1868795081866880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222346.225511:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1868795081866880:0@lo:400:kworker.0 00000100:00100000:3.0:1782222346.225710:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0873f67-836f-4221-9522-aadc54ad715e:3655:1868795081865728:0@lo:400:kworker.0 00000100:00100000:3.0:1782222346.225759:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222346.225802:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081866368:0@lo:400:kworker.0 00000100:00100000:3.0:1782222346.225830:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222346.225849:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1868795081867008:0@lo:400:kworker.0 00000100:00100000:3.0:1782222346.225870:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222346.225888:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1782222346.225893:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081865856:0@lo:400:kworker.0 00000100:00100000:3.0:1782222346.225913:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222346.225930:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081866496:0@lo:400:kworker.0 00000100:00100000:3.0:1782222346.225949:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222346.225964:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1868795081867136:0@lo:400:kworker.0 00000100:00100000:3.0:1782222346.226001:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1782222346.226063:0:17235:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1782222346.226079:0:17235:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17235:1868795081867520:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1782222346.226106:0:17235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222346.226121:0:17235:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746166300 going to sleep for 11 seconds 00000100:00100000:3.0:1782222346.226135:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081866368 00000100:00100000:3.0:1782222346.226139:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081866368 00000100:00100000:3.0:1782222346.226168:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081865856 00000100:00100000:3.0:1782222346.226171:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081865856 00000100:00100000:3.0:1782222346.226184:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782222346.226190:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081866368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222346.226229:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081866368:12345-0@lo:400:kworker.0 Request processed in 39us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222346.226261:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782222346.226275:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782222346.226280:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081865856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222346.226308:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081865856:12345-0@lo:400:kworker.0 Request processed in 28us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222346.226314:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782222346.226335:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081866496 00000100:00100000:3.0:1782222346.226338:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081866496 00000100:00100000:3.0:1782222346.226352:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081867520 00000100:00100000:3.0:1782222346.226355:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081867520 00000100:00100000:3.0:1782222346.226375:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782222346.226381:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081866496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222346.226415:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081866496:12345-0@lo:400:kworker.0 Request processed in 34us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222346.226429:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782222346.226440:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782222346.226445:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17235:x1868795081867520:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1782222346.226666:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782222346.226678:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081867392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782222346.226719:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222346.226751:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081867392 00000100:00100000:3.0:1782222346.226754:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081867392 00000100:00100000:3.0:1782222346.226779:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782222346.226784:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3653:x1868795081867392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782222346.226802:0:18718:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1782222346.226837:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3653:x1868795081867392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222346.226843:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782222346.226863:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081867008 00000100:00100000:3.0:1782222346.226866:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081867008 00000100:00100000:3.0:1782222346.226890:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081867136 00000100:00100000:3.0:1782222346.226893:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081867136 00000100:00100000:3.0:1782222346.226914:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782222346.226920:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1868795081867008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222346.226958:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1868795081867008:12345-0@lo:400:kworker.0 Request processed in 38us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222346.226964:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782222346.226977:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782222346.226983:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1868795081867136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222346.227026:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1868795081867136:12345-0@lo:400:kworker.0 Request processed in 43us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222346.227038:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1782222346.227060:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782222346.227064:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782222346.227066:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782222346.227091:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081865856:0@lo:400:kworker.0 00000100:00100000:3.0:1782222346.227103:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081866496:0@lo:400:kworker.0 00010000:00080000:3.0:1782222346.227114:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474d0700 x1868795081867136/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222346.227123:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1868795081867136:0@lo:400:kworker.0 00000100:00100000:3.0:1782222346.227135:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081866368:0@lo:400:kworker.0 00010000:00080000:3.0:1782222346.227145:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07474d0a80 x1868795081867008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222346.227153:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1868795081867008:0@lo:400:kworker.0 00010000:00080000:3.0:1782222346.227187:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0849b15c00 x1868795081867392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222362 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222346.227200:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081867392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782222346.227631:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081865728 00000100:00100000:2.0:1782222346.227637:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081865728 00000100:00100000:2.0:1782222346.227676:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1782222346.227704:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f4f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+24:3655:x1868795081865728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222346.227764:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f4f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+24:3655:x1868795081865728:12345-0@lo:400:kworker.0 Request processed in 62us (2003us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222346.227770:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1782222346.227809:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0873f67-836f-4221-9522-aadc54ad715e:3655:1868795081865728:0@lo:400:kworker.0 00000004:00080000:1.0:1782222346.231879:0:17234:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1782222346.231991:0:17234:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 545260755433ns, next at 0ns, rc = 0 00080000:00080000:1.0:1782222346.232000:0:17234:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1782222346.232172:0:17951:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1782222346.232208:0:17951:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881598e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17951:1868795081867776:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1782222346.232314:0:17951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222346.232348:0:17951:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0875edfa80 going to sleep for 11 seconds 00000004:00080000:1.0:1782222346.232365:0:17950:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1782222346.232416:0:17950:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 545261180345ns, next at 0ns, rc = 0 00080000:00080000:1.0:1782222346.232421:0:17950:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00002000:00080000:2.0:1782222346.236479:0:18714:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1782222346.236550:0:18714:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1782222346.236557:0:18714:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00000100:00100000:0.0:1782222346.237909:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081867648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782222346.237983:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222346.238052:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081867648 00000100:00100000:0.0:1782222346.238060:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081867648 00000100:00100000:0.0:1782222346.238113:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782222346.238122:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3655:x1868795081867648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782222346.238146:0:18718:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1782222346.238190:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3655:x1868795081867648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222346.238198:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1782222346.238222:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1782222346.238274:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0881599f80 x1868795081867648/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782222362 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222346.238295:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081867648:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782222346.240189:0:18715:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1782222346.240203:0:18715:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1782222346.240391:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081867776 00000100:00100000:3.0:1782222346.240399:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081867776 00000100:00100000:3.0:1782222346.240511:0:19827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782222346.240521:0:19827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17951:x1868795081867776:12345-0@lo:7:osp-pre-1-1.0 00002000:00080000:1.0:1782222346.248863:0:19827:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1782222346.248875:0:19827:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1782222346.249111:0:19827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17951:x1868795081867776:12345-0@lo:7:osp-pre-1-1.0 Request processed in 8586us (16794us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222346.249121:0:19827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:1.0:1782222346.251325:0:17188:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00080000:2.0:1782222346.253151:0:17951:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0881598e00 x1868795081867776/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782222362 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222346.253178:0:17951:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881598e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17951:1868795081867776:0@lo:7:osp-pre-1-1.0 00002000:00010000:3.0:1782222346.253359:0:18714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782222346.253384:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078cc74e8/0xe2b7cc26e681277f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222346.253402:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=545s v=(0 0) 00010000:00010000:3.0:1782222346.253406:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782222346.253413:0:18714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078cc74e8/0xe2b7cc26e681277f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222346.253432:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078cc74e8/0xe2b7cc26e681277f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222346.253443:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078cc74e8/0xe2b7cc26e681277f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222346.253451:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078cc74e8/0xe2b7cc26e681277f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222346.253487:0:18714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1782222346.253487:0:17951:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00010000:00010000:3.0:1782222346.253507:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782222346.253516:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078cc74e8/0xe2b7cc26e681277f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222346.253526:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08483ed200 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:3.0:1782222346.253533:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078cc74e8/0xe2b7cc26e681277f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222346.253541:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078cc74e8/0xe2b7cc26e681277f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222346.253565:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078cc74e8/0xe2b7cc26e681277f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222346.253572:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078cc74e8/0xe2b7cc26e681277f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222346.253591:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222346.253593:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222346.253595:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222346.253702:0:17951:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17951:1868795081867904:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1782222346.253797:0:17951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222346.253914:0:17951:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08509133c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782222346.253955:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081867904 00000100:00100000:2.0:1782222346.253964:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081867904 00000100:00100000:1.0:1782222346.254151:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782222346.254175:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17951:x1868795081867904:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1782222346.254211:0:18716:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1782222346.254328:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17951:x1868795081867904:12345-0@lo:5:osp-pre-1-1.0 Request processed in 164us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222346.254336:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782222346.255021:0:17951:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17951:1868795081867904:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1782222346.255036:0:17951:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00002000:00010000:1.0:1782222346.255057:0:18714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782222346.255064:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2259427/0xe2b7cc26e6812786 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222346.255077:0:17951:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07475aa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17951:1868795081868032:0@lo:5:osp-pre-1-1.0 00010000:00010000:1.0:1782222346.255081:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=545s v=(0 0) 00010000:00010000:1.0:1782222346.255084:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222346.255089:0:18714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2259427/0xe2b7cc26e6812786 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.255113:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2259427/0xe2b7cc26e6812786 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222346.255115:0:17951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782222346.255123:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2259427/0xe2b7cc26e6812786 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.255130:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2259427/0xe2b7cc26e6812786 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222346.255138:0:17951:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0850341180 going to sleep for 11 seconds 00000100:00100000:0.0:1782222346.255722:0:19827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081868032 00000100:00100000:0.0:1782222346.255741:0:19827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081868032 00000100:00100000:0.0:1782222346.255789:0:19827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782222346.255799:0:19827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17951:x1868795081868032:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1782222346.255835:0:19827:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00010000:00010000:1.0:1782222346.256554:0:18714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782222346.256745:0:17196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782222346.256760:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2259427/0xe2b7cc26e6812786 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.256777:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0875802200 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:2.0:1782222346.256783:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2259427/0xe2b7cc26e6812786 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.256799:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2259427/0xe2b7cc26e6812786 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782222346.257046:0:18714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782222346.257070:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2259427/0xe2b7cc26e6812786 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.257090:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2259427/0xe2b7cc26e6812786 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.257157:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222346.257163:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222346.257168:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222346.257454:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc64c75d/0xe2b7cc26e681278d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.257472:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=545s v=(0 0) 00010000:00010000:1.0:1782222346.257476:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222346.257482:0:18714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc64c75d/0xe2b7cc26e681278d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.257495:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc64c75d/0xe2b7cc26e681278d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.257504:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc64c75d/0xe2b7cc26e681278d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.257522:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc64c75d/0xe2b7cc26e681278d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.257582:0:18714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1782222346.257925:0:17940:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00010000:1.0:1782222346.258002:0:18714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782222346.258007:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004df7d8cd/0xe2b7cc26e6812794 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.258016:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=545s v=(0 0) 00010000:00010000:1.0:1782222346.258019:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222346.258023:0:18714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004df7d8cd/0xe2b7cc26e6812794 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.258032:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004df7d8cd/0xe2b7cc26e6812794 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.258040:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004df7d8cd/0xe2b7cc26e6812794 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.258047:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004df7d8cd/0xe2b7cc26e6812794 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.258103:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782222346.258110:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc64c75d/0xe2b7cc26e681278d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.258117:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0875802800 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:0.0:1782222346.258122:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc64c75d/0xe2b7cc26e681278d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.258131:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc64c75d/0xe2b7cc26e681278d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.258149:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc64c75d/0xe2b7cc26e681278d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.258157:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc64c75d/0xe2b7cc26e681278d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.258174:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782222346.258185:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004df7d8cd/0xe2b7cc26e6812794 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.258191:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0875803400 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:0.0:1782222346.258194:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004df7d8cd/0xe2b7cc26e6812794 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.258200:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004df7d8cd/0xe2b7cc26e6812794 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.258211:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004df7d8cd/0xe2b7cc26e6812794 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.258219:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222346.258220:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222346.258222:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222346.258949:0:18714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1782222346.258956:0:18714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004df7d8cd/0xe2b7cc26e6812794 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.258986:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782222346.261912:0:18714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782222346.261927:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f36ce283/0xe2b7cc26e681279b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.270502:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=545s v=(0 0) 00010000:00010000:1.0:1782222346.270507:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222346.270516:0:18714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f36ce283/0xe2b7cc26e681279b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.270532:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f36ce283/0xe2b7cc26e681279b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.270543:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f36ce283/0xe2b7cc26e681279b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.270552:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f36ce283/0xe2b7cc26e681279b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.271368:0:18714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782222346.272528:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782222346.272539:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f36ce283/0xe2b7cc26e681279b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.272552:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0875802600 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:1.0:1782222346.272560:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f36ce283/0xe2b7cc26e681279b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.272585:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f36ce283/0xe2b7cc26e681279b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.272605:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f36ce283/0xe2b7cc26e681279b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.272615:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f36ce283/0xe2b7cc26e681279b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782222346.272842:0:18714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782222346.272850:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052e01749/0xe2b7cc26e68127a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.272861:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=545s v=(0 0) 00010000:00010000:2.0:1782222346.272865:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782222346.272871:0:18714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052e01749/0xe2b7cc26e68127a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.272881:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052e01749/0xe2b7cc26e68127a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.272890:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052e01749/0xe2b7cc26e68127a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.272897:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052e01749/0xe2b7cc26e68127a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.272930:0:18714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782222346.273404:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782222346.273417:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052e01749/0xe2b7cc26e68127a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.273433:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb82a00 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:0.0:1782222346.273438:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052e01749/0xe2b7cc26e68127a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.273449:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052e01749/0xe2b7cc26e68127a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.273466:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222346.273476:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052e01749/0xe2b7cc26e68127a2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.273557:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052e01749/0xe2b7cc26e68127a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.273584:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222346.273586:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222346.273589:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782222346.274365:0:18714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782222346.274376:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003228a191/0xe2b7cc26e68127a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.274391:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=545s v=(0 0) 00010000:00010000:1.0:1782222346.274396:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222346.274403:0:18714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003228a191/0xe2b7cc26e68127a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.274417:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003228a191/0xe2b7cc26e68127a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.274428:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003228a191/0xe2b7cc26e68127a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.274446:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003228a191/0xe2b7cc26e68127a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.274464:0:18714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782222346.274474:0:17196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782222346.274483:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003228a191/0xe2b7cc26e68127a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.274491:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0875802a00 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:1.0:1782222346.274496:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003228a191/0xe2b7cc26e68127a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.274505:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003228a191/0xe2b7cc26e68127a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.274521:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003228a191/0xe2b7cc26e68127a9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.274529:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003228a191/0xe2b7cc26e68127a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.274548:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222346.274550:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222346.274552:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782222346.275045:0:18714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782222346.275058:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000112c0eba/0xe2b7cc26e68127b0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.275067:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=545s v=(0 0) 00010000:00010000:1.0:1782222346.275070:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222346.275075:0:18714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000112c0eba/0xe2b7cc26e68127b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.275085:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000112c0eba/0xe2b7cc26e68127b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.275094:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000112c0eba/0xe2b7cc26e68127b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.275101:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000112c0eba/0xe2b7cc26e68127b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.275126:0:18714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782222346.275196:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782222346.275202:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000112c0eba/0xe2b7cc26e68127b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.275210:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0875803600 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:2.0:1782222346.275214:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000112c0eba/0xe2b7cc26e68127b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.275223:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000112c0eba/0xe2b7cc26e68127b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.275259:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000112c0eba/0xe2b7cc26e68127b0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.275266:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000112c0eba/0xe2b7cc26e68127b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.275283:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222346.275285:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222346.275287:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782222346.275669:0:18714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782222346.275691:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092306314/0xe2b7cc26e68127b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.275708:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=545s v=(0 0) 00010000:00010000:1.0:1782222346.275712:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222346.275719:0:18714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092306314/0xe2b7cc26e68127b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.275743:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092306314/0xe2b7cc26e68127b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.275764:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092306314/0xe2b7cc26e68127b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.275771:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092306314/0xe2b7cc26e68127b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.275789:0:18714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782222346.275801:0:17196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782222346.275806:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092306314/0xe2b7cc26e68127b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.275814:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0875802e00 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:1.0:1782222346.275819:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092306314/0xe2b7cc26e68127b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.275829:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092306314/0xe2b7cc26e68127b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.275845:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092306314/0xe2b7cc26e68127b7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.275854:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092306314/0xe2b7cc26e68127b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.275873:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222346.275883:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222346.275885:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782222346.276665:0:18714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782222346.276675:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b53da69/0xe2b7cc26e68127be lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.276698:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=545s v=(0 0) 00010000:00010000:1.0:1782222346.276702:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222346.276707:0:18714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b53da69/0xe2b7cc26e68127be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.276717:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b53da69/0xe2b7cc26e68127be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.276736:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b53da69/0xe2b7cc26e68127be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.276743:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b53da69/0xe2b7cc26e68127be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.276769:0:18714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782222346.276779:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782222346.276784:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b53da69/0xe2b7cc26e68127be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.276793:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0875803a00 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:1.0:1782222346.276796:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b53da69/0xe2b7cc26e68127be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.276816:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b53da69/0xe2b7cc26e68127be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.276842:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b53da69/0xe2b7cc26e68127be lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.276850:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b53da69/0xe2b7cc26e68127be lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.276870:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222346.276872:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222346.276874:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782222346.277442:0:18714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782222346.277452:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011e59ddb/0xe2b7cc26e68127c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.277462:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=545s v=(0 0) 00010000:00010000:1.0:1782222346.277466:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222346.277470:0:18714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011e59ddb/0xe2b7cc26e68127c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.277548:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011e59ddb/0xe2b7cc26e68127c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.277561:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011e59ddb/0xe2b7cc26e68127c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.277576:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011e59ddb/0xe2b7cc26e68127c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.277596:0:18714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782222346.277606:0:17196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782222346.277611:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011e59ddb/0xe2b7cc26e68127c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.277621:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0875803c00 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:1.0:1782222346.277626:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011e59ddb/0xe2b7cc26e68127c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.277635:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011e59ddb/0xe2b7cc26e68127c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.277652:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011e59ddb/0xe2b7cc26e68127c5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.277659:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011e59ddb/0xe2b7cc26e68127c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.277679:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222346.277693:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222346.277696:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782222346.278290:0:18714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782222346.278306:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3b93038/0xe2b7cc26e68127cc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.278316:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=545s v=(0 0) 00010000:00010000:1.0:1782222346.278320:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222346.278324:0:18714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3b93038/0xe2b7cc26e68127cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.278335:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3b93038/0xe2b7cc26e68127cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.278344:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3b93038/0xe2b7cc26e68127cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.278351:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3b93038/0xe2b7cc26e68127cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.278368:0:18714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782222346.278377:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782222346.278382:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3b93038/0xe2b7cc26e68127cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.278391:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0875802400 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:1.0:1782222346.278395:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3b93038/0xe2b7cc26e68127cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.278403:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3b93038/0xe2b7cc26e68127cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.278422:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3b93038/0xe2b7cc26e68127cc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.278430:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3b93038/0xe2b7cc26e68127cc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.278449:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222346.278451:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222346.278453:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782222346.280285:0:18714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782222346.280301:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000109dcc64/0xe2b7cc26e68127d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.280319:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=545s v=(0 0) 00010000:00010000:1.0:1782222346.280324:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222346.280331:0:18714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000109dcc64/0xe2b7cc26e68127d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.280347:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000109dcc64/0xe2b7cc26e68127d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.280359:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000109dcc64/0xe2b7cc26e68127d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.280368:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000109dcc64/0xe2b7cc26e68127d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.280411:0:18714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782222346.280593:0:17196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782222346.280601:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000109dcc64/0xe2b7cc26e68127d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.280610:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0875803200 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:0.0:1782222346.280615:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000109dcc64/0xe2b7cc26e68127d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.280625:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000109dcc64/0xe2b7cc26e68127d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.281147:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000109dcc64/0xe2b7cc26e68127d3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.281159:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000109dcc64/0xe2b7cc26e68127d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.281192:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222346.281194:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222346.281196:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782222346.282223:0:18714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782222346.282269:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1f1e1d0/0xe2b7cc26e68127da lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.282284:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=545s v=(0 0) 00010000:00010000:1.0:1782222346.282289:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222346.282295:0:18714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1f1e1d0/0xe2b7cc26e68127da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.282310:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1f1e1d0/0xe2b7cc26e68127da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.282322:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1f1e1d0/0xe2b7cc26e68127da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.282330:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1f1e1d0/0xe2b7cc26e68127da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.282358:0:18714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782222346.282597:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782222346.282606:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1f1e1d0/0xe2b7cc26e68127da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.282617:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0875803800 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:0.0:1782222346.282623:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1f1e1d0/0xe2b7cc26e68127da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.282634:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1f1e1d0/0xe2b7cc26e68127da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.282659:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1f1e1d0/0xe2b7cc26e68127da lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.282668:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1f1e1d0/0xe2b7cc26e68127da lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.282708:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222346.282711:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222346.282713:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782222346.283476:0:18714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782222346.283790:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2259427/0xe2b7cc26e68127e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.283808:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=545s v=(0 0) 00010000:00010000:1.0:1782222346.283823:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222346.283830:0:18714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2259427/0xe2b7cc26e68127e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.283854:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2259427/0xe2b7cc26e68127e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.283866:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2259427/0xe2b7cc26e68127e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.283876:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2259427/0xe2b7cc26e68127e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.283904:0:18714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782222346.283919:0:17196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782222346.283924:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2259427/0xe2b7cc26e68127e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.283933:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0875802200 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:1.0:1782222346.283938:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2259427/0xe2b7cc26e68127e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.283947:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2259427/0xe2b7cc26e68127e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.283963:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2259427/0xe2b7cc26e68127e1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.284853:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2259427/0xe2b7cc26e68127e1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.284888:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222346.284890:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222346.284893:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782222346.286059:0:18714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782222346.286074:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc64c75d/0xe2b7cc26e68127e8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.286094:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=545s v=(0 0) 00010000:00010000:1.0:1782222346.286100:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222346.286108:0:18714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc64c75d/0xe2b7cc26e68127e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.286124:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc64c75d/0xe2b7cc26e68127e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.286135:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc64c75d/0xe2b7cc26e68127e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.286144:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc64c75d/0xe2b7cc26e68127e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.286175:0:18714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782222346.286568:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782222346.286577:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc64c75d/0xe2b7cc26e68127e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.286587:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0875802800 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:0.0:1782222346.286592:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc64c75d/0xe2b7cc26e68127e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.286617:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc64c75d/0xe2b7cc26e68127e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.286638:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc64c75d/0xe2b7cc26e68127e8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.286647:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc64c75d/0xe2b7cc26e68127e8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.286676:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222346.286678:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222346.286680:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782222346.287601:0:18714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782222346.287620:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4d5c8c4/0xe2b7cc26e68127ef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.287634:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=545s v=(0 0) 00010000:00010000:1.0:1782222346.287639:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222346.287645:0:18714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4d5c8c4/0xe2b7cc26e68127ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.287659:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4d5c8c4/0xe2b7cc26e68127ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.287670:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4d5c8c4/0xe2b7cc26e68127ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.287679:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4d5c8c4/0xe2b7cc26e68127ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.287898:0:18714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782222346.287920:0:17196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782222346.287927:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4d5c8c4/0xe2b7cc26e68127ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.287937:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0875802000 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:1.0:1782222346.287944:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4d5c8c4/0xe2b7cc26e68127ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.287955:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4d5c8c4/0xe2b7cc26e68127ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.288548:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4d5c8c4/0xe2b7cc26e68127ef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.288556:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4d5c8c4/0xe2b7cc26e68127ef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.288584:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222346.288586:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222346.288588:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782222346.289414:0:18714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782222346.289425:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa453043/0xe2b7cc26e68127f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.289438:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=545s v=(0 0) 00010000:00010000:1.0:1782222346.289443:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222346.289450:0:18714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa453043/0xe2b7cc26e68127f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.289463:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa453043/0xe2b7cc26e68127f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.289474:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa453043/0xe2b7cc26e68127f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.289804:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa453043/0xe2b7cc26e68127f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.290065:0:18714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782222346.290165:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782222346.290177:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa453043/0xe2b7cc26e68127f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.290189:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0875803e00 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:0.0:1782222346.290195:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa453043/0xe2b7cc26e68127f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.290206:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa453043/0xe2b7cc26e68127f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.290229:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa453043/0xe2b7cc26e68127f6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.291353:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa453043/0xe2b7cc26e68127f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.291405:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222346.291408:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222346.291414:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782222346.293204:0:18714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782222346.293230:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004df7d8cd/0xe2b7cc26e68127fd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.293282:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=545s v=(0 0) 00010000:00010000:1.0:1782222346.293289:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222346.293297:0:18714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004df7d8cd/0xe2b7cc26e68127fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.293320:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004df7d8cd/0xe2b7cc26e68127fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.293334:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004df7d8cd/0xe2b7cc26e68127fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.293344:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004df7d8cd/0xe2b7cc26e68127fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.293377:0:18714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782222346.293392:0:17196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782222346.293399:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004df7d8cd/0xe2b7cc26e68127fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.293408:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0875803400 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:1.0:1782222346.293423:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004df7d8cd/0xe2b7cc26e68127fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.293435:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004df7d8cd/0xe2b7cc26e68127fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.293459:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004df7d8cd/0xe2b7cc26e68127fd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.293467:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004df7d8cd/0xe2b7cc26e68127fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.293488:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222346.293491:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222346.293493:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782222346.294530:0:18714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782222346.294544:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000994a65a7/0xe2b7cc26e6812804 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.294559:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=545s v=(0 0) 00010000:00010000:1.0:1782222346.294563:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222346.294569:0:18714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000994a65a7/0xe2b7cc26e6812804 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.294583:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000994a65a7/0xe2b7cc26e6812804 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.294594:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000994a65a7/0xe2b7cc26e6812804 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.294613:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000994a65a7/0xe2b7cc26e6812804 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.294679:0:18714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782222346.299123:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782222346.299142:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000994a65a7/0xe2b7cc26e6812804 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.299302:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0875803000 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:0.0:1782222346.299309:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000994a65a7/0xe2b7cc26e6812804 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.299323:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000994a65a7/0xe2b7cc26e6812804 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.299356:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000994a65a7/0xe2b7cc26e6812804 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.299365:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000994a65a7/0xe2b7cc26e6812804 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782222346.300116:0:18714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782222346.300129:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f36ce283/0xe2b7cc26e681280b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.300148:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=545s v=(0 0) 00010000:00010000:1.0:1782222346.300154:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222346.300162:0:18714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f36ce283/0xe2b7cc26e681280b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.300179:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f36ce283/0xe2b7cc26e681280b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.300191:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f36ce283/0xe2b7cc26e681280b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.300200:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f36ce283/0xe2b7cc26e681280b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.300268:0:18714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782222346.300792:0:17196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1782222346.302090:0:18714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782222346.302107:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f37e98d3/0xe2b7cc26e6812812 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.302139:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=545s v=(0 0) 00010000:00010000:1.0:1782222346.302144:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222346.302151:0:18714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f37e98d3/0xe2b7cc26e6812812 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.302168:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f37e98d3/0xe2b7cc26e6812812 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.302179:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f37e98d3/0xe2b7cc26e6812812 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.302187:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f37e98d3/0xe2b7cc26e6812812 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.302200:0:18714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:3.0:1782222346.302629:0:19527:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1782222346.302762:0:19527:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1782222346.302772:0:19527:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1782222346.303073:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782222346.303082:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f37e98d3/0xe2b7cc26e6812812 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.303106:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0875802c00 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:0.0:1782222346.303113:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f37e98d3/0xe2b7cc26e6812812 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.303127:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f37e98d3/0xe2b7cc26e6812812 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.303161:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f37e98d3/0xe2b7cc26e6812812 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.303169:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f37e98d3/0xe2b7cc26e6812812 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.303194:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222346.303196:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222346.303197:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782222346.303408:0:18714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782222346.303416:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa660f74/0xe2b7cc26e6812819 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.303425:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=545s v=(0 0) 00010000:00010000:1.0:1782222346.303429:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222346.303434:0:18714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa660f74/0xe2b7cc26e6812819 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.303445:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa660f74/0xe2b7cc26e6812819 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.303466:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa660f74/0xe2b7cc26e6812819 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.303474:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa660f74/0xe2b7cc26e6812819 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.303491:0:18714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782222346.305399:0:19827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17951:x1868795081868032:12345-0@lo:5:osp-pre-1-1.0 Request processed in 49591us (50272us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1782222346.305416:0:19827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1782222346.305528:0:19828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782222346.305549:0:19828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa660f74/0xe2b7cc26e6812819 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.305562:0:19828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0841458800 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:2.0:1782222346.305567:0:19828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa660f74/0xe2b7cc26e6812819 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.305579:0:19828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa660f74/0xe2b7cc26e6812819 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.305612:0:19828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa660f74/0xe2b7cc26e6812819 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.305619:0:19828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa660f74/0xe2b7cc26e6812819 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.305648:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f36ce283/0xe2b7cc26e681280b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.305655:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0875802600 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:2.0:1782222346.305658:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f36ce283/0xe2b7cc26e681280b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.305665:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f36ce283/0xe2b7cc26e681280b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.305676:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f36ce283/0xe2b7cc26e681280b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782222346.306289:0:18714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782222346.306303:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e33fb76f/0xe2b7cc26e6812820 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.306321:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=545s v=(0 0) 00010000:00010000:1.0:1782222346.306326:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222346.306335:0:18714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e33fb76f/0xe2b7cc26e6812820 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.306352:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e33fb76f/0xe2b7cc26e6812820 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.306364:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e33fb76f/0xe2b7cc26e6812820 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.306371:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e33fb76f/0xe2b7cc26e6812820 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.306402:0:18714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782222346.308182:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f36ce283/0xe2b7cc26e681280b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.308218:0:17196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782222346.308223:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e33fb76f/0xe2b7cc26e6812820 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.308320:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0841459c00 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:2.0:1782222346.308327:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e33fb76f/0xe2b7cc26e6812820 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.308339:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e33fb76f/0xe2b7cc26e6812820 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.308361:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e33fb76f/0xe2b7cc26e6812820 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.308369:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e33fb76f/0xe2b7cc26e6812820 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.308384:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222346.308385:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222346.308388:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222346.308402:0:19828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222346.308405:0:19828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222346.308407:0:19828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782222346.309409:0:18714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782222346.309420:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6515f7c/0xe2b7cc26e6812827 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.309436:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=545s v=(0 0) 00010000:00010000:2.0:1782222346.309440:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782222346.309448:0:18714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6515f7c/0xe2b7cc26e6812827 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.309461:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6515f7c/0xe2b7cc26e6812827 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.309472:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6515f7c/0xe2b7cc26e6812827 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.309480:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6515f7c/0xe2b7cc26e6812827 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.309504:0:18714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782222346.309515:0:17196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782222346.309520:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6515f7c/0xe2b7cc26e6812827 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.309528:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83000 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:2.0:1782222346.309532:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6515f7c/0xe2b7cc26e6812827 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.309554:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6515f7c/0xe2b7cc26e6812827 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.309568:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6515f7c/0xe2b7cc26e6812827 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.309576:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6515f7c/0xe2b7cc26e6812827 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.309594:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222346.309595:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222346.309597:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222346.313938:0:17951:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1782222346.313962:0:17951:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07475aa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17951:1868795081868032:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1782222346.314136:0:17951:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00002000:00010000:2.0:1782222346.314172:0:18714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782222346.314187:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061b8e0dc/0xe2b7cc26e681282e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.314204:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=545s v=(0 0) 00010000:00010000:2.0:1782222346.314209:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782222346.314215:0:18714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061b8e0dc/0xe2b7cc26e681282e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222346.314261:0:17951:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07475aa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17951:1868795081868160:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1782222346.314339:0:17951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222346.314395:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081868160 00000100:00100000:3.0:1782222346.314402:0:17219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081868160 00000100:00100000:3.0:1782222346.314460:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782222346.314468:0:17219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17951:x1868795081868160:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1782222346.314526:0:17219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17951:x1868795081868160:12345-0@lo:900:osp-pre-1-1.0 Request processed in 58us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222346.314535:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782222346.314562:0:17951:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0850341180 going to sleep for 11 seconds 00010000:00080000:3.0:1782222346.314579:0:17951:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f07475aa680 x1868795081868160/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1782222362 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222346.314590:0:17951:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07475aa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17951:1868795081868160:0@lo:900:osp-pre-1-1.0 00010000:00010000:0.0:1782222346.315926:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222346.316313:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061b8e0dc/0xe2b7cc26e681282e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.316339:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061b8e0dc/0xe2b7cc26e681282e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.316369:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061b8e0dc/0xe2b7cc26e681282e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.316399:0:18714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1782222346.318228:0:18714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782222346.318327:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b72f0ca3/0xe2b7cc26e6812835 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.318344:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=545s v=(0 0) 00010000:00010000:2.0:1782222346.318347:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782222346.318353:0:18714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b72f0ca3/0xe2b7cc26e6812835 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.318367:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b72f0ca3/0xe2b7cc26e6812835 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.318376:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b72f0ca3/0xe2b7cc26e6812835 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.318383:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b72f0ca3/0xe2b7cc26e6812835 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.318402:0:18714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1782222346.318414:0:17196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782222346.318420:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061b8e0dc/0xe2b7cc26e681282e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.318441:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb82600 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:2.0:1782222346.318446:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061b8e0dc/0xe2b7cc26e681282e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.318459:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061b8e0dc/0xe2b7cc26e681282e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.318479:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061b8e0dc/0xe2b7cc26e681282e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.318488:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061b8e0dc/0xe2b7cc26e681282e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.318510:0:17196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782222346.318514:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b72f0ca3/0xe2b7cc26e6812835 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.318521:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb82800 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:2.0:1782222346.318526:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b72f0ca3/0xe2b7cc26e6812835 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.318534:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b72f0ca3/0xe2b7cc26e6812835 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.318545:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b72f0ca3/0xe2b7cc26e6812835 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.318559:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b72f0ca3/0xe2b7cc26e6812835 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222346.318573:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222346.318574:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222346.318576:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222346.319156:0:19828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782222346.320764:0:18714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782222346.320787:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053c1fc32/0xe2b7cc26e681283c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.320814:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=545s v=(0 0) 00010000:00010000:0.0:1782222346.320820:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782222346.320827:0:18714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053c1fc32/0xe2b7cc26e681283c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.320876:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053c1fc32/0xe2b7cc26e681283c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.320888:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053c1fc32/0xe2b7cc26e681283c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.320897:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053c1fc32/0xe2b7cc26e681283c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222346.322330:0:18714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1782222346.322480:0:18714:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:0.0:1782222346.322620:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17235:x1868795081867520:12345-0@lo:5:osp-pre-1-0.0 Request processed in 96165us (96504us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222346.322634:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782222346.322726:0:17235:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17235:1868795081867520:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1782222346.322746:0:17235:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1782222346.322811:0:17235:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747782300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17235:1868795081868288:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1782222346.322853:0:17235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222346.322892:0:17235:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0746415480 going to sleep for 11 seconds 00000100:00100000:0.0:1782222346.322917:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081868288 00000100:00100000:0.0:1782222346.322925:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081868288 00000100:00100000:0.0:1782222346.323455:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782222346.323468:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17235:x1868795081868288:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1782222346.323537:0:18714:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:1.0:1782222346.330057:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782222346.330080:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053c1fc32/0xe2b7cc26e681283c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.330103:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb8c00 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:1.0:1782222346.330110:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053c1fc32/0xe2b7cc26e681283c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.330127:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053c1fc32/0xe2b7cc26e681283c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.330163:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053c1fc32/0xe2b7cc26e681283c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.330172:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053c1fc32/0xe2b7cc26e681283c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222346.330360:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222346.330364:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782222346.330369:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782222346.334845:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17235:x1868795081868288:12345-0@lo:5:osp-pre-1-0.0 Request processed in 11367us (11979us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1782222346.334861:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782222346.335098:0:17235:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747782300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17235:1868795081868288:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1782222346.335127:0:17235:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000001:02000400:0.0:1782222346.997867:0:19886:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1782222347.051877:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782222347.693005:0:17242:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1782222347.974966:0:19938:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782222347.975521:0:19938:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1782222348.075299:0:19828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1782222348.971421:0:19988:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782222348.971647:0:19988:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1782222349.105486:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222349.206752:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222349.206844:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060801664 00000100:00100000:0.0:1782222349.206854:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060801664 00000100:00100000:0.0:1782222349.207037:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 114 00000100:00100000:0.0:1782222349.207055:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f4f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2386:x1868795060801664:12345-192.168.203.27@tcp:250:mount.lustre.0 00010000:00080000:0.0:1782222349.207084:0:17201:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from d0274066-4ed8-4dcc-b7c7-6f5c024ab825@192.168.203.27@tcp t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:0.0:1782222349.207110:0:17201:0:(genops.c:1406:class_connect()) connect: client d0274066-4ed8-4dcc-b7c7-6f5c024ab825, cookie 0xe2b7cc26e6812843 00000100:00080000:0.0:1782222349.207297:0:17201:0:(import.c:65:import_set_state_nolock()) ffff8f084fd19800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782222349.207374:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f4f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+5:2386:x1868795060801664:12345-192.168.203.27@tcp:250:mount.lustre.0 Request processed in 327us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222349.207382:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 114 00000100:00100000:0.0:1782222349.217742:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222349.217879:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060801792 00000100:00100000:2.0:1782222349.217894:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060801792 00000100:00100000:2.0:1782222349.217981:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 115 00000100:00100000:2.0:1782222349.217999:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f4f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+5:14917:x1868795060801792:12345-192.168.203.27@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782222349.218022:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222349.218047:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f087fb82600/0xe2b7cc26e681284a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x558f77f2f75587fb expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222349.218087:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fb82600/0xe2b7cc26e681284a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587fb expref: 6 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222349.218104:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f087fb82600/0xe2b7cc26e681284a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75587fb expref: 6 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222349.218117:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb82600, rc 0) 00000100:00100000:2.0:1782222349.218204:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f4f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+6:14917:x1868795060801792:12345-192.168.203.27@tcp:101:mount.lustre.0 Request processed in 207us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222349.218280:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 115 00000100:00100000:3.0:1782222349.225410:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222349.225598:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060801920 00000100:00100000:0.0:1782222349.225607:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060801920 00000100:00100000:0.0:1782222349.225668:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 116 00000100:00100000:0.0:1782222349.225678:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f4f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+6:14917:x1868795060801920:12345-192.168.203.27@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782222349.225812:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f4f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+6:14917:x1868795060801920:12345-192.168.203.27@tcp:501:mount.lustre.0 Request processed in 135us (412us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782222349.225820:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 116 00000100:00100000:2.0:1782222349.228997:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222349.229105:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060802048 00000100:00100000:0.0:1782222349.229132:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060802048 00000100:00100000:0.0:1782222349.229221:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 117 00000100:00100000:0.0:1782222349.229299:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f4f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+6:14917:x1868795060802048:12345-192.168.203.27@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782222349.229338:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222349.229361:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f087fcb9e00/0xe2b7cc26e6812851 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558802 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222349.229397:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fcb9e00/0xe2b7cc26e6812851 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558802 expref: 7 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222349.229412:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f087fcb9e00/0xe2b7cc26e6812851 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558802 expref: 7 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222349.229424:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fcb9e00, rc 0) 00000100:00100000:0.0:1782222349.229490:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f4f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+7:14917:x1868795060802048:12345-192.168.203.27@tcp:101:mount.lustre.0 Request processed in 258us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222349.229496:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 117 00000100:00100000:3.0:1782222349.236981:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222349.237088:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060802176 00000100:00100000:2.0:1782222349.237105:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060802176 00000100:00100000:2.0:1782222349.237185:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 118 00000100:00100000:2.0:1782222349.237197:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f4f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+7:14917:x1868795060802176:12345-192.168.203.27@tcp:501:mount.lustre.0 00000100:00100000:2.0:1782222349.237435:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f4f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+8:14917:x1868795060802176:12345-192.168.203.27@tcp:501:mount.lustre.0 Request processed in 241us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222349.237445:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 118 00000100:00100000:0.0:1782222349.245535:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222349.245985:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060802304 00000100:00100000:3.0:1782222349.245995:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060802304 00000100:00100000:3.0:1782222349.246049:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 119 00000100:00100000:3.0:1782222349.246059:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f4f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+8:14917:x1868795060802304:12345-192.168.203.27@tcp:503:mount.lustre.0 00000100:00100000:3.0:1782222349.246289:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f4f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+8:14917:x1868795060802304:12345-192.168.203.27@tcp:503:mount.lustre.0 Request processed in 230us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222349.246299:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 119 00000100:00100000:2.0:1782222349.259556:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222349.260488:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060802432 00000100:00100000:3.0:1782222349.260499:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060802432 00000100:00100000:3.0:1782222349.262711:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 120 00000100:00100000:3.0:1782222349.262730:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087eecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+8:14936:x1868795060802432:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782222349.262901:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087eecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+8:14936:x1868795060802432:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 175us (3352us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222349.262920:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 120 00000100:00100000:0.0:1782222349.345619:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222349.345694:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060802560 00000100:00100000:2.0:1782222349.345705:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060802560 00000100:00100000:2.0:1782222349.345765:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 121 00000100:00100000:2.0:1782222349.345775:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087eec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+8:14936:x1868795060802560:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782222349.345973:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087eec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+8:14936:x1868795060802560:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 197us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222349.345981:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 121 00000100:00100000:1.0:1782222349.355536:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222349.355775:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060802688 00000100:00100000:3.0:1782222349.355786:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060802688 00000100:00100000:3.0:1782222349.355850:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 122 00000100:00100000:3.0:1782222349.355859:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087eec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+8:14936:x1868795060802688:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782222349.356028:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087eec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+8:14936:x1868795060802688:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 169us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222349.356036:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 122 00000100:00100000:0.0:1782222349.365205:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222349.365330:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060802816 00000100:00100000:3.0:1782222349.365340:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060802816 00000100:00100000:3.0:1782222349.365387:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 123 00000100:00100000:3.0:1782222349.365396:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087eeca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+8:14917:x1868795060802816:12345-192.168.203.27@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782222349.365413:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222349.365430:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f08483ecc00/0xe2b7cc26e6812858 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558833 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222349.365456:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f08483ecc00/0xe2b7cc26e6812858 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558833 expref: 9 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222349.365467:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f08483ecc00/0xe2b7cc26e6812858 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558833 expref: 9 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222349.365475:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f08483ecc00, rc 0) 00000100:00100000:3.0:1782222349.365523:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087eeca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+9:14917:x1868795060802816:12345-192.168.203.27@tcp:101:mount.lustre.0 Request processed in 128us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222349.365530:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 123 00000100:00100000:0.0:1782222349.373146:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222349.373280:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060802944 00000100:00100000:2.0:1782222349.373290:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060802944 00000100:00100000:2.0:1782222349.373348:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 124 00000100:00100000:2.0:1782222349.373357:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087eeca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+9:14917:x1868795060802944:12345-192.168.203.27@tcp:256:mount.lustre.0 20000000:01000000:2.0:1782222349.373384:0:17202:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1782222349.373418:0:17202:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1782222349.373425:0:17202:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1782222349.373431:0:17202:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1782222349.373443:0:17202:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1782222349.373446:0:17202:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1782222349.376739:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087eeca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+9:14917:x1868795060802944:12345-192.168.203.27@tcp:256:mount.lustre.0 Request processed in 3371us (3591us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222349.376759:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 124 00000100:00100000:0.0:1782222349.382154:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222349.382264:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060803072 00000100:00100000:3.0:1782222349.382274:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060803072 00000100:00100000:3.0:1782222349.382327:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 125 00000100:00100000:3.0:1782222349.382337:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087eec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+9:14917:x1868795060803072:12345-192.168.203.27@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782222349.382355:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222349.382372:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f08483ed200/0xe2b7cc26e681285f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x558f77f2f755883a expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222349.382400:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f08483ed200/0xe2b7cc26e681285f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755883a expref: 10 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222349.382416:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f08483ed200/0xe2b7cc26e681285f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755883a expref: 10 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222349.382424:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f08483ed200, rc 0) 00000100:00100000:3.0:1782222349.382484:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087eec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+10:14917:x1868795060803072:12345-192.168.203.27@tcp:101:mount.lustre.0 Request processed in 147us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222349.382491:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 125 00000100:00100000:0.0:1782222349.387193:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222349.387325:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060803200 00000100:00100000:2.0:1782222349.387335:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060803200 00000100:00100000:2.0:1782222349.387389:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 126 00000100:00100000:2.0:1782222349.387399:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087eecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+10:14917:x1868795060803200:12345-192.168.203.27@tcp:501:mount.lustre.0 00000100:00100000:2.0:1782222349.387553:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087eecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+10:14917:x1868795060803200:12345-192.168.203.27@tcp:501:mount.lustre.0 Request processed in 155us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222349.387562:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 126 00000100:00100000:1.0:1782222349.389464:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222349.389566:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060803328 00000100:00100000:2.0:1782222349.389575:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060803328 00000100:00100000:2.0:1782222349.389632:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 127 00000100:00100000:2.0:1782222349.389642:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087eecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+10:14917:x1868795060803328:12345-192.168.203.27@tcp:503:mount.lustre.0 00000100:00100000:2.0:1782222349.390217:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087eecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+10:14917:x1868795060803328:12345-192.168.203.27@tcp:503:mount.lustre.0 Request processed in 153us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222349.390229:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 127 00000100:00100000:0.0:1782222349.401230:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222349.401815:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060803456 00000100:00100000:3.0:1782222349.401837:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060803456 00000100:00100000:3.0:1782222349.401898:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 128 00000100:00100000:3.0:1782222349.401908:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+10:14941:x1868795060803456:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782222349.402075:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+10:14941:x1868795060803456:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 168us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222349.402084:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 128 00000100:00100000:0.0:1782222349.407389:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222349.407486:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060803584 00000100:00100000:2.0:1782222349.407496:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060803584 00000100:00100000:2.0:1782222349.407550:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 129 00000100:00100000:2.0:1782222349.407559:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+10:14941:x1868795060803584:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782222349.407719:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+10:14941:x1868795060803584:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 160us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222349.407727:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 129 00000100:00100000:1.0:1782222349.418907:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222349.418999:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060803712 00000100:00100000:3.0:1782222349.419009:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060803712 00000100:00100000:3.0:1782222349.419072:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 7 00000100:00100000:3.0:1782222349.419081:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2386:x1868795060803712:12345-192.168.203.27@tcp:38:mount.lustre.0 00010000:00080000:3.0:1782222349.419110:0:17210:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 8d3282c7-c1ac-4cf8-a606-482b3aabf172@192.168.203.27@tcp t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:3.0:1782222349.419159:0:17210:0:(genops.c:1406:class_connect()) connect: client 8d3282c7-c1ac-4cf8-a606-482b3aabf172, cookie 0xe2b7cc26e6812866 00000004:00100000:3.0:1782222349.419184:0:17210:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1782222349.419416:0:17210:0:(import.c:65:import_set_state_nolock()) ffff8f07466dd800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782222349.419479:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+6:2386:x1868795060803712:12345-192.168.203.27@tcp:38:mount.lustre.0 Request processed in 397us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222349.419487:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 7 00000100:00100000:0.0:1782222349.423078:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222349.423188:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060803968 00000100:00100000:2.0:1782222349.423199:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060803968 00000100:00100000:2.0:1782222349.423284:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 8 00000100:00100000:2.0:1782222349.423293:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2386:x1868795060803968:12345-192.168.203.27@tcp:38:mount.lustre.0 00010000:00080000:2.0:1782222349.423326:0:17209:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 8d3282c7-c1ac-4cf8-a606-482b3aabf172@192.168.203.27@tcp t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:2.0:1782222349.423380:0:17209:0:(genops.c:1406:class_connect()) connect: client 8d3282c7-c1ac-4cf8-a606-482b3aabf172, cookie 0xe2b7cc26e681286d 00000004:00100000:2.0:1782222349.423405:0:17209:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1782222349.423587:0:17209:0:(import.c:65:import_set_state_nolock()) ffff8f07460e5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782222349.423648:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+6:2386:x1868795060803968:12345-192.168.203.27@tcp:38:mount.lustre.0 Request processed in 355us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222349.423655:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 8 00000100:00100000:0.0:1782222349.435288:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222349.435333:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222349.435468:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060804096 00000100:00100000:3.0:1782222349.435478:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060804096 00000100:00100000:3.0:1782222349.435547:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060803840 00000100:00100000:3.0:1782222349.435550:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060803840 00000100:00100000:3.0:1782222349.435575:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 9 00000100:00100000:3.0:1782222349.435584:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+6:0:x1868795060804096:12345-192.168.203.27@tcp:41:mount.lustre.0 00000004:00000024:3.0:1782222349.435621:0:17210:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1782222349.435706:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+6:0:x1868795060804096:12345-192.168.203.27@tcp:41:mount.lustre.0 Request processed in 122us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222349.435713:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 9 00000100:00100000:3.0:1782222349.435731:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 10 00000100:00100000:3.0:1782222349.435737:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+6:0:x1868795060803840:12345-192.168.203.27@tcp:41:mount.lustre.0 00000004:00000024:3.0:1782222349.435753:0:17210:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1782222349.435788:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+6:0:x1868795060803840:12345-192.168.203.27@tcp:41:mount.lustre.0 Request processed in 50us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222349.435794:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 10 00000100:00080000:0.0:1782222349.436149:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782222349.436154:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782222349.436715:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222349.436780:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060804224 00000100:00100000:3.0:1782222349.436786:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060804224 00000100:00100000:3.0:1782222349.436862:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 11 00000100:00100000:3.0:1782222349.436871:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+6:14917:x1868795060804224:12345-192.168.203.27@tcp:41:mount.lustre.0 00000004:00000024:3.0:1782222349.436901:0:17210:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1782222349.436949:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+6:14917:x1868795060804224:12345-192.168.203.27@tcp:41:mount.lustre.0 Request processed in 79us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222349.436956:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 11 00000100:00100000:0.0:1782222349.457373:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222349.457486:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060804352 00000100:00100000:2.0:1782222349.457497:0:19481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060804352 00000100:00100000:2.0:1782222349.457559:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 12 00000100:00100000:2.0:1782222349.457569:0:19481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+6:14917:x1868795060804352:12345-192.168.203.27@tcp:40:mount.lustre.0 00000100:00100000:2.0:1782222349.457670:0:19481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+6:14917:x1868795060804352:12345-192.168.203.27@tcp:40:mount.lustre.0 Request processed in 92us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222349.457677:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 12 00000100:00100000:0.0:1782222349.467640:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222349.467692:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222349.467727:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222349.467830:0:19827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060804480 00000100:00100000:2.0:1782222349.467841:0:19827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060804480 00000100:00100000:2.0:1782222349.467879:0:19827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060804608 00000100:00100000:2.0:1782222349.467882:0:19827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060804608 00000100:00100000:2.0:1782222349.467900:0:19827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 19 00000100:00100000:2.0:1782222349.467907:0:19827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2386:x1868795060804480:12345-192.168.203.27@tcp:8:mount.lustre.0 00010000:00080000:2.0:1782222349.467941:0:19827:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 8d3282c7-c1ac-4cf8-a606-482b3aabf172@192.168.203.27@tcp t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:2.0:1782222349.467972:0:19827:0:(genops.c:1406:class_connect()) connect: client 8d3282c7-c1ac-4cf8-a606-482b3aabf172, cookie 0xe2b7cc26e6812874 00002000:00100000:2.0:1782222349.467995:0:19827:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8d3282c7-c1ac-4cf8-a606-482b3aabf172/ffff8f07470fe800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782222349.468012:0:19827:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782222349.468180:0:19827:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1782222349.468223:0:19827:0:(import.c:65:import_set_state_nolock()) ffff8f07470fe000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782222349.468313:0:19827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+6:2386:x1868795060804480:12345-192.168.203.27@tcp:8:mount.lustre.0 Request processed in 404us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222349.468321:0:19827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 19 00000100:00100000:2.0:1782222349.468338:0:19827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 20 00000100:00100000:2.0:1782222349.468343:0:19827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2386:x1868795060804608:12345-192.168.203.27@tcp:8:mount.lustre.0 00010000:00080000:2.0:1782222349.468360:0:19827:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 8d3282c7-c1ac-4cf8-a606-482b3aabf172@192.168.203.27@tcp t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:2.0:1782222349.468376:0:19827:0:(genops.c:1406:class_connect()) connect: client 8d3282c7-c1ac-4cf8-a606-482b3aabf172, cookie 0xe2b7cc26e681287b 00002000:00100000:2.0:1782222349.468384:0:19827:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8d3282c7-c1ac-4cf8-a606-482b3aabf172/ffff8f07464a5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782222349.468397:0:19827:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782222349.468487:0:19827:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1782222349.468502:0:19827:0:(import.c:65:import_set_state_nolock()) ffff8f07464a3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782222349.468526:0:19827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+6:2386:x1868795060804608:12345-192.168.203.27@tcp:8:mount.lustre.0 Request processed in 181us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222349.468532:0:19827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 20 00000100:00100000:3.0:1782222349.468768:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060804736 00000100:00100000:3.0:1782222349.468774:0:17219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060804736 00000100:00100000:3.0:1782222349.468823:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 3 00000100:00100000:3.0:1782222349.468831:0:17219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8d3282c7-c1ac-4cf8-a606-482b3aabf172+6:14917:x1868795060804736:12345-192.168.203.27@tcp:900:mount.lustre.0 00000100:00100000:3.0:1782222349.468868:0:17219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8d3282c7-c1ac-4cf8-a606-482b3aabf172+6:14917:x1868795060804736:12345-192.168.203.27@tcp:900:mount.lustre.0 Request processed in 38us (1236us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222349.468874:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 3 00000100:00100000:1.0:1782222349.472277:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222349.472458:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060804864 00000100:00100000:3.0:1782222349.472468:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060804864 00000100:00100000:3.0:1782222349.472520:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 0 00000100:00100000:3.0:1782222349.472531:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8d3282c7-c1ac-4cf8-a606-482b3aabf172+6:14917:x1868795060804864:12345-192.168.203.27@tcp:33:mount.lustre.0 00000004:00080000:1.0:1782222349.474330:0:17211:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1718us 00000004:00200000:1.0:1782222349.508439:0:17211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1782222349.508636:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8d3282c7-c1ac-4cf8-a606-482b3aabf172+6:14917:x1868795060804864:12345-192.168.203.27@tcp:33:mount.lustre.0 Request processed in 36028us (36322us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222349.508653:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 0 00000100:00100000:0.0:1782222349.736907:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222349.737081:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060804992 00000100:00100000:1.0:1782222349.737098:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060804992 00000100:00100000:1.0:1782222349.737164:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 13 00000100:00100000:1.0:1782222349.737175:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+6:14964:x1868795060804992:12345-192.168.203.27@tcp:101:mkdir.0 00010000:00010000:1.0:1782222349.737200:0:17209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222349.737225:0:17209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458600/0xe2b7cc26e6812882 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755886b expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222349.737328:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458c00/0xe2b7cc26e6812889 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222349.737341:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458c00/0xe2b7cc26e6812889 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222349.737355:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458c00/0xe2b7cc26e6812889 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782222349.737400:0:17209:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782222349.737404:0:17209:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782222349.737449:0:17209:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458c00/0xe2b7cc26e6812889 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222349.737474:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458600/0xe2b7cc26e6812882 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755886b expref: 8 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222349.737491:0:17209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458c00/0xe2b7cc26e6812889 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755886b expref: 7 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222349.737500:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0843b9b000) 00010000:00010000:1.0:1782222349.737503:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782222349.737506:0:17209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0841458c00, rc 0) 00000100:00100000:1.0:1782222349.737564:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+7:14964:x1868795060804992:12345-192.168.203.27@tcp:101:mkdir.0 Request processed in 391us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222349.737571:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 13 00010000:00010000:1.0:1782222350.128955:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782222350.314603:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081868544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782222350.314684:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222350.314891:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081868544 00000100:00100000:2.0:1782222350.314899:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081868544 00000100:00100000:2.0:1782222350.314958:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782222350.314969:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088159ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081868544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782222350.314992:0:18718:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1782222350.315049:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088159ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081868544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222350.315072:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782222350.315316:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782222350.315330:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081868416:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782222350.315367:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1782222350.315630:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782222350.315680:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081868544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782222350.316022:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081868416 00000100:00100000:2.0:1782222350.316028:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081868416 00000100:00100000:2.0:1782222350.316070:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782222350.316199:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081868416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782222350.316231:0:17213:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1782222350.316412:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081868416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 334us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222350.316419:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1782222350.316754:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081868416:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782222350.317228:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782222350.317257:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081868672:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782222350.317442:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222350.317793:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081868800:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782222350.317826:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222350.317904:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081868800 00000100:00100000:0.0:1782222350.317910:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081868800 00000100:00100000:0.0:1782222350.317965:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782222350.317974:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081868800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782222350.318066:0:18718:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1782222350.318177:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081868800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 203us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222350.318184:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782222350.318228:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081868800:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782222350.318425:0:18230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081868672 00000100:00100000:2.0:1782222350.318430:0:18230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081868672 00000100:00100000:2.0:1782222350.318466:0:18230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782222350.318474:0:18230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081868672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782222350.318502:0:18230:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1782222350.318541:0:18230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081868672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222350.318547:0:18230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1782222350.318834:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782222350.318864:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081868672:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1782222351.146820:0:19828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782222351.279749:0:17966:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1782222351.338437:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782222351.338449:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782222351.338460:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081869056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782222351.338464:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07475aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081868928:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782222351.338669:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081869568:0@lo:400:kworker.0 00000100:00100000:1.0:1782222351.338773:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081869440:0@lo:400:kworker.0 00000100:00100000:0.0:1782222351.345133:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222351.345191:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081869056 00000100:00100000:0.0:1782222351.345199:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081869056 00000100:00100000:0.0:1782222351.345279:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782222351.345302:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0875aad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3654:x1868795081869056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782222351.345336:0:18718:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1782222351.345376:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0875aad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3654:x1868795081869056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222351.345383:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782222351.345452:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081869056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782222351.345477:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0873f67-836f-4221-9522-aadc54ad715e:3654:1868795081869184:0@lo:400:kworker.0 00000100:00100000:0.0:1782222351.345507:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222351.346639:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1868795081869696:0@lo:400:kworker.0 00000100:00100000:2.0:1782222351.346709:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081869184 00000100:00100000:2.0:1782222351.346716:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081869184 00000100:00100000:2.0:1782222351.346759:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1782222351.346767:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+24:3654:x1868795081869184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222351.346812:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+24:3654:x1868795081869184:12345-0@lo:400:kworker.0 Request processed in 46us (1303us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222351.346819:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:1.0:1782222351.346910:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782222351.346949:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222351.346981:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081869696 00000100:00100000:0.0:1782222351.346986:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1868795081870208:0@lo:400:kworker.0 00000100:00100000:2.0:1782222351.346987:0:19481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081869696 00000100:00100000:0.0:1782222351.347023:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222351.347048:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1868795081870720:0@lo:400:kworker.0 00000100:00100000:2.0:1782222351.347049:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081870208 00000100:00100000:2.0:1782222351.347054:0:19481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081870208 00000100:00100000:1.0:1782222351.347060:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222351.347086:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222351.347091:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782222351.347099:0:19827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081869440 00000100:00100000:1.0:1782222351.347104:0:19827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081869440 00000100:00100000:0.0:1782222351.347121:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0873f67-836f-4221-9522-aadc54ad715e:3654:1868795081869184:0@lo:400:kworker.0 00000100:00100000:1.0:1782222351.347141:0:19827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782222351.347141:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782222351.347154:0:19827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081869440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222351.347154:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081870080:0@lo:400:kworker.0 00000100:00100000:0.0:1782222351.347188:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222351.347211:0:19827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081869440:12345-0@lo:400:kworker.0 Request processed in 59us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222351.347212:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1868795081870592:0@lo:400:kworker.0 00000100:00100000:0.0:1782222351.347256:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222351.347291:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081870080 00000100:00100000:0.0:1782222351.347295:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081870080 00000100:00100000:0.0:1782222351.347337:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782222351.347343:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0875aace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081870080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222351.347386:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0875aace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081870080:12345-0@lo:400:kworker.0 Request processed in 42us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222351.347393:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782222351.347424:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081870080:0@lo:400:kworker.0 00000100:00100000:0.0:1782222351.347448:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081869440:0@lo:400:kworker.0 00000100:00100000:0.0:1782222351.347455:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081869952:0@lo:400:kworker.0 00000100:00100000:0.0:1782222351.347476:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222351.347494:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081869952 00000100:00100000:0.0:1782222351.347497:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081869952 00000100:00100000:0.0:1782222351.347516:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782222351.347522:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0875aaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081869952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222351.347549:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0875aaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081869952:12345-0@lo:400:kworker.0 Request processed in 27us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222351.347554:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782222351.347585:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081869952:0@lo:400:kworker.0 00000100:00100000:0.0:1782222351.347591:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1868795081870464:0@lo:400:kworker.0 00000100:00100000:0.0:1782222351.347611:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222351.347631:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1782222351.347642:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081869312:0@lo:400:kworker.0 00000100:00100000:0.0:1782222351.347678:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222351.347724:0:19481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0875aac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1868795081869696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222351.348694:0:19481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0875aac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1868795081869696:12345-0@lo:400:kworker.0 Request processed in 972us (1743us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222351.348705:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782222351.348727:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081870720 00000100:00100000:2.0:1782222351.348733:0:19481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081870720 00000100:00100000:2.0:1782222351.348754:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081870592 00000100:00100000:2.0:1782222351.348756:0:19481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081870592 00000100:00100000:2.0:1782222351.348770:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081870464 00000100:00100000:2.0:1782222351.348772:0:19481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081870464 00000100:00100000:2.0:1782222351.348789:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782222351.348796:0:19481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0875aaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1868795081870208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222351.348938:0:19481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0875aaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1868795081870208:12345-0@lo:400:kworker.0 Request processed in 142us (1916us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222351.348945:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782222351.348959:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1782222351.348965:0:19481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0875aaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1868795081870720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222351.348997:0:19481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0875aaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1868795081870720:12345-0@lo:400:kworker.0 Request processed in 33us (1914us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222351.349038:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782222351.349050:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0875aac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1868795081870592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222351.349072:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782222351.349095:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0875aac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1868795081870592:12345-0@lo:400:kworker.0 Request processed in 45us (1835us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222351.349137:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782222351.349148:0:19481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0875aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1868795081870464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222351.349163:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081869824:0@lo:400:kworker.0 00000100:00100000:1.0:1782222351.349168:0:19827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782222351.349190:0:19481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0875aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1868795081870464:12345-0@lo:400:kworker.0 Request processed in 43us (1576us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222351.349206:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081869312 00000100:00100000:0.0:1782222351.349208:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222351.349255:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1868795081870336:0@lo:400:kworker.0 00000100:00100000:0.0:1782222351.349278:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1782222351.349311:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074778f800 x1868795081870464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222351.349323:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1868795081870464:0@lo:400:kworker.0 00000100:00080000:0.0:1782222351.349364:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782222351.349369:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782222351.349371:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782222351.349406:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222351.349441:0:17209:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1782222351.349449:0:17209:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1782222351.349466:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081868928 00000100:00100000:0.0:1782222351.349470:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081868928 00000100:00100000:0.0:1782222351.349495:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782222351.349501:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0875aaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081868928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782222351.349517:0:18718:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1782222351.349557:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0875aaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081868928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222351.349573:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782222351.349608:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07475aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081868928:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782222351.349635:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1868795081870592:0@lo:400:kworker.0 00000100:00100000:0.0:1782222351.349666:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1868795081869696:0@lo:400:kworker.0 00000100:00100000:0.0:1782222351.349677:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1868795081870208:0@lo:400:kworker.0 00010000:00080000:0.0:1782222351.349775:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074778d180 x1868795081870720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222351.349786:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1868795081870720:0@lo:400:kworker.0 00000100:00100000:0.0:1782222351.349827:0:18230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081869824 00000100:00100000:0.0:1782222351.349838:0:18230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081869824 00000100:00100000:0.0:1782222351.349866:0:18230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1782222351.349872:0:18230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0875aadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081869824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222351.349910:0:18230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0875aadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081869824:12345-0@lo:400:kworker.0 Request processed in 39us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222351.349917:0:18230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1782222351.349943:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081869824:0@lo:400:kworker.0 00000100:00100000:0.0:1782222351.350044:0:17210:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1782222351.350051:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081870336 00000100:00100000:0.0:1782222351.350054:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081870336 00000100:00080000:0.0:1782222351.350070:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782222351.351292:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081869312 00000100:00100000:1.0:1782222351.351354:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782222351.351362:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0875aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081869312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222351.351437:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0875aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081869312:12345-0@lo:400:kworker.0 Request processed in 76us (3757us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222351.351444:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782222351.351493:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081869312:0@lo:400:kworker.0 00000100:00100000:3.0:1782222351.351679:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782222351.351689:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782222351.351743:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222351.351774:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081869568 00000100:00100000:2.0:1782222351.351779:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081869568 00000100:00100000:2.0:1782222351.351808:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782222351.351815:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3653:x1868795081869568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222351.351942:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3653:x1868795081869568:12345-0@lo:400:kworker.0 Request processed in 127us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222351.351949:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782222351.351984:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081869568:0@lo:400:kworker.0 00000100:00100000:0.0:1782222351.354381:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1782222351.354401:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0875aadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1868795081870336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222351.354513:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0875aadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1868795081870336:12345-0@lo:400:kworker.0 Request processed in 118us (5232us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222351.354521:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782222351.354616:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1868795081870336:0@lo:400:kworker.0 00000001:00100000:3.0:1782222351.860459:0:19527:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8d3282c7-c1ac-4cf8-a606-482b3aabf172 00000001:00080000:3.0:1782222351.860477:0:19527:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:0.0:1782222352.018029:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222352.018151:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060805120 00000100:00100000:3.0:1782222352.018169:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060805120 00000100:00100000:3.0:1782222352.018293:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 14 00000100:00100000:3.0:1782222352.018304:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0875aae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d3282c7-c1ac-4cf8-a606-482b3aabf172+7:15016:x1868795060805120:12345-192.168.203.27@tcp:41:lfs.0 00000004:00000024:3.0:1782222352.018341:0:17208:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1782222352.018437:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0875aae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d3282c7-c1ac-4cf8-a606-482b3aabf172+7:15016:x1868795060805120:12345-192.168.203.27@tcp:41:lfs.0 Request processed in 134us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222352.018444:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 14 00000100:00080000:0.0:1782222352.019012:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782222352.020978:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222352.021114:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060805248 00000100:00100000:2.0:1782222352.021123:0:19481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060805248 00000100:00100000:2.0:1782222352.021193:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 15 00000100:00100000:2.0:1782222352.021202:0:19481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0875aaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+6:15016:x1868795060805248:12345-192.168.203.27@tcp:41:lfs.0 00000004:00000024:2.0:1782222352.021261:0:19481:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1782222352.021378:0:19481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0875aaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+6:15016:x1868795060805248:12345-192.168.203.27@tcp:41:lfs.0 Request processed in 176us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222352.021386:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 15 00000100:00080000:0.0:1782222352.022711:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782222352.025502:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222352.025604:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060805376 00000100:00100000:0.0:1782222352.025613:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060805376 00000100:00100000:0.0:1782222352.025701:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 11 00000100:00100000:0.0:1782222352.025711:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8d3282c7-c1ac-4cf8-a606-482b3aabf172+6:15016:x1868795060805376:12345-192.168.203.27@tcp:13:lfs.0 00002000:00000024:0.0:1782222352.025742:0:18718:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1782222352.025846:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8d3282c7-c1ac-4cf8-a606-482b3aabf172+6:15016:x1868795060805376:12345-192.168.203.27@tcp:13:lfs.0 Request processed in 137us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222352.025864:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 11 00000100:00080000:2.0:1782222352.026149:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782222352.041417:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222352.041653:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060805504 00000100:00100000:0.0:1782222352.041664:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060805504 00000100:00100000:0.0:1782222352.041737:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 12 00000100:00100000:0.0:1782222352.041747:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8d3282c7-c1ac-4cf8-a606-482b3aabf172+5:15016:x1868795060805504:12345-192.168.203.27@tcp:13:lfs.0 00002000:00000024:0.0:1782222352.041776:0:18718:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1782222352.041881:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8d3282c7-c1ac-4cf8-a606-482b3aabf172+5:15016:x1868795060805504:12345-192.168.203.27@tcp:13:lfs.0 Request processed in 136us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222352.041890:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 12 00000100:00080000:2.0:1782222352.042635:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782222352.175584:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222352.314655:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222352.315535:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060805632 00000100:00100000:0.0:1782222352.315546:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060805632 00000100:00100000:0.0:1782222352.315668:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 131 00000100:00100000:0.0:1782222352.315678:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+10:15046:x1868795060805632:12345-192.168.203.27@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782222352.315693:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222352.315710:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f087fcb9200/0xe2b7cc26e6812890 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558872 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222352.315737:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fcb9200/0xe2b7cc26e6812890 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558872 expref: 11 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222352.315747:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f087fcb9200/0xe2b7cc26e6812890 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558872 expref: 11 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222352.315756:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fcb9200, rc 0) 00000100:00100000:0.0:1782222352.315824:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+11:15046:x1868795060805632:12345-192.168.203.27@tcp:101:mount.lustre.0 Request processed in 148us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222352.315848:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 131 00000100:00100000:3.0:1782222352.321329:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222352.321489:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060805760 00000100:00100000:2.0:1782222352.321500:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060805760 00000100:00100000:2.0:1782222352.321557:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 132 00000100:00100000:2.0:1782222352.321567:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+11:15046:x1868795060805760:12345-192.168.203.27@tcp:501:mount.lustre.0 00000100:00100000:2.0:1782222352.321726:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+11:15046:x1868795060805760:12345-192.168.203.27@tcp:501:mount.lustre.0 Request processed in 160us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222352.321745:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 132 00000100:00100000:1.0:1782222352.336036:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222352.336139:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060805888 00000100:00100000:0.0:1782222352.336149:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060805888 00000100:00100000:0.0:1782222352.336222:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 133 00000100:00100000:0.0:1782222352.336232:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+11:15046:x1868795060805888:12345-192.168.203.27@tcp:503:mount.lustre.0 00000100:00100000:0.0:1782222352.336411:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+11:15046:x1868795060805888:12345-192.168.203.27@tcp:503:mount.lustre.0 Request processed in 180us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222352.336420:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 133 00000100:00100000:3.0:1782222352.385474:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222352.385669:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060806016 00000100:00100000:0.0:1782222352.385678:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060806016 00000100:00100000:0.0:1782222352.385730:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 134 00000100:00100000:0.0:1782222352.385740:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+11:15055:x1868795060806016:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782222352.386835:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+11:15055:x1868795060806016:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 1091us (1364us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222352.386847:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 134 00000100:00100000:3.0:1782222352.429282:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222352.429396:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060806144 00000100:00100000:2.0:1782222352.429406:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060806144 00000100:00100000:2.0:1782222352.429465:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 135 00000100:00100000:2.0:1782222352.429476:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+11:15055:x1868795060806144:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782222352.429624:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+11:15055:x1868795060806144:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 149us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222352.429632:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 135 00000100:00100000:1.0:1782222352.445367:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222352.451960:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060806272 00000100:00100000:0.0:1782222352.451977:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060806272 00000100:00100000:0.0:1782222352.452047:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 136 00000100:00100000:0.0:1782222352.452057:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+11:15055:x1868795060806272:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782222352.452230:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+11:15055:x1868795060806272:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 174us (6871us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222352.452275:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 136 00000100:00100000:0.0:1782222352.456386:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222352.456480:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060806400 00000100:00100000:3.0:1782222352.456489:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060806400 00000100:00100000:3.0:1782222352.456542:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 137 00000100:00100000:3.0:1782222352.456552:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+11:15046:x1868795060806400:12345-192.168.203.27@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782222352.456567:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222352.456583:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f08483ed000/0xe2b7cc26e6812897 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x558f77f2f75588a3 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222352.456608:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f08483ed000/0xe2b7cc26e6812897 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75588a3 expref: 12 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222352.456648:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f08483ed000/0xe2b7cc26e6812897 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75588a3 expref: 12 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222352.456659:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f08483ed000, rc 0) 00000100:00100000:3.0:1782222352.456718:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+12:15046:x1868795060806400:12345-192.168.203.27@tcp:101:mount.lustre.0 Request processed in 167us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222352.456725:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 137 00000100:00100000:3.0:1782222352.468116:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222352.468208:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060806528 00000100:00100000:2.0:1782222352.468217:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060806528 00000100:00100000:2.0:1782222352.468297:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 138 00000100:00100000:2.0:1782222352.468308:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+12:15046:x1868795060806528:12345-192.168.203.27@tcp:256:mount.lustre.0 20000000:01000000:2.0:1782222352.468334:0:17201:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1782222352.468357:0:17201:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1782222352.468362:0:17201:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1782222352.468366:0:17201:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1782222352.468369:0:17201:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1782222352.468372:0:17201:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1782222352.471784:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+12:15046:x1868795060806528:12345-192.168.203.27@tcp:256:mount.lustre.0 Request processed in 3466us (3666us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222352.471801:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 138 00000100:00100000:0.0:1782222352.475143:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222352.476275:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060806656 00000100:00100000:2.0:1782222352.476287:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060806656 00000100:00100000:2.0:1782222352.476352:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 139 00000100:00100000:2.0:1782222352.476363:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+12:15046:x1868795060806656:12345-192.168.203.27@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782222352.476392:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222352.476413:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f087fb82a00/0xe2b7cc26e681289e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x558f77f2f75588aa expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222352.476443:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fb82a00/0xe2b7cc26e681289e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75588aa expref: 13 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222352.476456:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f087fb82a00/0xe2b7cc26e681289e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75588aa expref: 13 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222352.476466:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb82a00, rc 0) 00000100:00100000:2.0:1782222352.476534:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+13:15046:x1868795060806656:12345-192.168.203.27@tcp:101:mount.lustre.0 Request processed in 173us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222352.476542:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 139 00000100:00100000:3.0:1782222352.478626:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222352.478737:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060806784 00000100:00100000:2.0:1782222352.478746:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060806784 00000100:00100000:2.0:1782222352.478804:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 140 00000100:00100000:2.0:1782222352.478814:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+13:15046:x1868795060806784:12345-192.168.203.27@tcp:501:mount.lustre.0 00000100:00100000:2.0:1782222352.478963:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+13:15046:x1868795060806784:12345-192.168.203.27@tcp:501:mount.lustre.0 Request processed in 150us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222352.478970:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 140 00000100:00100000:0.0:1782222352.484786:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222352.484942:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060806912 00000100:00100000:3.0:1782222352.484951:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060806912 00000100:00100000:3.0:1782222352.485007:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 141 00000100:00100000:3.0:1782222352.485017:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+13:15046:x1868795060806912:12345-192.168.203.27@tcp:503:mount.lustre.0 00000100:00100000:3.0:1782222352.485167:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+13:15046:x1868795060806912:12345-192.168.203.27@tcp:503:mount.lustre.0 Request processed in 151us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222352.485175:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 141 00000100:00100000:3.0:1782222352.507185:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222352.507907:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060807040 00000100:00100000:0.0:1782222352.507919:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060807040 00000100:00100000:0.0:1782222352.507986:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 142 00000100:00100000:0.0:1782222352.507996:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+13:15059:x1868795060807040:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782222352.508157:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+13:15059:x1868795060807040:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 161us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222352.508166:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 142 00000100:00100000:1.0:1782222352.515556:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222352.515625:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060807168 00000100:00100000:3.0:1782222352.515634:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060807168 00000100:00100000:3.0:1782222352.515700:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 143 00000100:00100000:3.0:1782222352.515710:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+13:15059:x1868795060807168:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782222352.515883:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+13:15059:x1868795060807168:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 173us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222352.515892:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 143 00000100:00100000:1.0:1782222352.528064:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222352.528110:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222352.528228:0:20002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060807296 00000100:00100000:0.0:1782222352.528273:0:20002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060807296 00000100:00100000:0.0:1782222352.528313:0:20002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060807552 00000100:00100000:0.0:1782222352.528316:0:20002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060807552 00000100:00100000:0.0:1782222352.528336:0:20002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 16 00000100:00100000:0.0:1782222352.528343:0:20002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2386:x1868795060807296:12345-192.168.203.27@tcp:38:mount.lustre.0 00000100:00100000:3.0:1782222352.528359:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 17 00000100:00100000:3.0:1782222352.528365:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2386:x1868795060807552:12345-192.168.203.27@tcp:38:mount.lustre.0 00010000:00080000:3.0:1782222352.528380:0:17208:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from c320fdbb-74fa-4205-b5df-42980d45bb62@192.168.203.27@tcp t0 exp 0000000000000000 cur 551 last 0 00010000:00080000:0.0:1782222352.528382:0:20002:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from c320fdbb-74fa-4205-b5df-42980d45bb62@192.168.203.27@tcp t0 exp 0000000000000000 cur 551 last 0 00000020:00000080:3.0:1782222352.528415:0:17208:0:(genops.c:1406:class_connect()) connect: client c320fdbb-74fa-4205-b5df-42980d45bb62, cookie 0xe2b7cc26e68128a5 00000020:00000080:0.0:1782222352.528415:0:20002:0:(genops.c:1406:class_connect()) connect: client c320fdbb-74fa-4205-b5df-42980d45bb62, cookie 0xe2b7cc26e68128ac 00000004:00100000:3.0:1782222352.528493:0:17208:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1782222352.528587:0:17208:0:(import.c:65:import_set_state_nolock()) ffff8f087e2d0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782222352.528702:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c320fdbb-74fa-4205-b5df-42980d45bb62+6:2386:x1868795060807552:12345-192.168.203.27@tcp:38:mount.lustre.0 Request processed in 333us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222352.528710:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 17 00000004:00100000:0.0:1782222352.536922:0:20002:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1782222352.537066:0:20002:0:(import.c:65:import_set_state_nolock()) ffff8f084fd1d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782222352.537142:0:20002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c320fdbb-74fa-4205-b5df-42980d45bb62+6:2386:x1868795060807296:12345-192.168.203.27@tcp:38:mount.lustre.0 Request processed in 8796us (9085us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222352.537153:0:20002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 16 00000100:00100000:0.0:1782222352.548204:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222352.548298:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222352.548442:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060807680 00000100:00100000:3.0:1782222352.548453:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060807680 00000100:00100000:3.0:1782222352.548529:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060807424 00000100:00100000:3.0:1782222352.548533:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060807424 00000100:00100000:3.0:1782222352.548561:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 18 00000100:00100000:3.0:1782222352.548570:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0875aafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c320fdbb-74fa-4205-b5df-42980d45bb62+6:0:x1868795060807680:12345-192.168.203.27@tcp:41:mount.lustre.0 00000004:00000024:3.0:1782222352.548602:0:17210:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1782222352.548674:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0875aafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c320fdbb-74fa-4205-b5df-42980d45bb62+6:0:x1868795060807680:12345-192.168.203.27@tcp:41:mount.lustre.0 Request processed in 104us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222352.548681:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 18 00000100:00100000:3.0:1782222352.548710:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 19 00000100:00100000:3.0:1782222352.548718:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0875aac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c320fdbb-74fa-4205-b5df-42980d45bb62+6:0:x1868795060807424:12345-192.168.203.27@tcp:41:mount.lustre.0 00000004:00000024:3.0:1782222352.548730:0:17210:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1782222352.548755:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0875aac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c320fdbb-74fa-4205-b5df-42980d45bb62+6:0:x1868795060807424:12345-192.168.203.27@tcp:41:mount.lustre.0 Request processed in 38us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222352.548761:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 19 00000100:00080000:0.0:1782222352.550589:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782222352.550598:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782222352.550942:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222352.551065:0:20002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060807808 00000100:00100000:0.0:1782222352.551074:0:20002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060807808 00000100:00100000:0.0:1782222352.551137:0:20002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 20 00000100:00100000:0.0:1782222352.551146:0:20002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c320fdbb-74fa-4205-b5df-42980d45bb62+6:15046:x1868795060807808:12345-192.168.203.27@tcp:41:mount.lustre.0 00000004:00000024:0.0:1782222352.551175:0:20002:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1782222352.551279:0:20002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c320fdbb-74fa-4205-b5df-42980d45bb62+6:15046:x1868795060807808:12345-192.168.203.27@tcp:41:mount.lustre.0 Request processed in 134us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222352.551287:0:20002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 20 00000100:00100000:1.0:1782222352.557413:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222352.557992:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060807936 00000100:00100000:3.0:1782222352.558003:0:19481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060807936 00000100:00100000:3.0:1782222352.558061:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 21 00000100:00100000:3.0:1782222352.558071:0:19481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c320fdbb-74fa-4205-b5df-42980d45bb62+6:15046:x1868795060807936:12345-192.168.203.27@tcp:40:mount.lustre.0 00000100:00100000:3.0:1782222352.558157:0:19481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c320fdbb-74fa-4205-b5df-42980d45bb62+6:15046:x1868795060807936:12345-192.168.203.27@tcp:40:mount.lustre.0 Request processed in 87us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222352.558165:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 21 00000100:00100000:1.0:1782222352.563381:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222352.563420:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222352.563459:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222352.564111:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060808064 00000100:00100000:0.0:1782222352.564122:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060808064 00000100:00100000:0.0:1782222352.564166:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060808192 00000100:00100000:0.0:1782222352.564169:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060808192 00000100:00100000:0.0:1782222352.564196:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 21 00000100:00100000:0.0:1782222352.564204:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2386:x1868795060808064:12345-192.168.203.27@tcp:8:mount.lustre.0 00010000:00080000:0.0:1782222352.564266:0:18714:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from c320fdbb-74fa-4205-b5df-42980d45bb62@192.168.203.27@tcp t0 exp 0000000000000000 cur 551 last 0 00000020:00000080:0.0:1782222352.564299:0:18714:0:(genops.c:1406:class_connect()) connect: client c320fdbb-74fa-4205-b5df-42980d45bb62, cookie 0xe2b7cc26e68128b3 00002000:00100000:0.0:1782222352.564311:0:18714:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c320fdbb-74fa-4205-b5df-42980d45bb62/ffff8f084fd1e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782222352.564322:0:18714:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782222352.564404:0:18714:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1782222352.564435:0:18714:0:(import.c:65:import_set_state_nolock()) ffff8f084fd18800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782222352.564497:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c320fdbb-74fa-4205-b5df-42980d45bb62+6:2386:x1868795060808064:12345-192.168.203.27@tcp:8:mount.lustre.0 Request processed in 292us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222352.564506:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 21 00000100:00100000:0.0:1782222352.564522:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 22 00000100:00100000:0.0:1782222352.564527:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2386:x1868795060808192:12345-192.168.203.27@tcp:8:mount.lustre.0 00010000:00080000:0.0:1782222352.564543:0:18714:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from c320fdbb-74fa-4205-b5df-42980d45bb62@192.168.203.27@tcp t0 exp 0000000000000000 cur 551 last 0 00000020:00000080:0.0:1782222352.564560:0:18714:0:(genops.c:1406:class_connect()) connect: client c320fdbb-74fa-4205-b5df-42980d45bb62, cookie 0xe2b7cc26e68128ba 00002000:00100000:0.0:1782222352.564578:0:18714:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c320fdbb-74fa-4205-b5df-42980d45bb62/ffff8f084fd1c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782222352.564584:0:18714:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782222352.564626:0:18714:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1782222352.564653:0:18714:0:(import.c:65:import_set_state_nolock()) ffff8f084fd1b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782222352.564676:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c320fdbb-74fa-4205-b5df-42980d45bb62+6:2386:x1868795060808192:12345-192.168.203.27@tcp:8:mount.lustre.0 Request processed in 147us (1217us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222352.564683:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 22 00000100:00100000:3.0:1782222352.565681:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060808320 00000100:00100000:3.0:1782222352.565691:0:17219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060808320 00000100:00100000:3.0:1782222352.565761:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 4 00000100:00100000:3.0:1782222352.565771:0:17219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c320fdbb-74fa-4205-b5df-42980d45bb62+6:15046:x1868795060808320:12345-192.168.203.27@tcp:900:mount.lustre.0 00000100:00100000:3.0:1782222352.565839:0:17219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c320fdbb-74fa-4205-b5df-42980d45bb62+6:15046:x1868795060808320:12345-192.168.203.27@tcp:900:mount.lustre.0 Request processed in 69us (2466us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222352.565847:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 4 00000100:00100000:1.0:1782222352.571316:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222352.573190:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060808448 00000100:00100000:2.0:1782222352.573204:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060808448 00000100:00100000:2.0:1782222352.573307:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 1 00000100:00100000:2.0:1782222352.573318:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c320fdbb-74fa-4205-b5df-42980d45bb62+6:15046:x1868795060808448:12345-192.168.203.27@tcp:33:mount.lustre.0 00000004:00200000:2.0:1782222352.573431:0:17212:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1782222352.573530:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c320fdbb-74fa-4205-b5df-42980d45bb62+6:15046:x1868795060808448:12345-192.168.203.27@tcp:33:mount.lustre.0 Request processed in 213us (2224us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222352.573539:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 1 00000100:00100000:2.0:1782222352.804684:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222352.805103:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060808576 00000100:00100000:0.0:1782222352.805114:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060808576 00000100:00100000:0.0:1782222352.805230:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 22 00000100:00100000:0.0:1782222352.805270:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c320fdbb-74fa-4205-b5df-42980d45bb62+6:15082:x1868795060808576:12345-192.168.203.27@tcp:101:mkdir.0 00010000:00010000:0.0:1782222352.805290:0:17209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222352.805314:0:17209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e68128c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75588db expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222352.805378:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e68128c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222352.805392:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e68128c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222352.805404:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e68128c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782222352.805454:0:17209:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782222352.805459:0:17209:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782222352.805480:0:17209:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e68128c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222352.805521:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e68128c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75588db expref: 8 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222352.805539:0:17209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e68128c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75588db expref: 7 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222352.805548:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0843b9b000) 00010000:00010000:0.0:1782222352.805551:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782222352.805554:0:17209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fcb8200, rc 0) 00000100:00100000:0.0:1782222352.805617:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c320fdbb-74fa-4205-b5df-42980d45bb62+7:15082:x1868795060808576:12345-192.168.203.27@tcp:101:mkdir.0 Request processed in 349us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222352.805624:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 22 00010000:00010000:1.0:1782222353.194489:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222354.219524:0:19828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1782222354.926192:0:17188:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c320fdbb-74fa-4205-b5df-42980d45bb62 00000001:00100000:3.0:1782222354.926205:0:17188:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8d3282c7-c1ac-4cf8-a606-482b3aabf172 00000001:00100000:2.0:1782222354.927039:0:18710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c320fdbb-74fa-4205-b5df-42980d45bb62 00000001:00100000:2.0:1782222354.927048:0:18710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8d3282c7-c1ac-4cf8-a606-482b3aabf172 00000001:00100000:1.0:1782222354.935735:0:17940:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c320fdbb-74fa-4205-b5df-42980d45bb62 00000001:00100000:1.0:1782222354.935749:0:17940:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8d3282c7-c1ac-4cf8-a606-482b3aabf172 00010000:00010000:1.0:1782222355.243506:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222355.434456:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081870848:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782222355.434526:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222355.434640:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081870848 00000100:00100000:0.0:1782222355.434648:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081870848 00000100:00100000:0.0:1782222355.434708:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782222355.434718:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081870848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782222355.434745:0:18718:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1782222355.434806:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081870848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222355.434814:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782222355.434857:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081870848:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1782222355.435145:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782222355.435509:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782222355.435521:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081870976:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782222355.435558:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222355.435598:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081870976 00000100:00100000:1.0:1782222355.435625:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081870976 00000100:00100000:1.0:1782222355.435657:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1782222355.435665:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081870976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782222355.435689:0:17213:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1782222355.435726:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081870976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222355.435733:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1782222355.435768:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081870976:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782222355.435956:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782222355.435965:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0875aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081871104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782222355.436003:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222355.436043:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081871104 00000100:00100000:0.0:1782222355.436047:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081871104 00000100:00100000:0.0:1782222355.436080:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782222355.436086:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0875aad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081871104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782222355.436099:0:18718:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1782222355.436129:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0875aad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081871104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222355.436135:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1782222355.436150:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782222355.436168:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0875aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081871104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782222355.436630:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081871232:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782222355.436658:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222355.436775:0:18230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081871232 00000100:00100000:2.0:1782222355.436780:0:18230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081871232 00000100:00100000:2.0:1782222355.436817:0:18230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1782222355.436825:0:18230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0875aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081871232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782222355.436848:0:18230:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1782222355.436885:0:18230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0875aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081871232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222355.436891:0:18230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1782222355.437163:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081871232:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782222356.268274:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782222356.453586:0:20087:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1782222356.458529:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081871488:0@lo:400:kworker.0 00000100:00100000:1.0:1782222356.458606:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222356.458692:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081872000:0@lo:400:kworker.0 00000100:00100000:1.0:1782222356.458717:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222356.458734:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1868795081872512:0@lo:400:kworker.0 00000100:00100000:3.0:1782222356.458747:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0873f67-836f-4221-9522-aadc54ad715e:3655:1868795081871360:0@lo:400:kworker.0 00000100:00100000:1.0:1782222356.458775:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222356.458778:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222356.458803:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1868795081871872:0@lo:400:kworker.0 00000100:00100000:1.0:1782222356.458821:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081871616:0@lo:400:kworker.0 00000100:00100000:3.0:1782222356.458825:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222356.462254:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081872512 00000100:00100000:2.0:1782222356.462268:0:19481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081872512 00000100:00100000:2.0:1782222356.462335:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081871872 00000100:00100000:2.0:1782222356.462339:0:19481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081871872 00000100:00100000:2.0:1782222356.462364:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782222356.462372:0:19481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1868795081872512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222356.464276:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782222356.464293:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1868795081871872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222356.464372:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1868795081871872:12345-0@lo:400:kworker.0 Request processed in 85us (5546us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222356.464380:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782222356.464428:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081871744:0@lo:400:kworker.0 00000100:00100000:1.0:1782222356.464471:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222356.464508:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081872256:0@lo:400:kworker.0 00000100:00100000:1.0:1782222356.464527:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222356.464705:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1868795081872768:0@lo:400:kworker.0 00000100:00100000:1.0:1782222356.464735:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222356.464772:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081871488 00000100:00100000:1.0:1782222356.464779:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081871488 00000100:00100000:1.0:1782222356.464885:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081872000 00000100:00100000:1.0:1782222356.464890:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081872000 00000100:00100000:1.0:1782222356.464905:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1782222356.464912:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081871488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222356.464950:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081871488:12345-0@lo:400:kworker.0 Request processed in 38us (6344us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222356.464957:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1782222356.464971:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782222356.464978:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081872000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222356.465007:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081872000:12345-0@lo:400:kworker.0 Request processed in 30us (6290us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222356.465025:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782222356.465048:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081872768 00000100:00100000:1.0:1782222356.465051:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081872768 00000100:00100000:1.0:1782222356.465078:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782222356.465083:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1868795081872768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222356.465118:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1868795081872768:12345-0@lo:400:kworker.0 Request processed in 34us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222356.465123:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782222356.465141:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081871744 00000100:00100000:1.0:1782222356.465145:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081871744 00000100:00100000:1.0:1782222356.465169:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081872256 00000100:00100000:1.0:1782222356.465172:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081872256 00000100:00100000:1.0:1782222356.465189:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782222356.465194:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081871744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222356.465260:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1868795081871872:0@lo:400:kworker.0 00000100:00100000:3.0:1782222356.465268:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1868795081872384:0@lo:400:kworker.0 00000100:00100000:0.0:1782222356.465273:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782222356.465281:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081872256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222356.466972:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081872256:12345-0@lo:400:kworker.0 Request processed in 1689us (2440us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222356.466982:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782222356.469661:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081873024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782222356.469730:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222356.469981:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081871488:0@lo:400:kworker.0 00000100:00100000:0.0:1782222356.470000:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081872000:0@lo:400:kworker.0 00000100:00100000:0.0:1782222356.470047:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081873024 00000100:00100000:0.0:1782222356.470053:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081873024 00000100:00100000:0.0:1782222356.470111:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782222356.470119:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088159b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3656:x1868795081873024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782222356.470150:0:18718:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1782222356.470194:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088159b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3656:x1868795081873024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222356.470201:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782222356.470230:0:3656:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1782222356.470268:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081873024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782222356.470297:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222356.470322:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081871616 00000100:00100000:0.0:1782222356.470327:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081871616 00000100:00100000:0.0:1782222356.470347:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782222356.470353:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081871616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222356.470387:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081871616:12345-0@lo:400:kworker.0 Request processed in 33us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222356.470394:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782222356.470418:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081871616:0@lo:400:kworker.0 00000100:00100000:0.0:1782222356.470426:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081872128:0@lo:400:kworker.0 00000100:00100000:0.0:1782222356.470448:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222356.470465:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081872128 00000100:00100000:0.0:1782222356.470468:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081872128 00000100:00100000:3.0:1782222356.471570:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222356.471734:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1868795081872896:0@lo:400:kworker.0 00000100:00100000:3.0:1782222356.471779:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222356.471870:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081872384 00000100:00100000:3.0:1782222356.471875:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081872384 00000100:00100000:3.0:1782222356.471901:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081872896 00000100:00100000:3.0:1782222356.471904:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081872896 00000100:00100000:3.0:1782222356.471923:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782222356.471929:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1868795081872384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222356.471972:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1868795081872384:12345-0@lo:400:kworker.0 Request processed in 43us (6678us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222356.471979:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782222356.471993:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782222356.471999:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1868795081872896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222356.472025:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1868795081872896:12345-0@lo:400:kworker.0 Request processed in 27us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222356.472030:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782222356.472063:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1868795081872384:0@lo:400:kworker.0 00010000:00080000:3.0:1782222356.472077:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088163f100 x1868795081872896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222356.472088:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1868795081872896:0@lo:400:kworker.0 00000100:00080000:3.0:1782222356.472130:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782222356.472134:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782222356.472137:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782222356.472147:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081871360 00000100:00100000:3.0:1782222356.472151:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081871360 00000100:00100000:3.0:1782222356.472175:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1782222356.472181:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+24:3655:x1868795081871360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222356.472223:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+24:3655:x1868795081871360:12345-0@lo:400:kworker.0 Request processed in 42us (13443us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222356.472230:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1782222356.472294:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0873f67-836f-4221-9522-aadc54ad715e:3655:1868795081871360:0@lo:400:kworker.0 00000100:00100000:0.0:1782222356.472999:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782222356.473008:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0881598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081872128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222356.473051:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0881598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081872128:12345-0@lo:400:kworker.0 Request processed in 45us (2602us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222356.473058:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782222356.474947:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081871744:12345-0@lo:400:kworker.0 Request processed in 9747us (10469us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222356.474960:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782222356.475024:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081871744:0@lo:400:kworker.0 00000100:00100000:1.0:1782222356.475039:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081872256:0@lo:400:kworker.0 00000100:00100000:1.0:1782222356.475051:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1868795081872768:0@lo:400:kworker.0 00000100:00100000:1.0:1782222356.475074:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782222356.475083:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07475ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081873152:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782222356.475128:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222356.475167:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081873152 00000100:00100000:1.0:1782222356.475172:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081873152 00000100:00100000:1.0:1782222356.475209:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782222356.475216:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081873152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782222356.475269:0:18717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1782222356.476436:0:19481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1868795081872512:12345-0@lo:400:kworker.0 Request processed in 14061us (17656us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222356.476459:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782222356.476927:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081872128:0@lo:400:kworker.0 00000100:00100000:0.0:1782222356.476939:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1868795081872640:0@lo:400:kworker.0 00000100:00100000:0.0:1782222356.476976:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222356.477006:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081872640 00000100:00100000:0.0:1782222356.477010:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081872640 00000100:00100000:0.0:1782222356.477051:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1782222356.477059:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088159a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1868795081872640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222356.477111:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088159a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1868795081872640:12345-0@lo:400:kworker.0 Request processed in 53us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222356.477118:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1782222356.477135:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1782222356.477156:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f088163df80 x1868795081872640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782222356.477165:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1868795081872640:0@lo:400:kworker.0 00000100:00100000:1.0:1782222356.477281:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081873152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2064us (2151us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222356.477289:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782222356.477565:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1868795081872512:0@lo:400:kworker.0 00000100:00100000:0.0:1782222356.478690:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07475ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081873152:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1782222357.290415:0:19828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782222357.930949:0:17242:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1782222357.933117:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222357.933158:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222357.933190:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222357.933215:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222357.933262:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222357.933280:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222357.933299:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222357.933316:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222357.933338:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222357.933368:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060808832 00000100:00100000:3.0:1782222357.933378:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060808832 00000100:00100000:3.0:1782222357.933425:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060809344 00000100:00100000:3.0:1782222357.933428:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060809344 00000100:00100000:3.0:1782222357.933443:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060808960 00000100:00100000:2.0:1782222357.933631:0:19827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060809088 00000100:00100000:2.0:1782222357.933636:0:19827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060809088 00000100:00100000:2.0:1782222357.933660:0:19827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060809600 00000100:00100000:2.0:1782222357.933663:0:19827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060809600 00000100:00100000:2.0:1782222357.933675:0:19827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060809216 00000100:00100000:2.0:1782222357.933678:0:19827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060809216 00000100:00100000:2.0:1782222357.933689:0:19827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060809728 00000100:00100000:2.0:1782222357.933691:0:19827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060809728 00000100:00100000:2.0:1782222357.933722:0:19827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 13 00000100:00100000:2.0:1782222357.933730:0:19827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+5:2388:x1868795060809088:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222357.933812:0:19827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+5:2388:x1868795060809088:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 82us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222357.933819:0:19827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 13 00000100:00100000:2.0:1782222357.933836:0:19827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 14 00000100:00100000:2.0:1782222357.933842:0:19827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c320fdbb-74fa-4205-b5df-42980d45bb62+5:2388:x1868795060809600:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222357.933866:0:19827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c320fdbb-74fa-4205-b5df-42980d45bb62+5:2388:x1868795060809600:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 24us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222357.933872:0:19827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 14 00000100:00100000:2.0:1782222357.933883:0:19827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 15 00000100:00100000:2.0:1782222357.933889:0:19827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+5:2388:x1868795060809216:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222357.933925:0:19827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+5:2388:x1868795060809216:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 36us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222357.933932:0:19827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 15 00000100:00100000:2.0:1782222357.933943:0:19827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 16 00000100:00100000:2.0:1782222357.933964:0:19827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c320fdbb-74fa-4205-b5df-42980d45bb62+6:2388:x1868795060809728:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222357.933990:0:19827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c320fdbb-74fa-4205-b5df-42980d45bb62+6:2388:x1868795060809728:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 27us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222357.933997:0:19827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 16 00000100:00100000:2.0:1782222357.934018:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060808704 00000100:00100000:2.0:1782222357.934021:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060808704 00000100:00100000:2.0:1782222357.934048:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 145 00000100:00100000:2.0:1782222357.934055:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+13:2388:x1868795060808704:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222357.934080:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+13:2388:x1868795060808704:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 26us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222357.934087:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 145 00000100:00100000:2.0:1782222357.934112:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060809472 00000100:00100000:2.0:1782222357.934115:0:19481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060809472 00000100:00100000:2.0:1782222357.934134:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 44 00000100:00100000:2.0:1782222357.934141:0:19481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+6:2388:x1868795060808832:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222357.934169:0:19481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+6:2388:x1868795060808832:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 29us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222357.934176:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 44 00000100:00100000:2.0:1782222357.934191:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 45 00000100:00100000:2.0:1782222357.934198:0:19481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c320fdbb-74fa-4205-b5df-42980d45bb62+6:2388:x1868795060809344:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222357.934222:0:19481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c320fdbb-74fa-4205-b5df-42980d45bb62+6:2388:x1868795060809344:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 25us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222357.934227:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 45 00000100:00100000:2.0:1782222357.934258:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 46 00000100:00100000:2.0:1782222357.934272:0:19481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c320fdbb-74fa-4205-b5df-42980d45bb62+5:2388:x1868795060809472:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222357.934301:0:19481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c320fdbb-74fa-4205-b5df-42980d45bb62+5:2388:x1868795060809472:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 31us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222357.934306:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 46 00000100:00100000:3.0:1782222357.934667:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060808960 00000100:00100000:3.0:1782222357.934716:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 47 00000100:00100000:3.0:1782222357.934724:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d3282c7-c1ac-4cf8-a606-482b3aabf172+5:2388:x1868795060808960:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222357.934751:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d3282c7-c1ac-4cf8-a606-482b3aabf172+5:2388:x1868795060808960:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 29us (1469us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222357.934758:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 47 00000100:00080000:0.0:1782222357.936056:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782222357.936063:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782222357.936066:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782222357.936068:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:3.0:1782222358.000039:0:19527:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c320fdbb-74fa-4205-b5df-42980d45bb62 00010000:00010000:2.0:1782222358.318062:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782222359.340470:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222360.364220:0:19828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222360.554891:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782222360.554926:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081873280:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782222360.555042:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222360.555219:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081873280 00000100:00100000:1.0:1782222360.555229:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081873280 00000100:00100000:1.0:1782222360.555316:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1782222360.555327:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081873280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782222360.555373:0:17214:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1782222360.555446:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081873280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222360.555454:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782222360.556179:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081873408:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782222360.556258:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222360.556313:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081873408 00000100:00100000:0.0:1782222360.556319:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081873408 00000100:00100000:0.0:1782222360.556387:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782222360.556396:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088159a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081873408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782222360.556426:0:18718:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1782222360.556468:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088159a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081873408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222360.556475:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1782222360.557798:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782222360.557868:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081873408:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782222360.557897:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782222360.557906:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081873536:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782222360.557963:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222360.558018:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081873536 00000100:00100000:2.0:1782222360.558025:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081873536 00000100:00100000:2.0:1782222360.558079:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1782222360.558088:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081873536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782222360.558129:0:17213:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1782222360.558176:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081873536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222360.558182:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1782222360.558214:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081873536:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782222360.559792:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081873664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782222360.559881:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222360.559981:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081873280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782222360.560370:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081873664 00000100:00100000:1.0:1782222360.560380:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081873664 00000100:00100000:1.0:1782222360.560464:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782222360.560476:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081873664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782222360.560520:0:18718:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1782222360.560599:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081873664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222360.560607:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1782222360.560802:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782222360.560837:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081873664:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782222361.386610:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782222361.515928:0:17966:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1782222361.579324:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782222361.579356:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07475ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081873792:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782222361.579455:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222361.579548:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081873792 00000100:00100000:3.0:1782222361.579557:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081873792 00000100:00100000:3.0:1782222361.579636:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782222361.579647:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081873792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782222361.579683:0:18718:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1782222361.579737:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081873792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222361.579745:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1782222361.579769:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782222361.579823:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07475ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081873792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782222361.579972:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782222361.579984:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081873920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782222361.580030:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222361.580064:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081873920 00000100:00100000:2.0:1782222361.580067:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081873920 00000100:00100000:2.0:1782222361.580098:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782222361.580105:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081873920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782222361.580116:0:18718:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1782222361.580143:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081873920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222361.580150:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1782222361.580165:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782222361.580185:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081873920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782222361.583395:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0873f67-836f-4221-9522-aadc54ad715e:3656:1868795081874048:0@lo:400:kworker.0 00000100:00100000:2.0:1782222361.583490:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222361.583537:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081874560:0@lo:400:kworker.0 00000100:00100000:2.0:1782222361.583567:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222361.583597:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1868795081875072:0@lo:400:kworker.0 00000100:00100000:2.0:1782222361.583625:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222361.583653:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782222361.583659:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1868795081874432:0@lo:400:kworker.0 00000100:00100000:2.0:1782222361.583682:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222361.583702:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1868795081874944:0@lo:400:kworker.0 00000100:00100000:2.0:1782222361.583721:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222361.583757:0:18230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081874560 00000100:00100000:2.0:1782222361.583766:0:18230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081874560 00000100:00100000:2.0:1782222361.583842:0:18230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1782222361.583853:0:18230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081874560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222361.584441:0:18230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081874560:12345-0@lo:400:kworker.0 Request processed in 109us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222361.584452:0:18230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1782222361.584486:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081875072 00000100:00100000:2.0:1782222361.584491:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081875072 00000100:00100000:2.0:1782222361.584527:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081874432 00000100:00100000:2.0:1782222361.584530:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081874432 00000100:00100000:2.0:1782222361.584567:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081874944 00000100:00100000:2.0:1782222361.584582:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081874944 00000100:00100000:2.0:1782222361.584598:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782222361.584605:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1868795081875072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222361.584643:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1868795081875072:12345-0@lo:400:kworker.0 Request processed in 38us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222361.584648:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782222361.584659:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1782222361.584664:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1868795081874432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222361.584704:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1868795081874432:12345-0@lo:400:kworker.0 Request processed in 39us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222361.584710:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1782222361.584720:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782222361.584725:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1868795081874944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222361.584745:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1868795081874944:12345-0@lo:400:kworker.0 Request processed in 21us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222361.584750:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1782222361.584785:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782222361.584790:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782222361.584803:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081874176:0@lo:400:kworker.0 00000100:00100000:2.0:1782222361.584839:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222361.584863:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081874688:0@lo:400:kworker.0 00000100:00100000:2.0:1782222361.584883:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222361.584899:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1868795081875200:0@lo:400:kworker.0 00000100:00100000:2.0:1782222361.584924:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222361.584941:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1782222361.584946:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081874304:0@lo:400:kworker.0 00000100:00100000:2.0:1782222361.584978:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222361.584995:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1868795081874816:0@lo:400:kworker.0 00000100:00100000:2.0:1782222361.585015:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222361.585029:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1868795081875328:0@lo:400:kworker.0 00000100:00100000:2.0:1782222361.585046:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222361.585068:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081874176 00000100:00100000:2.0:1782222361.585072:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081874176 00000100:00100000:2.0:1782222361.585095:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1782222361.585101:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081874176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222361.585137:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081874176:12345-0@lo:400:kworker.0 Request processed in 35us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222361.585142:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1782222361.585158:0:19827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081874688 00000100:00100000:2.0:1782222361.585161:0:19827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081874688 00000100:00100000:2.0:1782222361.585184:0:19827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081874304 00000100:00100000:2.0:1782222361.585187:0:19827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081874304 00000100:00100000:2.0:1782222361.585202:0:19827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782222361.585207:0:19827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081874688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222361.585269:0:19827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081874688:12345-0@lo:400:kworker.0 Request processed in 61us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222361.585281:0:19827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782222361.585291:0:19827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782222361.585297:0:19827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081874304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222361.585322:0:19827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081874304:12345-0@lo:400:kworker.0 Request processed in 25us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222361.585327:0:19827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782222361.585355:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081875200 00000100:00100000:2.0:1782222361.585358:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081875200 00000100:00100000:2.0:1782222361.585382:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081874816 00000100:00100000:2.0:1782222361.585385:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081874816 00000100:00100000:2.0:1782222361.585398:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081875328 00000100:00100000:2.0:1782222361.585400:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081875328 00000100:00100000:2.0:1782222361.585414:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782222361.585419:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1868795081875200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222361.585447:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1868795081875200:12345-0@lo:400:kworker.0 Request processed in 29us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222361.585453:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782222361.585464:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782222361.585469:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1868795081874816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222361.585491:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1868795081874816:12345-0@lo:400:kworker.0 Request processed in 22us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222361.585496:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782222361.585504:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1782222361.585508:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1868795081875328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222361.585529:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1868795081875328:12345-0@lo:400:kworker.0 Request processed in 21us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222361.585544:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1782222361.585567:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782222361.585582:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782222361.585628:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1868795081874432:0@lo:400:kworker.0 00000100:00100000:2.0:1782222361.585643:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1868795081874944:0@lo:400:kworker.0 00000100:00100000:2.0:1782222361.585655:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081874560:0@lo:400:kworker.0 00010000:00080000:2.0:1782222361.585671:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074561ca80 x1868795081875072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222361.585684:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1868795081875072:0@lo:400:kworker.0 00000100:00100000:2.0:1782222361.585731:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081874304:0@lo:400:kworker.0 00000100:00100000:2.0:1782222361.585740:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1868795081874816:0@lo:400:kworker.0 00010000:00080000:2.0:1782222361.585748:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f074561ed80 x1868795081875328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782222361.585758:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1868795081875328:0@lo:400:kworker.0 00000100:00100000:2.0:1782222361.585768:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081874176:0@lo:400:kworker.0 00000100:00100000:2.0:1782222361.585778:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081874688:0@lo:400:kworker.0 00000100:00100000:2.0:1782222361.585786:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1868795081875200:0@lo:400:kworker.0 00000100:00100000:3.0:1782222361.585998:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081874048 00000100:00100000:3.0:1782222361.586003:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081874048 00000100:00100000:3.0:1782222361.586050:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1782222361.586059:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+24:3656:x1868795081874048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222361.586126:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+24:3656:x1868795081874048:12345-0@lo:400:kworker.0 Request processed in 69us (2637us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222361.586143:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1782222361.586185:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0873f67-836f-4221-9522-aadc54ad715e:3656:1868795081874048:0@lo:400:kworker.0 00000020:00000080:2.0:1782222361.945355:0:20236:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffda96c5700 20000000:00000080:2.0:1782222361.945374:0:20236:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f0747085c00 uarg=0000000000000000 20000000:01000000:2.0:1782222361.945785:0:20236:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1782222361.945792:0:20236:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1782222361.945803:0:20236:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1782222361.946919:0:20237:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1782222361.947071:0:20236:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1782222361.957665:0:20236:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1782222361.958942:0:20236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f08483ec000/0xe2b7cc26e68128cf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222361.958985:0:20236:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f0746431c00/0xe2b7cc26e6812564 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e681255d expref: 23 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222361.958994:0:20236:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f087fb83600/0xe2b7cc26e6812572 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e681256b expref: 23 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222361.959002:0:20236:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f074744dc00/0xe2b7cc26e68125b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68125aa expref: 23 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222361.959009:0:20236:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f074744d600/0xe2b7cc26e681270f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6812708 expref: 23 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222361.959021:0:20236:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f08483ed200/0xe2b7cc26e681285f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755883a expref: 12 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222361.959029:0:20236:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f087fb82a00/0xe2b7cc26e681289e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75588aa expref: 12 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222361.959038:0:20236:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f08483ec000/0xe2b7cc26e68128cf lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222361.959109:0:20236:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f087fb82a00/0xe2b7cc26e681289e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75588aa expref: 12 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222361.959155:0:20236:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f087fb82a00/0xe2b7cc26e681289e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75588aa expref: 12 pid: 17202 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222361.959176:0:20236:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07475ab800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20236:1868795081875456:192.168.203.27@tcp:104: 00010000:00010000:3.0:1782222361.959474:0:20236:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f08483ed200/0xe2b7cc26e681285f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755883a expref: 12 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222361.959484:0:20236:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f08483ed200/0xe2b7cc26e681285f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755883a expref: 12 pid: 17203 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222361.959493:0:20236:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849b15c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20236:1868795081875584:192.168.203.27@tcp:104: 00010000:00010000:3.0:1782222361.959537:0:20236:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f074744d600/0xe2b7cc26e681270f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e6812708 expref: 23 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222361.959546:0:20236:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f074744d600/0xe2b7cc26e681270f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e6812708 expref: 23 pid: 17201 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222361.959556:0:20236:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747e70380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20236:1868795081875712:0@lo:104: 00000100:00100000:3.0:1782222361.961954:0:20236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222361.962043:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081875712 00000100:00100000:0.0:1782222361.962057:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081875712 00010000:00010000:3.0:1782222361.962095:0:20236:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f074744dc00/0xe2b7cc26e68125b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e68125aa expref: 23 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222361.962117:0:20236:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f074744dc00/0xe2b7cc26e68125b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e68125aa expref: 23 pid: 17202 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222361.962136:0:20236:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747e72a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20236:1868795081875840:0@lo:104: 00000100:00100000:0.0:1782222361.962138:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782222361.962158:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0873f67-836f-4221-9522-aadc54ad715e+3:20236:x1868795081875712:12345-0@lo:104: 00010000:00010000:0.0:1782222361.962200:0:17191:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f087fcb8e00/0xe2b7cc26e6812708 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e681270f expref: -99 pid: 19526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222361.962226:0:20236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222361.962310:0:17192:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1782222361.962322:0:17192:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:3.0:1782222361.962354:0:20236:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f087fb83600/0xe2b7cc26e6812572 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e681256b expref: 23 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222361.962354:0:17191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782222361.962367:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0873f67-836f-4221-9522-aadc54ad715e+3:20236:x1868795081875712:12345-0@lo:104: Request processed in 212us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222361.962389:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782222361.962405:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081875840 00000100:00100000:0.0:1782222361.962410:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081875840 00010000:00010000:3.0:1782222361.962421:0:20236:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f087fb83600/0xe2b7cc26e6812572 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e681256b expref: 23 pid: 17201 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222361.962436:0:20236:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747e73480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20236:1868795081875968:0@lo:104: 00000100:00100000:0.0:1782222361.962446:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782222361.962456:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0873f67-836f-4221-9522-aadc54ad715e+3:20236:x1868795081875840:12345-0@lo:104: 00010000:00010000:0.0:1782222361.962465:0:17191:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f087fb82200/0xe2b7cc26e68125aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e68125b1 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222361.962499:0:20236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782222361.962539:0:20236:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f0746431c00/0xe2b7cc26e6812564 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2b7cc26e681255d expref: 23 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222361.962548:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081875968 00010000:00010000:3.0:1782222361.962551:0:20236:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f0746431c00/0xe2b7cc26e6812564 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2b7cc26e681255d expref: 23 pid: 17203 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222361.962556:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081875968 00000100:00100000:3.0:1782222361.962580:0:20236:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747e72d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20236:1868795081876096:0@lo:104: 00000100:00100000:1.0:1782222361.962663:0:20238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782222361.962674:0:20238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a0873f67-836f-4221-9522-aadc54ad715e+4:20236:x1868795081875968:12345-0@lo:104: 00010000:00010000:0.0:1782222361.962678:0:17191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1782222361.962686:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0873f67-836f-4221-9522-aadc54ad715e+4:20236:x1868795081875840:12345-0@lo:104: Request processed in 231us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222361.962702:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1782222361.962785:0:17196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782222361.962791:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f087fcb8e00/0xe2b7cc26e6812708 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e681270f expref: -99 pid: 19526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222361.962798:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb8e00 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:0.0:1782222361.962802:0:17196:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f087fcb8e00/0xe2b7cc26e6812708 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e681270f expref: -99 pid: 19526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222361.962811:0:17196:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f087fcb8e00/0xe2b7cc26e6812708 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e681270f expref: -99 pid: 19526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782222361.962818:0:17196:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f087fcb8e00/0xe2b7cc26e6812708 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e681270f expref: -99 pid: 19526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222361.962822:0:20238:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f074744c800/0xe2b7cc26e681256b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6812572 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782222361.962824:0:17196:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782222361.962868:0:17196:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f087fcb8e00/0xe2b7cc26e6812708 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e681270f expref: -99 pid: 19526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222361.962877:0:20238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1782222361.962877:0:17196:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1782222361.962886:0:20238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a0873f67-836f-4221-9522-aadc54ad715e+3:20236:x1868795081875968:12345-0@lo:104: Request processed in 214us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222361.962893:0:20238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1782222361.962901:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f087fcb8e00/0xe2b7cc26e6812708 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e681270f expref: -99 pid: 19526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222361.962910:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f087fcb8e00/0xe2b7cc26e6812708 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e681270f expref: -99 pid: 19526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222361.962922:0:17196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782222361.962925:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f087fb82200/0xe2b7cc26e68125aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e68125b1 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222361.962939:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb82200 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:0.0:1782222361.962942:0:17196:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f087fb82200/0xe2b7cc26e68125aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e68125b1 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222361.962949:0:17196:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f087fb82200/0xe2b7cc26e68125aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e68125b1 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782222361.962954:0:17196:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f087fb82200/0xe2b7cc26e68125aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e68125b1 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782222361.962959:0:17196:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782222361.962972:0:17196:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f087fb82200/0xe2b7cc26e68125aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e68125b1 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222361.962977:0:17196:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782222361.962983:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f087fb82200/0xe2b7cc26e68125aa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e68125b1 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222361.962988:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f087fb82200/0xe2b7cc26e68125aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e68125b1 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222361.962997:0:17196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782222361.963000:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f074744c800/0xe2b7cc26e681256b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6812572 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222361.963005:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744c800 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:0.0:1782222361.963007:0:17196:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f074744c800/0xe2b7cc26e681256b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e6812572 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222361.963021:0:17196:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f074744c800/0xe2b7cc26e681256b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e6812572 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782222361.963027:0:17196:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f074744c800/0xe2b7cc26e681256b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e6812572 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782222361.963032:0:17196:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782222361.963044:0:17196:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f074744c800/0xe2b7cc26e681256b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6812572 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222361.963049:0:17196:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782222361.963061:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f074744c800/0xe2b7cc26e681256b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6812572 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222361.963067:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f074744c800/0xe2b7cc26e681256b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6812572 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222361.963077:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222361.963079:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222361.963080:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782222361.963086:0:19828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222361.963107:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0873f67-836f-4221-9522-aadc54ad715e:3655:1868795081876224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782222361.963145:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222361.963182:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782222361.963190:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0873f67-836f-4221-9522-aadc54ad715e:3655:1868795081876352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782222361.963212:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222361.963275:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782222361.963286:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081876224 00000100:00100000:0.0:1782222361.963287:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0873f67-836f-4221-9522-aadc54ad715e:3654:1868795081876480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782222361.963293:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081876224 00010000:00010000:1.0:1782222361.963317:0:17195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f074744d600/0xe2b7cc26e681270f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6812708 expref: 24 pid: 17201 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222361.963337:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081876352 00000100:00100000:1.0:1782222361.963340:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081876352 00010000:00010000:1.0:1782222361.963351:0:17195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f074744dc00/0xe2b7cc26e68125b1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e68125aa expref: 25 pid: 17202 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222361.963367:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782222361.963373:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0873f67-836f-4221-9522-aadc54ad715e+25:3655:x1868795081876224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782222361.963396:0:17195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222361.963402:0:17195:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f074744d600/0xe2b7cc26e681270f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e6812708 expref: 25 pid: 17201 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222361.963411:0:17195:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f074744d600/0xe2b7cc26e681270f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e6812708 expref: 25 pid: 17201 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222361.963428:0:17195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782222361.963456:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0873f67-836f-4221-9522-aadc54ad715e+25:3655:x1868795081876224:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222361.963463:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782222361.963484:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782222361.963489:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0873f67-836f-4221-9522-aadc54ad715e+24:3655:x1868795081876352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782222361.963496:0:17195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222361.963501:0:17195:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f074744dc00/0xe2b7cc26e68125b1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e68125aa expref: 24 pid: 17202 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222361.963510:0:17195:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f074744dc00/0xe2b7cc26e68125b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e68125aa expref: 24 pid: 17202 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222361.963519:0:17195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782222361.963540:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0873f67-836f-4221-9522-aadc54ad715e+24:3655:x1868795081876352:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222361.963545:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782222361.963817:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222361.963862:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081876480 00000100:00100000:1.0:1782222361.963868:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081876480 00010000:00010000:1.0:1782222361.963886:0:17195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f087fb83600/0xe2b7cc26e6812572 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e681256b expref: 24 pid: 17201 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222361.963897:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0873f67-836f-4221-9522-aadc54ad715e:3655:1868795081876352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782222361.963910:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0873f67-836f-4221-9522-aadc54ad715e:3655:1868795081876224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782222361.963914:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782222361.964012:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0873f67-836f-4221-9522-aadc54ad715e+24:3654:x1868795081876480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782222361.964021:0:17195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222361.964025:0:17195:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f087fb83600/0xe2b7cc26e6812572 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e681256b expref: 24 pid: 17201 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222361.964035:0:17195:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f087fb83600/0xe2b7cc26e6812572 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e681256b expref: 24 pid: 17201 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222361.964045:0:17195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782222361.964150:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0873f67-836f-4221-9522-aadc54ad715e+24:3654:x1868795081876480:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222361.964166:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782222361.964192:0:20236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222361.965540:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081876096 00000100:00100000:1.0:1782222361.965550:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081876096 00000100:00100000:1.0:1782222361.965605:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782222361.965615:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0873f67-836f-4221-9522-aadc54ad715e+3:20236:x1868795081876096:12345-0@lo:104: 00010000:00010000:1.0:1782222361.965630:0:17192:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e681255d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6812564 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222361.965695:0:17192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782222361.965701:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0873f67-836f-4221-9522-aadc54ad715e+3:20236:x1868795081876096:12345-0@lo:104: Request processed in 88us (1517us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222361.965707:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1782222361.965800:0:17197:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782222361.965808:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e681255d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2b7cc26e6812564 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222361.965817:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f074744d000 already unused, calling callback (ffffffffc138ac20) 10000000:00010000:2.0:1782222361.965822:0:17197:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e681255d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2b7cc26e6812564 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222361.965831:0:17197:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e681255d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2b7cc26e6812564 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782222361.965839:0:17197:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e681255d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2b7cc26e6812564 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782222361.965845:0:17197:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782222361.965962:0:17197:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e681255d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6812564 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222361.965969:0:17197:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782222361.965983:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e681255d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6812564 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222361.965990:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff8f074744d000/0xe2b7cc26e681255d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2b7cc26e6812564 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222361.966009:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222361.966011:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222361.966013:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222361.966021:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782222361.966033:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0873f67-836f-4221-9522-aadc54ad715e:3653:1868795081876608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782222361.966084:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222361.966126:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081876608 00000100:00100000:2.0:1782222361.966130:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081876608 00010000:00010000:2.0:1782222361.966151:0:17194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f0746431c00/0xe2b7cc26e6812564 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e681255d expref: 24 pid: 17203 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222361.966174:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782222361.966181:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0873f67-836f-4221-9522-aadc54ad715e+24:3653:x1868795081876608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782222361.966190:0:17194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782222361.966195:0:17194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f0746431c00/0xe2b7cc26e6812564 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2b7cc26e681255d expref: 24 pid: 17203 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222361.966205:0:17194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f0746431c00/0xe2b7cc26e6812564 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2b7cc26e681255d expref: 24 pid: 17203 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222361.966220:0:17194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782222361.966270:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0873f67-836f-4221-9522-aadc54ad715e+24:3653:x1868795081876608:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222361.966278:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782222361.966342:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0873f67-836f-4221-9522-aadc54ad715e:3653:1868795081876608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782222361.970797:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0873f67-836f-4221-9522-aadc54ad715e:3654:1868795081876480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782222361.970810:0:20236:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08490eda80 going to sleep for 11 seconds 00010000:00010000:2.0:1782222361.970838:0:20236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f074744d600/0xe2b7cc26e681270f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e6812708 expref: 23 pid: 17201 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222361.970845:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222361.970860:0:20236:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747e70380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20236:1868795081875712:0@lo:104: 00010000:00010000:2.0:1782222361.970872:0:20236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f074744dc00/0xe2b7cc26e68125b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e68125aa expref: 22 pid: 17202 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222361.970880:0:20236:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747e72a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20236:1868795081875840:0@lo:104: 00010000:00010000:2.0:1782222361.970907:0:20236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f087fb83600/0xe2b7cc26e6812572 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e681256b expref: 21 pid: 17201 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222361.970917:0:20236:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747e73480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20236:1868795081875968:0@lo:104: 00010000:00010000:2.0:1782222361.970927:0:20236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f0746431c00/0xe2b7cc26e6812564 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2b7cc26e681255d expref: 20 pid: 17203 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222361.970936:0:20236:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747e72d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20236:1868795081876096:0@lo:104: 00000100:00100000:2.0:1782222361.978861:0:20236:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07475ab800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20236:1868795081875456:192.168.203.27@tcp:104: 00000100:00100000:2.0:1782222361.991155:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222361.991327:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060809856 00000100:00100000:1.0:1782222361.991337:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060809856 00010000:00010000:1.0:1782222361.991416:0:17195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f087fb82a00/0xe2b7cc26e681289e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75588aa expref: 13 pid: 17202 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222361.991462:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 13 00000100:00100000:1.0:1782222361.991472:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087eec9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+13:2390:x1868795060809856:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782222361.991490:0:17195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222361.991497:0:17195:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8f087fb82a00/0xe2b7cc26e681289e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75588aa expref: 13 pid: 17202 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222361.991512:0:17195:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f087fb82a00/0xe2b7cc26e681289e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75588aa expref: 13 pid: 17202 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222361.991535:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f087fb82a00/0xe2b7cc26e681289e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75588aa expref: 13 pid: 17202 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222361.991589:0:17195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782222361.991668:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087eec9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+12:2390:x1868795060809856:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 196us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222361.991676:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 13 00000100:00100000:2.0:1782222361.992061:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222361.995965:0:20236:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849b15c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20236:1868795081875584:192.168.203.27@tcp:104: 00010000:00010000:3.0:1782222361.996029:0:20236:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f08483ec000/0xe2b7cc26e68128cf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222361.996957:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060809984 00000100:00100000:1.0:1782222361.996972:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060809984 00010000:00010000:1.0:1782222361.997028:0:17193:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f08483ed200/0xe2b7cc26e681285f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755883a expref: 12 pid: 17203 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222361.997081:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 14 00000100:00100000:1.0:1782222361.997091:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+12:2388:x1868795060809984:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782222361.997110:0:17193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222361.997116:0:17193:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8f08483ed200/0xe2b7cc26e681285f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755883a expref: 12 pid: 17203 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222361.997130:0:17193:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f08483ed200/0xe2b7cc26e681285f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755883a expref: 12 pid: 17203 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222361.997162:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f08483ed200/0xe2b7cc26e681285f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755883a expref: 12 pid: 17203 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222361.997193:0:17193:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f08483ec000/0xe2b7cc26e68128cf lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222361.997203:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f08483ec000/0xe2b7cc26e68128cf lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222361.997223:0:17193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f08483ec000/0xe2b7cc26e68128cf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222361.997271:0:17193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f08483ec000/0xe2b7cc26e68128cf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222361.997279:0:17193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f08483ec000/0xe2b7cc26e68128cf lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222361.997286:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f08483ec000/0xe2b7cc26e68128cf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222361.997294:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08483ec000 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:1.0:1782222361.997299:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f08483ec000/0xe2b7cc26e68128cf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222361.997310:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f08483ec000/0xe2b7cc26e68128cf lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222361.997324:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f08483ec000/0xe2b7cc26e68128cf lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222361.997335:0:17193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782222362.001437:0:20236:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f08483ec000/0xe2b7cc26e68128cf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222362.001470:0:20236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f08483ec000/0xe2b7cc26e68128cf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222362.001483:0:20236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f08483ec000/0xe2b7cc26e68128cf lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222362.003583:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+11:2388:x1868795060809984:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 6465us (11494us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222362.003602:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 14 00010000:00010000:0.0:1782222362.413123:0:19828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222363.046890:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222363.046934:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222363.046972:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222363.046995:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222363.047022:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222363.047041:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222363.047081:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222363.047103:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222363.047128:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222363.047162:0:19827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060810496 00000100:00100000:3.0:1782222363.047174:0:19827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060810496 00000100:00100000:3.0:1782222363.047313:0:19827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060811008 00000100:00100000:3.0:1782222363.047317:0:19827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060811008 00000100:00100000:3.0:1782222363.047334:0:19827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060810624 00000100:00100000:3.0:1782222363.047337:0:19827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060810624 00000100:00100000:3.0:1782222363.047349:0:19827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060811136 00000100:00100000:3.0:1782222363.047351:0:19827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060811136 00000100:00100000:3.0:1782222363.047366:0:19827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 19 00000100:00100000:3.0:1782222363.047376:0:19827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+5:2388:x1868795060810496:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222363.047459:0:19827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+5:2388:x1868795060810496:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 85us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222363.047467:0:19827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 19 00000100:00100000:3.0:1782222363.047484:0:19827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 20 00000100:00100000:3.0:1782222363.047490:0:19827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086547d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c320fdbb-74fa-4205-b5df-42980d45bb62+5:2388:x1868795060811008:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222363.047513:0:19827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086547d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c320fdbb-74fa-4205-b5df-42980d45bb62+5:2388:x1868795060811008:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 23us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222363.047519:0:19827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 20 00000100:00100000:3.0:1782222363.047682:0:19827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 21 00000100:00100000:3.0:1782222363.047688:0:19827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+5:2388:x1868795060810624:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222363.047724:0:19827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+5:2388:x1868795060810624:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 36us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222363.047731:0:19827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 21 00000100:00100000:3.0:1782222363.047743:0:19827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 22 00000100:00100000:3.0:1782222363.047749:0:19827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c320fdbb-74fa-4205-b5df-42980d45bb62+5:2388:x1868795060811136:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222363.047772:0:19827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c320fdbb-74fa-4205-b5df-42980d45bb62+5:2388:x1868795060811136:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 23us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222363.047778:0:19827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 22 00000100:00100000:3.0:1782222363.047798:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060810240 00000100:00100000:3.0:1782222363.047801:0:19481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060810240 00000100:00100000:3.0:1782222363.047830:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060810752 00000100:00100000:3.0:1782222363.047834:0:19481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060810752 00000100:00100000:3.0:1782222363.047847:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060810368 00000100:00100000:3.0:1782222363.047850:0:19481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060810368 00000100:00100000:3.0:1782222363.047862:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060810880 00000100:00100000:3.0:1782222363.047864:0:19481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060810880 00000100:00100000:3.0:1782222363.047876:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 54 00000100:00100000:3.0:1782222363.047883:0:19481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+6:2388:x1868795060810240:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222363.047909:0:19481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+6:2388:x1868795060810240:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 27us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222363.047915:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 54 00000100:00100000:3.0:1782222363.047925:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 55 00000100:00100000:3.0:1782222363.047930:0:19481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c320fdbb-74fa-4205-b5df-42980d45bb62+6:2388:x1868795060810752:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222363.047949:0:19481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c320fdbb-74fa-4205-b5df-42980d45bb62+6:2388:x1868795060810752:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 20us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222363.047965:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 55 00000100:00100000:3.0:1782222363.047975:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 56 00000100:00100000:3.0:1782222363.047981:0:19481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+5:2388:x1868795060810368:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222363.048002:0:19481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+5:2388:x1868795060810368:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 21us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222363.048008:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 56 00000100:00100000:3.0:1782222363.048017:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 57 00000100:00100000:3.0:1782222363.048023:0:19481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c320fdbb-74fa-4205-b5df-42980d45bb62+5:2388:x1868795060810880:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222363.048044:0:19481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c320fdbb-74fa-4205-b5df-42980d45bb62+5:2388:x1868795060810880:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 21us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222363.048050:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 57 00000100:00100000:3.0:1782222363.048074:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060810112 00000100:00100000:3.0:1782222363.048078:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060810112 00000100:00100000:3.0:1782222363.048104:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 147 00000100:00100000:3.0:1782222363.048110:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+11:2388:x1868795060810112:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222363.048128:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+11:2388:x1868795060810112:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 19us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222363.048133:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 147 00000100:00080000:3.0:1782222363.048169:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782222363.048172:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782222363.048175:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782222363.048177:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:2.0:1782222363.372639:0:17206:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782222363.372649:0:17206:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f0746531000 from 13 10000000:01000000:2.0:1782222363.372656:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782222363.372729:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb82a00/0xe2b7cc26e68128d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222363.372744:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f087fb82a00/0xe2b7cc26e68128d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222363.372757:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f087fb82a00/0xe2b7cc26e68128d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222363.372799:0:17206:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cfdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081876736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782222363.372892:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222363.372946:0:17206:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b63e900 going to sleep for 11 seconds 00000100:00100000:0.0:1782222363.374006:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081876736 00000100:00100000:0.0:1782222363.374023:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081876736 00000100:00100000:0.0:1782222363.374107:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1782222363.374119:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+20:17206:x1868795081876736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782222363.374138:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222363.374171:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f087fcb9c00/0xe2b7cc26e68128dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e68128d6 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222363.374205:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fcb9c00/0xe2b7cc26e68128dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e68128d6 expref: 21 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222363.374218:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f087fcb9c00/0xe2b7cc26e68128dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68128d6 expref: 21 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222363.374228:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fcb9c00, rc 0) 00000100:00100000:0.0:1782222363.374502:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+21:17206:x1868795081876736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 384us (1609us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222363.374511:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1782222363.375651:0:17206:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cfdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081876736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782222363.375689:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f087fb82a00/0xe2b7cc26e68128d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68128dd expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222363.375732:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f087fb82a00/0xe2b7cc26e68128d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e68128dd expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222363.375879:0:17206:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cfdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081876864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782222363.375938:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222363.375984:0:17206:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b63e900 going to sleep for 11 seconds 00000100:00100000:1.0:1782222363.376361:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081876864 00000100:00100000:1.0:1782222363.376369:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081876864 00000100:00100000:1.0:1782222363.376419:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1782222363.376429:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+21:17206:x1868795081876864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782222363.376611:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+21:17206:x1868795081876864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 182us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222363.376628:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1782222363.378421:0:17206:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cfdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081876864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782222363.378497:0:17206:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cfdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081876992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782222363.378707:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222363.378762:0:17206:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b63e900 going to sleep for 11 seconds 00000100:00100000:1.0:1782222363.378977:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081876992 00000100:00100000:1.0:1782222363.378985:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081876992 00000100:00100000:1.0:1782222363.379038:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1782222363.379049:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+21:17206:x1868795081876992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782222363.379218:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+21:17206:x1868795081876992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222363.379225:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1782222363.379766:0:17206:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cfdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081876992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1782222363.382600:0:20257:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1782222363.382951:0:17206:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1782222363.382982:0:17206:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782222363.382999:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb82a00/0xe2b7cc26e68128d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68128dd expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222363.383035:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f087fb82a00/0xe2b7cc26e68128d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68128dd expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782222363.383049:0:17206:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782222363.383053:0:17206:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f08815e5000 from 13 10000000:01000000:0.0:1782222363.383056:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782222363.383108:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fcb8c00/0xe2b7cc26e68128e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222363.383116:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f087fcb8c00/0xe2b7cc26e68128e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222363.383128:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f087fcb8c00/0xe2b7cc26e68128e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222363.383169:0:17206:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081877120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782222363.383437:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222363.383497:0:17206:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b795000 going to sleep for 11 seconds 00000100:00100000:1.0:1782222363.383596:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081877120 00000100:00100000:1.0:1782222363.383606:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081877120 00000100:00100000:1.0:1782222363.383666:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1782222363.383677:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f08664eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+21:17206:x1868795081877120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782222363.383704:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222363.383727:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f0841458400/0xe2b7cc26e68128eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e68128e4 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222363.383756:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f0841458400/0xe2b7cc26e68128eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e68128e4 expref: 22 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222363.383768:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f0841458400/0xe2b7cc26e68128eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68128e4 expref: 22 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222363.383778:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0841458400, rc 0) 00000100:00100000:1.0:1782222363.387051:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f08664eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+22:17206:x1868795081877120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3360us (3599us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222363.387067:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1782222363.387169:0:17206:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081877120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782222363.387218:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f087fcb8c00/0xe2b7cc26e68128e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68128eb expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222363.389359:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f087fcb8c00/0xe2b7cc26e68128e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e68128eb expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222363.389502:0:17206:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088163d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081877248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782222363.391445:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222363.391507:0:17206:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f07464063c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782222363.391950:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081877248 00000100:00100000:0.0:1782222363.391961:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081877248 00000100:00100000:0.0:1782222363.392027:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1782222363.392037:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+22:17206:x1868795081877248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782222363.392227:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+22:17206:x1868795081877248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 191us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222363.396442:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1782222363.397095:0:17206:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088163d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081877248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782222363.397180:0:17206:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cfdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081877376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782222363.397387:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222363.397430:0:17206:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b72a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782222363.399178:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081877376 00000100:00100000:0.0:1782222363.399197:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081877376 00000100:00100000:0.0:1782222363.399866:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1782222363.399900:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+22:17206:x1868795081877376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782222363.400121:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+22:17206:x1868795081877376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 225us (2733us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222363.400130:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1782222363.400495:0:17206:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cfdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081877376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782222363.409603:0:20258:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1782222363.411513:0:17206:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1782222363.411573:0:17206:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782222363.411588:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fcb8c00/0xe2b7cc26e68128e4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68128eb expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222363.411624:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f087fcb8c00/0xe2b7cc26e68128e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68128eb expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782222363.411638:0:17206:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782222363.411641:0:17206:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f08516c3800 from 13 10000000:01000000:3.0:1782222363.411645:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782222363.411696:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f08483ece00/0xe2b7cc26e68128f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222363.411705:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f08483ece00/0xe2b7cc26e68128f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222363.411728:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f08483ece00/0xe2b7cc26e68128f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222363.411761:0:17206:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747e73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081877504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782222363.411861:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222363.411916:0:17206:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08490ed540 going to sleep for 11 seconds 00000100:00100000:0.0:1782222363.412148:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081877504 00000100:00100000:0.0:1782222363.412158:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081877504 00000100:00100000:0.0:1782222363.412229:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1782222363.412400:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+22:17206:x1868795081877504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782222363.412426:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222363.412446:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f087fcb8e00/0xe2b7cc26e68128f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e68128f2 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222363.412481:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fcb8e00/0xe2b7cc26e68128f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e68128f2 expref: 23 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222363.412495:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f087fcb8e00/0xe2b7cc26e68128f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e68128f2 expref: 23 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222363.412505:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fcb8e00, rc 0) 00000100:00100000:0.0:1782222363.412585:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+23:17206:x1868795081877504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222363.412592:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1782222363.415894:0:17206:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747e73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081877504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782222363.415933:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f08483ece00/0xe2b7cc26e68128f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68128f9 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222363.415949:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f08483ece00/0xe2b7cc26e68128f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e68128f9 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222363.416082:0:17206:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747e73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081877632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782222363.416163:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222363.416475:0:17206:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08490ed540 going to sleep for 11 seconds 00000100:00100000:2.0:1782222363.416574:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081877632 00000100:00100000:2.0:1782222363.416583:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081877632 00000100:00100000:2.0:1782222363.416642:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1782222363.416653:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+23:17206:x1868795081877632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782222363.416843:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+23:17206:x1868795081877632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 192us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222363.416862:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1782222363.417123:0:17206:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747e73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081877632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782222363.417170:0:17206:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747e73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081877760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782222363.417225:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222363.417518:0:17206:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08490ed540 going to sleep for 11 seconds 00000100:00100000:0.0:1782222363.432138:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081877760 00000100:00100000:0.0:1782222363.432161:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081877760 00000100:00100000:0.0:1782222363.432265:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1782222363.432277:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+23:17206:x1868795081877760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782222363.434080:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+23:17206:x1868795081877760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1795us (16844us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222363.434105:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1782222363.437406:0:17206:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747e73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081877760:0@lo:503:ll_cfg_requeue.0 00010000:00010000:2.0:1782222363.437683:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782222363.439350:0:20260:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1782222363.439723:0:17206:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1782222363.439749:0:17206:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782222363.439766:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f08483ece00/0xe2b7cc26e68128f2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68128f9 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222363.439790:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f08483ece00/0xe2b7cc26e68128f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e68128f9 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782222363.439803:0:17206:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782222363.439806:0:17206:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8f0748460800 from 13 10000000:01000000:2.0:1782222363.439810:0:17206:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782222363.439865:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb83600/0xe2b7cc26e6812900 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222363.439874:0:17206:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff8f087fb83600/0xe2b7cc26e6812900 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222363.439887:0:17206:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff8f087fb83600/0xe2b7cc26e6812900 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222363.439918:0:17206:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cfdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081877888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782222363.440006:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222363.440058:0:17206:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b63e600 going to sleep for 11 seconds 00000100:00100000:3.0:1782222363.440435:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081877888 00000100:00100000:3.0:1782222363.440443:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081877888 00000100:00100000:3.0:1782222363.440507:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1782222363.440519:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+23:17206:x1868795081877888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782222363.440535:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222363.440769:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f08483ec000/0xe2b7cc26e6812907 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2b7cc26e6812900 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222363.441472:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f08483ec000/0xe2b7cc26e6812907 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2b7cc26e6812900 expref: 24 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222363.441487:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f08483ec000/0xe2b7cc26e6812907 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2b7cc26e6812900 expref: 24 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222363.441498:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f08483ec000, rc 0) 00000100:00100000:3.0:1782222363.442455:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0873f67-836f-4221-9522-aadc54ad715e+24:17206:x1868795081877888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1931us (2442us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222363.442467:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1782222363.443564:0:17206:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cfdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081877888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782222363.443596:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff8f087fb83600/0xe2b7cc26e6812900 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812907 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222363.443625:0:17206:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff8f087fb83600/0xe2b7cc26e6812900 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2b7cc26e6812907 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222363.443743:0:17206:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cfdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081878016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782222363.443812:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222363.443854:0:17206:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b63e600 going to sleep for 11 seconds 00000100:00100000:2.0:1782222363.443879:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081878016 00000100:00100000:2.0:1782222363.443885:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081878016 00000100:00100000:2.0:1782222363.443933:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1782222363.443942:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+24:17206:x1868795081878016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782222363.444081:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+24:17206:x1868795081878016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222363.444088:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1782222363.444122:0:17206:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cfdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081878016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782222363.444150:0:17206:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cfdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081878144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782222363.444192:0:17206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222363.444205:0:17206:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f086b63e600 going to sleep for 11 seconds 00000100:00100000:2.0:1782222363.444216:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081878144 00000100:00100000:2.0:1782222363.444219:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081878144 00000100:00100000:2.0:1782222363.444600:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1782222363.444610:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+24:17206:x1868795081878144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782222363.444715:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+24:17206:x1868795081878144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222363.444722:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1782222363.444774:0:17206:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cfdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0873f67-836f-4221-9522-aadc54ad715e:17206:1868795081878144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1782222363.448634:0:20261:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1782222363.451263:0:17206:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1782222363.451338:0:17206:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782222363.451384:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff8f087fb83600/0xe2b7cc26e6812900 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812907 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222363.451401:0:17206:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff8f087fb83600/0xe2b7cc26e6812900 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2b7cc26e6812907 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222363.498492:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222363.498619:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060811264 00000100:00100000:2.0:1782222363.498633:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060811264 00000100:00100000:2.0:1782222363.498711:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 160 00000100:00100000:2.0:1782222363.498723:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+11:14931:x1868795060811264:12345-192.168.203.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782222363.498745:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222363.498777:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f087fb82800/0xe2b7cc26e681290e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x558f77f2f75588e2 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222363.498814:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f087fb82800/0xe2b7cc26e681290e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75588e2 expref: 12 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222363.498828:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f087fb82800/0xe2b7cc26e681290e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75588e2 expref: 12 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222363.498840:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fb82800, rc 0) 00000100:00100000:2.0:1782222363.498913:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+12:14931:x1868795060811264:12345-192.168.203.27@tcp:101:ll_cfg_requeue.0 Request processed in 191us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222363.498920:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 160 00000100:00100000:0.0:1782222363.504907:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222363.507532:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060811392 00000100:00100000:3.0:1782222363.507550:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060811392 00000100:00100000:3.0:1782222363.507648:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 161 00000100:00100000:3.0:1782222363.507660:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+12:14931:x1868795060811392:12345-192.168.203.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782222363.508193:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+12:14931:x1868795060811392:12345-192.168.203.27@tcp:501:ll_cfg_requeue.0 Request processed in 532us (3297us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222363.508205:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 161 00000100:00100000:2.0:1782222363.514753:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222363.515458:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060811520 00000100:00100000:0.0:1782222363.515472:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060811520 00000100:00100000:0.0:1782222363.515548:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 162 00000100:00100000:0.0:1782222363.515570:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+12:14931:x1868795060811520:12345-192.168.203.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782222363.517138:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+12:14931:x1868795060811520:12345-192.168.203.27@tcp:503:ll_cfg_requeue.0 Request processed in 1569us (2387us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222363.517154:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 162 00000100:00100000:0.0:1782222363.533954:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222363.534329:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060811648 00000100:00100000:3.0:1782222363.534342:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060811648 00000100:00100000:3.0:1782222363.534431:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 163 00000100:00100000:3.0:1782222363.534442:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+12:14931:x1868795060811648:12345-192.168.203.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782222363.534465:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222363.534488:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f08483ed200/0xe2b7cc26e6812915 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x558f77f2f75588e9 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222363.534528:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f08483ed200/0xe2b7cc26e6812915 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75588e9 expref: 13 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222363.534542:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f08483ed200/0xe2b7cc26e6812915 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75588e9 expref: 13 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222363.534552:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f08483ed200, rc 0) 00000100:00100000:3.0:1782222363.534652:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+13:14931:x1868795060811648:12345-192.168.203.27@tcp:101:ll_cfg_requeue.0 Request processed in 211us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222363.534661:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 163 00000100:00100000:1.0:1782222363.542550:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222363.543929:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060811776 00000100:00100000:0.0:1782222363.543946:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060811776 00000100:00100000:0.0:1782222363.544030:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 164 00000100:00100000:0.0:1782222363.544042:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+13:14931:x1868795060811776:12345-192.168.203.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782222363.545993:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+13:14931:x1868795060811776:12345-192.168.203.27@tcp:501:ll_cfg_requeue.0 Request processed in 194us (1700us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222363.546013:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 164 00000100:00100000:3.0:1782222363.550154:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222363.551728:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060811904 00000100:00100000:0.0:1782222363.551746:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060811904 00000100:00100000:0.0:1782222363.551838:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 165 00000100:00100000:0.0:1782222363.551851:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+13:14931:x1868795060811904:12345-192.168.203.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782222363.552222:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+13:14931:x1868795060811904:12345-192.168.203.27@tcp:503:ll_cfg_requeue.0 Request processed in 371us (2078us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222363.552275:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 165 00010000:00010000:0.0:1782222364.458706:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222365.484299:0:19828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222365.679757:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782222365.679782:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081878272:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782222365.679835:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782222365.679849:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081878400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782222365.679856:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222365.679892:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222365.679904:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081878528:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782222365.679933:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222365.679993:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081878272 00000100:00100000:2.0:1782222365.680000:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081878272 00000100:00100000:2.0:1782222365.680040:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081878528 00000100:00100000:2.0:1782222365.680043:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081878528 00000100:00100000:2.0:1782222365.680059:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782222365.680067:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081878272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782222365.680101:0:17213:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1782222365.680160:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081878272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222365.680168:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782222365.680185:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782222365.680192:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081878528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782222365.680210:0:17213:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1782222365.680263:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081878528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222365.680269:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782222365.680289:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081878400 00000100:00100000:2.0:1782222365.680293:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081878400 00000100:00100000:2.0:1782222365.680328:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782222365.680334:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081878400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782222365.680350:0:18718:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1782222365.680383:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081878400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222365.680390:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1782222365.680409:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782222365.680453:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081878528:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782222365.680485:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081878400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782222365.680519:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081878272:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782222365.680687:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081878656:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782222365.680717:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222365.680936:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081878656 00000100:00100000:2.0:1782222365.680941:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081878656 00000100:00100000:2.0:1782222365.681006:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782222365.681013:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081878656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782222365.681024:0:18718:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1782222365.681056:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081878656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222365.681062:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1782222365.688628:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782222365.688950:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081878656:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1782222366.506803:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222366.698682:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081879168:0@lo:400:kworker.0 00000100:00100000:0.0:1782222366.698752:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222366.698795:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081879680:0@lo:400:kworker.0 00000100:00100000:1.0:1782222366.698911:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081878784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782222366.698943:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222366.698963:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081879296:0@lo:400:kworker.0 00000100:00100000:1.0:1782222366.698985:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222366.699003:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081879808:0@lo:400:kworker.0 00000100:00100000:1.0:1782222366.699023:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222366.699040:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1868795081880320:0@lo:400:kworker.0 00000100:00100000:1.0:1782222366.699062:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222366.699107:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0873f67-836f-4221-9522-aadc54ad715e:3653:1868795081879040:0@lo:400:kworker.0 00000100:00100000:2.0:1782222366.699139:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222366.699162:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081879552:0@lo:400:kworker.0 00000100:00100000:2.0:1782222366.699183:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222366.699199:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1868795081880064:0@lo:400:kworker.0 00000100:00100000:2.0:1782222366.699218:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222366.699428:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1868795081880576:0@lo:400:kworker.0 00000100:00100000:2.0:1782222366.699454:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222366.699491:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081879168 00000100:00100000:2.0:1782222366.699497:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081879168 00000100:00100000:2.0:1782222366.699551:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782222366.699560:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081879168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782222366.699608:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081879168:12345-0@lo:400:kworker.0 Request processed in 49us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222366.699615:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782222366.699649:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081878784 00000100:00100000:2.0:1782222366.699652:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081878784 00000100:00100000:2.0:1782222366.699683:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782222366.699690:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081878784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782222366.699711:0:18718:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1782222366.699828:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222366.699848:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1868795081880192:0@lo:400:kworker.0 00000100:00100000:0.0:1782222366.699870:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222366.699917:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081879168:0@lo:400:kworker.0 00000100:00100000:0.0:1782222366.699942:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081880320 00000100:00100000:0.0:1782222366.699945:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081880320 00000100:00100000:0.0:1782222366.700138:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081879552 00000100:00100000:0.0:1782222366.700142:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081879552 00000100:00100000:0.0:1782222366.700155:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081880064 00000100:00100000:0.0:1782222366.700157:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081880064 00000100:00100000:0.0:1782222366.700167:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081880576 00000100:00100000:0.0:1782222366.700170:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081880576 00000100:00100000:0.0:1782222366.700181:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081880192 00000100:00100000:0.0:1782222366.700183:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081880192 00000100:00100000:0.0:1782222366.700197:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1782222366.700204:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1868795081880320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222366.710171:0:19827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081879296 00000100:00100000:3.0:1782222366.710185:0:19827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081879296 00000100:00100000:3.0:1782222366.710259:0:19827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081879808 00000100:00100000:3.0:1782222366.710263:0:19827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081879808 00000100:00100000:3.0:1782222366.710289:0:19827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782222366.710299:0:19827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081879296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222366.710397:0:19827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081879296:12345-0@lo:400:kworker.0 Request processed in 100us (11410us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222366.710404:0:19827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782222366.710422:0:19827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782222366.710429:0:19827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081879808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222366.710473:0:19827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081879808:12345-0@lo:400:kworker.0 Request processed in 44us (11448us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222366.710490:0:19827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782222366.710616:0:18230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081879680 00000100:00100000:3.0:1782222366.710620:0:18230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081879680 00000100:00100000:3.0:1782222366.710647:0:18230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782222366.710653:0:18230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081879680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222366.711039:0:18230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081879680:12345-0@lo:400:kworker.0 Request processed in 385us (11209us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222366.711062:0:18230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782222366.711087:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782222366.711095:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081879552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222366.711136:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1868795081879552:12345-0@lo:400:kworker.0 Request processed in 43us (11952us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222366.711142:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782222366.711156:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782222366.711162:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1868795081880064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222366.711187:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1868795081880064:12345-0@lo:400:kworker.0 Request processed in 26us (11968us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222366.711192:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782222366.711202:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782222366.711208:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1868795081880576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222366.711253:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1868795081880576:12345-0@lo:400:kworker.0 Request processed in 26us (11779us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222366.711258:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782222366.711269:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782222366.711276:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1868795081880192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222366.711304:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1868795081880192:12345-0@lo:400:kworker.0 Request processed in 30us (11434us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222366.711310:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782222366.711353:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1868795081879552:0@lo:400:kworker.0 00000100:00100000:3.0:1782222366.711364:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1868795081880064:0@lo:400:kworker.0 00010000:00080000:3.0:1782222366.711384:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747780700 x1868795081880576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222366.711394:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1868795081880576:0@lo:400:kworker.0 00000100:00080000:3.0:1782222366.711431:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782222366.714508:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782222366.714512:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782222366.714592:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081879040 00000100:00100000:3.0:1782222366.714601:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081879040 00000100:00100000:3.0:1782222366.714658:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1782222366.714667:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+24:3653:x1868795081879040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222366.716098:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0873f67-836f-4221-9522-aadc54ad715e+24:3653:x1868795081879040:12345-0@lo:400:kworker.0 Request processed in 1415us (16940us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222366.716110:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1782222366.716181:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0873f67-836f-4221-9522-aadc54ad715e:3653:1868795081879040:0@lo:400:kworker.0 00000100:00100000:3.0:1782222366.716211:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081879680:0@lo:400:kworker.0 00000100:00100000:3.0:1782222366.716220:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1868795081880192:0@lo:400:kworker.0 00000100:00100000:3.0:1782222366.716275:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747e70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081878912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782222366.716304:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222366.716320:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081879424:0@lo:400:kworker.0 00000100:00100000:3.0:1782222366.716334:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222366.716343:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081879936:0@lo:400:kworker.0 00000100:00100000:3.0:1782222366.716352:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222366.716361:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1868795081880448:0@lo:400:kworker.0 00000100:00100000:3.0:1782222366.716390:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222366.716413:0:18717:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1782222366.716419:0:18717:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:3.0:1782222366.716429:0:19827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081879424 00000100:00100000:3.0:1782222366.716432:0:19827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081879424 00000100:00100000:1.0:1782222366.716692:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081880448 00000100:00100000:1.0:1782222366.716707:0:19481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081880448 00000100:00100000:1.0:1782222366.716756:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1782222366.716765:0:19481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1868795081880448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222366.721440:0:19481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1868795081880448:12345-0@lo:400:kworker.0 Request processed in 4668us (5038us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222366.721455:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1782222366.721497:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782222366.721573:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1868795081880448:0@lo:400:kworker.0 00000100:00100000:2.0:1782222366.721742:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081878784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 22051us (22796us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222366.721752:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782222366.721781:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081878912 00000100:00100000:2.0:1782222366.721787:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081878912 00000100:00080000:2.0:1782222366.721824:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782222366.721851:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782222366.721858:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081878912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782222366.721898:0:18718:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1782222366.721906:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1868795081880320:12345-0@lo:400:kworker.0 Request processed in 21702us (22842us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222366.721920:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782222366.721953:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081878912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (5647us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222366.721959:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782222366.721985:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747e70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081878912:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782222366.722194:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081879936 00000100:00100000:0.0:1782222366.722199:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081879936 00000100:00100000:0.0:1782222366.722226:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782222366.722253:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081879936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782222366.722295:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081879936:12345-0@lo:400:kworker.0 Request processed in 61us (5939us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222366.722301:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782222366.722329:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081879936:0@lo:400:kworker.0 00000100:00100000:1.0:1782222366.722618:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081878784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782222366.722631:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081879296:0@lo:400:kworker.0 00000100:00100000:1.0:1782222366.722643:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081879808:0@lo:400:kworker.0 00010000:00080000:1.0:1782222366.722656:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747782d80 x1868795081880320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782222366.722667:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1868795081880320:0@lo:400:kworker.0 00000100:00100000:3.0:1782222366.726359:0:19827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782222366.726368:0:19827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081879424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222366.726454:0:19827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081879424:12345-0@lo:400:kworker.0 Request processed in 87us (10118us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222366.726459:0:19827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782222366.726603:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081879424:0@lo:400:kworker.0 00000040:00080000:0.0:1782222367.149917:0:17242:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1782222367.530409:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782222368.135577:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222368.138227:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060812032 00000100:00100000:3.0:1782222368.138291:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060812032 00000100:00080000:2.0:1782222368.140168:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782222368.140304:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 23 00000100:00100000:2.0:1782222368.140324:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+6:15601:x1868795060812032:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782222368.140350:0:17210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222368.140378:0:17210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e681291c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75588f0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.140460:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82200/0xe2b7cc26e6812923 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.140514:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82200/0xe2b7cc26e6812923 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.140540:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82200/0xe2b7cc26e6812923 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.140557:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e681292a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.140565:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e681292a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.140572:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e681292a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.140671:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3e00/0xe2b7cc26e6812931 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.140831:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3e00/0xe2b7cc26e6812931 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.140840:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3e00/0xe2b7cc26e6812931 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782222368.140880:0:17210:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782222368.140884:0:17210:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782222368.140932:0:17210:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3e00/0xe2b7cc26e6812931 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.140954:0:17210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82200/0xe2b7cc26e6812923 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.140971:0:17210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82200/0xe2b7cc26e6812923 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.140977:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82200/0xe2b7cc26e6812923 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.140983:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb82200 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222368.140989:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82200/0xe2b7cc26e6812923 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.140997:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82200/0xe2b7cc26e6812923 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.141011:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0843b9b000) 00010000:00010000:2.0:1782222368.141014:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782222368.141020:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82200/0xe2b7cc26e6812923 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.141026:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb82200/0xe2b7cc26e6812923 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.141043:0:17210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e681292a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.141048:0:17210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e681292a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.141053:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e681292a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.141058:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fb83200 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222368.141066:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e681292a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.141072:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e681292a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.141080:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8f087f8f2600) 00010000:00010000:2.0:1782222368.141082:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782222368.141085:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e681292a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.141090:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83200/0xe2b7cc26e681292a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.141128:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fb83000/0xe2b7cc26e681291c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75588f0 expref: 8 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.141142:0:17210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3e00/0xe2b7cc26e6812931 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75588f0 expref: 7 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.141149:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f087f8f2d00) 00010000:00010000:2.0:1782222368.141152:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782222368.141154:0:17210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f08413d3e00, rc 0) 00000100:00100000:2.0:1782222368.142900:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+7:15601:x1868795060812032:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 2574us (7324us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222368.142913:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 23 00000100:00100000:3.0:1782222368.154977:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222368.155125:0:17220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060812160 00000100:00100000:2.0:1782222368.155138:0:17220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060812160 00000100:00100000:2.0:1782222368.155203:0:17220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 5 00000100:00100000:2.0:1782222368.155214:0:17220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+7:15601:x1868795060812160:12345-192.168.203.27@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1782222368.155363:0:17220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+7:15601:x1868795060812160:12345-192.168.203.27@tcp:900:lhsmtool_posix.0 Request processed in 150us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222368.155372:0:17220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 5 00000100:00100000:1.0:1782222368.199777:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222368.199836:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222368.199871:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222368.199902:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222368.199917:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222368.199932:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222368.200000:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060812544 00000100:00100000:3.0:1782222368.200014:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060812544 00000100:00100000:3.0:1782222368.200093:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060813056 00000100:00100000:3.0:1782222368.200097:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060813056 00000100:00100000:3.0:1782222368.200109:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060812672 00000100:00100000:3.0:1782222368.200111:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060812672 00000100:00100000:3.0:1782222368.200142:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 27 00000100:00100000:2.0:1782222368.200492:0:20002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060812800 00000100:00100000:2.0:1782222368.200497:0:20002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060812800 00000100:00100000:2.0:1782222368.200547:0:20002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060812416 00000100:00100000:2.0:1782222368.200550:0:20002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060812416 00000100:00100000:2.0:1782222368.200573:0:20002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 64 00000100:00100000:2.0:1782222368.200583:0:20002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c320fdbb-74fa-4205-b5df-42980d45bb62+6:2388:x1868795060812800:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222368.200694:0:20002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c320fdbb-74fa-4205-b5df-42980d45bb62+6:2388:x1868795060812800:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 112us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222368.200710:0:20002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 64 00000100:00100000:2.0:1782222368.200727:0:20002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 65 00000100:00100000:2.0:1782222368.200733:0:20002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d3282c7-c1ac-4cf8-a606-482b3aabf172+5:2388:x1868795060812416:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222368.200765:0:20002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d3282c7-c1ac-4cf8-a606-482b3aabf172+5:2388:x1868795060812416:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 32us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222368.200772:0:20002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 65 00000100:00080000:2.0:1782222368.200817:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782222368.200822:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782222368.200825:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782222368.200828:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782222368.200897:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060812288 00000100:00100000:0.0:1782222368.200902:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060812288 00000100:00100000:0.0:1782222368.200933:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 167 00000100:00100000:0.0:1782222368.200951:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087690c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+13:2388:x1868795060812288:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222368.200978:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087690c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+13:2388:x1868795060812288:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 39us (1217us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222368.200984:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 167 00000100:00100000:1.0:1782222368.201136:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222368.201207:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222368.201231:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222368.201345:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060812928 00000100:00100000:1.0:1782222368.201348:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060812928 00000100:00100000:1.0:1782222368.201375:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060813440 00000100:00100000:1.0:1782222368.201378:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060813440 00000100:00100000:1.0:1782222368.201394:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 66 00000100:00100000:1.0:1782222368.201401:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c320fdbb-74fa-4205-b5df-42980d45bb62+5:2388:x1868795060812928:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222368.201433:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c320fdbb-74fa-4205-b5df-42980d45bb62+5:2388:x1868795060812928:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 34us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222368.201459:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 66 00000100:00100000:1.0:1782222368.201473:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 24 00000100:00100000:1.0:1782222368.201478:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+7:15601:x1868795060813440:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782222368.201490:0:17209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222368.201511:0:17209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459400/0xe2b7cc26e6812938 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75588f7 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222368.201613:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458600/0xe2b7cc26e681293f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222368.201629:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458600/0xe2b7cc26e681293f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222368.201642:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458600/0xe2b7cc26e681293f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222368.202753:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8d3282c7-c1ac-4cf8-a606-482b3aabf172+5:2388:x1868795060812544:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222368.202815:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8d3282c7-c1ac-4cf8-a606-482b3aabf172+5:2388:x1868795060812544:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 87us (2978us total) trans 0 rc 0/0 00010000:00010000:1.0:1782222368.203250:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459800/0xe2b7cc26e6812946 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222368.203285:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459800/0xe2b7cc26e6812946 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222368.203299:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459800/0xe2b7cc26e6812946 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222368.203412:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459e00/0xe2b7cc26e681294d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222368.203421:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459e00/0xe2b7cc26e681294d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222368.203443:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459e00/0xe2b7cc26e681294d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782222368.203454:0:17209:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1782222368.206037:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458600/0xe2b7cc26e681293f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222368.206055:0:17209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458600/0xe2b7cc26e681293f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222368.206063:0:17209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458600/0xe2b7cc26e681293f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222368.206070:0:17209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0841458600 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222368.206075:0:17209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458600/0xe2b7cc26e681293f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222368.206082:0:17209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458600/0xe2b7cc26e681293f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222368.206097:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f087f8f2d00) 00010000:00010000:1.0:1782222368.206101:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222368.206106:0:17209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458600/0xe2b7cc26e681293f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222368.206111:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458600/0xe2b7cc26e681293f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222368.206126:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459800/0xe2b7cc26e6812946 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222368.206133:0:17209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459800/0xe2b7cc26e6812946 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222368.206150:0:17209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459800/0xe2b7cc26e6812946 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222368.206155:0:17209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0841459800 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222368.206158:0:17209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459800/0xe2b7cc26e6812946 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222368.206164:0:17209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459800/0xe2b7cc26e6812946 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222368.206173:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8f0859454800) 00010000:00010000:1.0:1782222368.206175:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222368.206178:0:17209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459800/0xe2b7cc26e6812946 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222368.206185:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459800/0xe2b7cc26e6812946 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222368.207293:0:19827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 28 00000100:00080000:2.0:1782222368.207347:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782222368.207395:0:19827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c320fdbb-74fa-4205-b5df-42980d45bb62+5:2388:x1868795060813056:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222368.207495:0:19827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c320fdbb-74fa-4205-b5df-42980d45bb62+5:2388:x1868795060813056:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 188us (7592us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222368.207517:0:19827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 28 00000100:00100000:2.0:1782222368.207562:0:19827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060813184 00000100:00100000:2.0:1782222368.207570:0:19827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060813184 00000100:00080000:2.0:1782222368.207599:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782222368.207626:0:19827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 29 00000100:00100000:2.0:1782222368.207633:0:19827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+5:2388:x1868795060812672:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222368.207660:0:19827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+5:2388:x1868795060812672:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 28us (7728us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222368.207667:0:19827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 29 00000100:00100000:2.0:1782222368.207690:0:19827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 30 00000100:00100000:2.0:1782222368.207697:0:19827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f088163f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c320fdbb-74fa-4205-b5df-42980d45bb62+5:2388:x1868795060813184:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1782222368.207727:0:19827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c320fdbb-74fa-4205-b5df-42980d45bb62+5:2388:x1868795060813184:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 31us (6519us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222368.207733:0:19827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 30 00000100:00100000:3.0:1782222368.210297:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 27 00010000:00010000:2.0:1782222368.212164:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459400/0xe2b7cc26e6812938 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75588f7 expref: 10 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.212198:0:17209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459e00/0xe2b7cc26e681294d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75588f7 expref: 9 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.212209:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f0859454600) 00010000:00010000:2.0:1782222368.212213:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782222368.212217:0:17209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0841459e00, rc 0) 00000100:00100000:2.0:1782222368.212655:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f088163fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+9:15601:x1868795060813440:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 11173us (11420us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1782222368.212823:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 24 00000100:00100000:2.0:1782222368.229938:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222368.230071:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060813568 00000100:00100000:0.0:1782222368.230084:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060813568 00000100:00100000:0.0:1782222368.230205:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 25 00000100:00100000:0.0:1782222368.230216:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+9:15601:x1868795060813568:12345-192.168.203.27@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1782222368.230367:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+9:15601:x1868795060813568:12345-192.168.203.27@tcp:59:lhsmtool_posix.0 Request processed in 153us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222368.230391:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 25 00000100:00100000:3.0:1782222368.236645:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222368.236853:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060813696 00000100:00100000:2.0:1782222368.236864:0:19481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060813696 00000100:00100000:2.0:1782222368.236921:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 26 00000100:00100000:2.0:1782222368.236932:0:19481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+5:15601:x1868795060813696:12345-192.168.203.27@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1782222368.237503:0:19481:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 516us 00000100:00100000:1.0:1782222368.262941:0:19481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+5:15601:x1868795060813696:12345-192.168.203.27@tcp:59:lhsmtool_posix.0 Request processed in 25999us (26292us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222368.262956:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 26 00000100:00100000:1.0:1782222368.367398:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222368.369172:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060813824 00000100:00100000:2.0:1782222368.369186:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060813824 00000100:00100000:2.0:1782222368.369531:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 27 00000100:00100000:2.0:1782222368.369543:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+9:15607:x1868795060813824:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1782222368.369562:0:17209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222368.369581:0:17209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e681295b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75588fe expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.369656:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e6812962 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.369670:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e6812962 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.369682:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e6812962 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.369697:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2600/0xe2b7cc26e6812969 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.369704:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2600/0xe2b7cc26e6812969 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.369723:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2600/0xe2b7cc26e6812969 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.369760:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e6812962 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.369767:0:17209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e6812962 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.369773:0:17209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e6812962 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.369779:0:17209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08413d2800 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222368.369783:0:17209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e6812962 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.369791:0:17209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e6812962 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.369802:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0843b9b000) 00010000:00010000:2.0:1782222368.369805:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782222368.369810:0:17209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e6812962 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.369816:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e6812962 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.369830:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2600/0xe2b7cc26e6812969 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.369835:0:17209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2600/0xe2b7cc26e6812969 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.369848:0:17209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2600/0xe2b7cc26e6812969 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.369854:0:17209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08413d2600 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:2.0:1782222368.369857:0:17209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2600/0xe2b7cc26e6812969 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.369863:0:17209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2600/0xe2b7cc26e6812969 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.369871:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f087f8f2600) 00010000:00010000:2.0:1782222368.369874:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782222368.369877:0:17209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2600/0xe2b7cc26e6812969 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.369883:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2600/0xe2b7cc26e6812969 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.369910:0:17209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e681295b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75588fe expref: 10 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.369931:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0843b9b000) 00010000:00010000:2.0:1782222368.369934:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782222368.369938:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e681295b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75588fe expref: 10 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.369947:0:17209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f08413d2c00, rc 0) 00000100:00100000:2.0:1782222368.372679:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+9:15607:x1868795060813824:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 3129us (6436us total) trans 0 rc 301/301 00000100:00100000:2.0:1782222368.372710:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 27 00000100:00100000:1.0:1782222368.378338:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222368.381093:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060813952 00000100:00100000:0.0:1782222368.381106:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060813952 00000100:00100000:0.0:1782222368.381171:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 0 00000100:00100000:0.0:1782222368.381181:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8d3282c7-c1ac-4cf8-a606-482b3aabf172+9:15607:x1868795060813952:12345-192.168.203.27@tcp:700:lfs.0 00000100:00100000:0.0:1782222368.381309:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8d3282c7-c1ac-4cf8-a606-482b3aabf172+9:15607:x1868795060813952:12345-192.168.203.27@tcp:700:lfs.0 Request processed in 129us (2978us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222368.381317:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 0 00000100:00100000:3.0:1782222368.387045:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222368.389439:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060814208 00000100:00100000:0.0:1782222368.389452:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060814208 00000100:00100000:0.0:1782222368.389534:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 28 00000100:00100000:0.0:1782222368.389545:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+9:15607:x1868795060814208:12345-192.168.203.27@tcp:36:lfs.0 00010000:00010000:0.0:1782222368.389596:0:17210:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222368.389631:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458c00/0xe2b7cc26e6812889 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755886b expref: 9 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.389653:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0843b9b000) 00010000:00010000:0.0:1782222368.389657:0:17210:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782222368.389714:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812970 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.389728:0:17210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e68128c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75588db expref: 5 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.389737:0:17210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812970 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.389784:0:17210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e68128c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75588db expref: 5 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.389799:0:17210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e68128c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75588db expref: 5 pid: 17209 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222368.389812:0:17210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747782d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17210:1868795081880704:192.168.203.27@tcp:104: 00000100:00100000:0.0:1782222368.389910:0:17210:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087fb65c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782222368.396069:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222368.396122:0:17210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747782d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17210:1868795081880704:192.168.203.27@tcp:104: 00010000:00010000:0.0:1782222368.396148:0:17210:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812970 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222368.396231:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060814336 00000100:00100000:2.0:1782222368.396264:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060814336 00010000:00010000:2.0:1782222368.396299:0:17194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e68128c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75588db expref: 6 pid: 17209 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222368.396335:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 15 00000100:00100000:2.0:1782222368.396343:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b786300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c320fdbb-74fa-4205-b5df-42980d45bb62+6:2390:x1868795060814336:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782222368.396360:0:17194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782222368.396366:0:17194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e68128c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75588db expref: 6 pid: 17209 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.396388:0:17194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e68128c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75588db expref: 6 pid: 17209 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.396408:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e68128c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f75588db expref: 6 pid: 17209 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.396425:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0843b9b000) 00010000:00010000:2.0:1782222368.396431:0:17194:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812970 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.396442:0:17194:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812970 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.396450:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812970 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.396487:0:17194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782222368.396544:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b786300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c320fdbb-74fa-4205-b5df-42980d45bb62+5:2390:x1868795060814336:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 201us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222368.396553:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 15 00010000:00010000:0.0:1782222368.396629:0:17210:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812970 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.396637:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812970 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.396660:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6812977 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.396670:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6812977 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.396678:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6812977 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.399365:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8a00/0xe2b7cc26e681297e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.399393:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8a00/0xe2b7cc26e681297e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.399405:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8a00/0xe2b7cc26e681297e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782222368.399424:0:17210:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000066f74afe reply state 00000000707c5ac4 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8a00/0xe2b7cc26e681297e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.399435:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8a00/0xe2b7cc26e681297e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.399441:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f07465b1200) 00010000:00010000:0.0:1782222368.399444:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782222368.399447:0:17210:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782222368.399452:0:17210:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1782222368.399459:0:17210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812970 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.399465:0:17210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812970 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.399470:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812970 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.399475:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb8400 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222368.399479:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812970 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.399486:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812970 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.399506:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0843b9b000) 00010000:00010000:0.0:1782222368.399509:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782222368.399512:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812970 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.399519:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812970 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782222368.399548:0:17210:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000066f74afe reply state 00000000707c5ac4 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6812977 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.399556:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6812977 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.399562:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f07465b1100) 00010000:00010000:0.0:1782222368.399564:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782222368.399566:0:17210:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1782222368.399643:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+10:15607:x1868795060814208:12345-192.168.203.27@tcp:36:lfs.0 Request processed in 10098us (12604us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1782222368.399650:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 28 00000100:00100000:3.0:1782222368.536611:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222368.537011:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060814464 00000100:00100000:1.0:1782222368.537021:0:19481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060814464 00000100:00100000:1.0:1782222368.537082:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 29 00000100:00100000:1.0:1782222368.537092:0:19481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0875aace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+10:15615:x1868795060814464:12345-192.168.203.27@tcp:101:lctl.0 00010000:00010000:1.0:1782222368.537113:0:19481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222368.537141:0:19481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459400/0xe2b7cc26e6812985 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558905 expref: -99 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222368.537206:0:19481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459a00/0xe2b7cc26e681298c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222368.537220:0:19481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459a00/0xe2b7cc26e681298c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222368.537389:0:19481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459a00/0xe2b7cc26e681298c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19481 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782222368.537437:0:19481:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782222368.537441:0:19481:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782222368.537472:0:19481:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459a00/0xe2b7cc26e681298c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222368.537496:0:19481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459400/0xe2b7cc26e6812985 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558905 expref: 12 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222368.537513:0:19481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459a00/0xe2b7cc26e681298c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558905 expref: 11 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222368.537529:0:19481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0859454800) 00010000:00010000:1.0:1782222368.537532:0:19481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782222368.537536:0:19481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0841459a00, rc 0) 00000100:00100000:1.0:1782222368.537639:0:19481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0875aace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+11:15615:x1868795060814464:12345-192.168.203.27@tcp:101:lctl.0 Request processed in 548us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222368.537647:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 29 00010000:00010000:2.0:1782222368.554466:0:19828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782222368.561351:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222368.561514:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060814592 00000100:00100000:2.0:1782222368.561533:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060814592 00000100:00100000:2.0:1782222368.561592:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 30 00000100:00100000:2.0:1782222368.561601:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c320fdbb-74fa-4205-b5df-42980d45bb62+5:15616:x1868795060814592:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1782222368.561620:0:17209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222368.561638:0:17209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e6812993 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755890c expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.561717:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2600/0xe2b7cc26e681299a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.561731:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2600/0xe2b7cc26e681299a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.561753:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2600/0xe2b7cc26e681299a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782222368.561795:0:17209:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782222368.561799:0:17209:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782222368.561822:0:17209:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2600/0xe2b7cc26e681299a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.561846:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e6812993 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755890c expref: 7 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.561887:0:17209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2600/0xe2b7cc26e681299a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755890c expref: 6 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.561896:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0859454800) 00010000:00010000:2.0:1782222368.561899:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782222368.561902:0:17209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f08413d2600, rc 0) 00000100:00100000:2.0:1782222368.561963:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c320fdbb-74fa-4205-b5df-42980d45bb62+6:15616:x1868795060814592:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 363us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222368.561970:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 30 00000100:00100000:3.0:1782222368.567503:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222368.567981:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060814720 00000100:00100000:0.0:1782222368.567991:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060814720 00000100:00100000:0.0:1782222368.568052:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 31 00000100:00100000:0.0:1782222368.568061:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0875aaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c320fdbb-74fa-4205-b5df-42980d45bb62+6:15616:x1868795060814720:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:0.0:1782222368.568082:0:17210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222368.568102:0:17210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e68129a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558913 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.568165:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e68129a8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.568191:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e68129a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.568203:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e68129a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.568215:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e68129af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.568222:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e68129af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.568228:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e68129af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.568330:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e68129b6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.568338:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e68129b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.568346:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e68129b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782222368.568383:0:17210:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782222368.568386:0:17210:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782222368.568405:0:17210:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e68129b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.568417:0:17210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e68129a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.568432:0:17210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e68129a8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.568439:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e68129a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.568445:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb9800 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222368.568449:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e68129a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.568457:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e68129a8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.568469:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0859454800) 00010000:00010000:0.0:1782222368.568472:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782222368.568477:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e68129a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.568483:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e68129a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.568496:0:17210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e68129af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.568502:0:17210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e68129af lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.568508:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e68129af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.568513:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb9600 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222368.568535:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e68129af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.568542:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e68129af lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.568550:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f07465b1100) 00010000:00010000:0.0:1782222368.568552:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782222368.568555:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e68129af lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.568561:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e68129af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.568587:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e68129a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558913 expref: 8 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.568599:0:17210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e68129b6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558913 expref: 7 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.568606:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f07465b1200) 00010000:00010000:0.0:1782222368.568608:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782222368.568611:0:17210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fcb9000, rc 0) 00000100:00100000:0.0:1782222368.568665:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0875aaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c320fdbb-74fa-4205-b5df-42980d45bb62+7:15616:x1868795060814720:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 605us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222368.568682:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 31 00000100:00100000:3.0:1782222368.571568:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222368.571818:0:17220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060814848 00000100:00100000:2.0:1782222368.571829:0:17220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060814848 00000100:00100000:2.0:1782222368.572025:0:17220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 6 00000100:00100000:2.0:1782222368.572037:0:17220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c320fdbb-74fa-4205-b5df-42980d45bb62+5:15616:x1868795060814848:12345-192.168.203.27@tcp:900:lfs.0 00000100:00100000:2.0:1782222368.572160:0:17220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c320fdbb-74fa-4205-b5df-42980d45bb62+5:15616:x1868795060814848:12345-192.168.203.27@tcp:900:lfs.0 Request processed in 125us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222368.572168:0:17220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 6 00000100:00100000:2.0:1782222368.586600:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222368.586704:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060815104 00000100:00100000:0.0:1782222368.586714:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060815104 00000100:00100000:0.0:1782222368.586777:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 32 00000100:00100000:0.0:1782222368.586787:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c320fdbb-74fa-4205-b5df-42980d45bb62+7:15616:x1868795060815104:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:0.0:1782222368.586823:0:17208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222368.586841:0:17208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e68129bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755891a expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782222368.586947:0:17208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1782222368.587037:0:17208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e68129bd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755891a expref: 9 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.587050:0:17208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0859454800) 00010000:00010000:0.0:1782222368.587053:0:17208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782222368.587058:0:17208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e68129bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755891a expref: 9 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.587072:0:17208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fcb8400, rc 0) 00000100:00100000:0.0:1782222368.587134:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c320fdbb-74fa-4205-b5df-42980d45bb62+8:15616:x1868795060815104:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 348us (543us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1782222368.587142:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 32 00000100:00100000:3.0:1782222368.590777:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222368.590915:0:20002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060815360 00000100:00100000:0.0:1782222368.590925:0:20002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060815360 00000100:00100000:0.0:1782222368.590968:0:20002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 33 00000100:00100000:0.0:1782222368.590977:0:20002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c320fdbb-74fa-4205-b5df-42980d45bb62+8:15616:x1868795060815360:12345-192.168.203.27@tcp:36:lfs.0 00010000:00010000:0.0:1782222368.591023:0:20002:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222368.591045:0:20002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e68129b6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558913 expref: 8 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.591063:0:20002:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f07465b1200) 00010000:00010000:0.0:1782222368.591067:0:20002:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782222368.591097:0:20002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e68129cb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.591110:0:20002:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e68129cb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.591118:0:20002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e68129cb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782222368.591609:0:20002:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f161520f reply state 000000001e7b2521 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e68129cb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.591623:0:20002:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e68129cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.591630:0:20002:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f07465b1200) 00010000:00010000:0.0:1782222368.591633:0:20002:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1782222368.591636:0:20002:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782222368.591643:0:20002:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1782222368.591728:0:20002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c320fdbb-74fa-4205-b5df-42980d45bb62+9:15616:x1868795060815360:12345-192.168.203.27@tcp:36:lfs.0 Request processed in 750us (958us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1782222368.591735:0:20002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 33 00000100:00100000:3.0:1782222368.594332:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222368.595177:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060815616 00000100:00100000:0.0:1782222368.595188:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060815616 00000100:00100000:0.0:1782222368.595271:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 2 00000100:00100000:0.0:1782222368.595280:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c320fdbb-74fa-4205-b5df-42980d45bb62+9:15616:x1868795060815616:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:0.0:1782222368.595502:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c320fdbb-74fa-4205-b5df-42980d45bb62+10:15616:x1868795060815616:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 221us (1175us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1782222368.595509:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 2 00000100:00100000:2.0:1782222368.599555:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222368.600181:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060815872 00000100:00100000:3.0:1782222368.600193:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060815872 00000100:00100000:3.0:1782222368.600275:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 34 00000100:00100000:3.0:1782222368.600299:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c320fdbb-74fa-4205-b5df-42980d45bb62+10:15616:x1868795060815872:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1782222368.600322:0:17210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222368.600343:0:17210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec800/0xe2b7cc26e68129d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558921 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222368.600418:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed600/0xe2b7cc26e68129d9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222368.600431:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed600/0xe2b7cc26e68129d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222368.600443:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed600/0xe2b7cc26e68129d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222368.600454:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec600/0xe2b7cc26e68129e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222368.600462:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec600/0xe2b7cc26e68129e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222368.600469:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec600/0xe2b7cc26e68129e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782222368.600582:0:17210:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1782222368.600681:0:17210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed600/0xe2b7cc26e68129d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222368.600690:0:17210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed600/0xe2b7cc26e68129d9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222368.600951:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed600/0xe2b7cc26e68129d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222368.600960:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08483ed600 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222368.600964:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed600/0xe2b7cc26e68129d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222368.600972:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed600/0xe2b7cc26e68129d9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222368.600985:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0859454800) 00010000:00010000:3.0:1782222368.600989:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222368.600993:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed600/0xe2b7cc26e68129d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222368.600999:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed600/0xe2b7cc26e68129d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222368.601013:0:17210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec600/0xe2b7cc26e68129e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222368.601019:0:17210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec600/0xe2b7cc26e68129e0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222368.601024:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec600/0xe2b7cc26e68129e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222368.601041:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08483ec600 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222368.601045:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec600/0xe2b7cc26e68129e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222368.601050:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec600/0xe2b7cc26e68129e0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222368.601058:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f07465b1100) 00010000:00010000:3.0:1782222368.601061:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222368.601063:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec600/0xe2b7cc26e68129e0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222368.601069:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec600/0xe2b7cc26e68129e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222368.601099:0:17210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec800/0xe2b7cc26e68129d2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558921 expref: 12 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222368.601109:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0859454800) 00010000:00010000:3.0:1782222368.601111:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782222368.601115:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec800/0xe2b7cc26e68129d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558921 expref: 12 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222368.601123:0:17210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f08483ec800, rc 0) 00000100:00100000:3.0:1782222368.601189:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c320fdbb-74fa-4205-b5df-42980d45bb62+11:15616:x1868795060815872:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 905us (1642us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1782222368.601197:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 34 00000100:00100000:3.0:1782222368.604582:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222368.608473:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060816000 00000100:00100000:2.0:1782222368.608487:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060816000 00000100:00100000:2.0:1782222368.608611:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 35 00000100:00100000:2.0:1782222368.608622:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c320fdbb-74fa-4205-b5df-42980d45bb62+11:15616:x1868795060816000:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1782222368.608644:0:17209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222368.608681:0:17209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3400/0xe2b7cc26e68129ee lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558928 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.608808:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e68129f5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.608820:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e68129f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.608830:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e68129f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782222368.608854:0:17209:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782222368.608857:0:17209:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782222368.608888:0:17209:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e68129f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.608912:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3400/0xe2b7cc26e68129ee lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558928 expref: 13 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.608931:0:17209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e68129f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558928 expref: 12 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.608940:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f07465b1200) 00010000:00010000:2.0:1782222368.608942:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782222368.608946:0:17209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f08413d2c00, rc 0) 00000100:00100000:2.0:1782222368.609015:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c320fdbb-74fa-4205-b5df-42980d45bb62+12:15616:x1868795060816000:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 395us (4441us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222368.609022:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 35 00000100:00100000:1.0:1782222368.620536:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222368.620617:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060816128 00000100:00100000:0.0:1782222368.620639:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060816128 00000100:00100000:0.0:1782222368.620702:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 3 00000100:00100000:0.0:1782222368.620713:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c320fdbb-74fa-4205-b5df-42980d45bb62+12:15616:x1868795060816128:12345-192.168.203.27@tcp:37:lfs.0 00000100:00100000:0.0:1782222368.625274:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c320fdbb-74fa-4205-b5df-42980d45bb62+12:15616:x1868795060816128:12345-192.168.203.27@tcp:37:lfs.0 Request processed in 4524us (4718us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222368.625298:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 3 00000100:00100000:3.0:1782222368.635684:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222368.635782:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060816384 00000100:00100000:2.0:1782222368.635791:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060816384 00000100:00100000:2.0:1782222368.635858:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 4 00000100:00100000:2.0:1782222368.635875:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fe13c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c320fdbb-74fa-4205-b5df-42980d45bb62+12:15616:x1868795060816384:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:2.0:1782222368.636076:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fe13c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c320fdbb-74fa-4205-b5df-42980d45bb62+13:15616:x1868795060816384:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 202us (411us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1782222368.636083:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 4 00000040:00080000:3.0:1782222368.682960:0:17966:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1782222368.763092:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222368.763360:0:20002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060816512 00000100:00100000:0.0:1782222368.763369:0:20002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060816512 00000100:00100000:0.0:1782222368.763428:0:20002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 36 00000100:00100000:0.0:1782222368.763437:0:20002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d3282c7-c1ac-4cf8-a606-482b3aabf172+11:15622:x1868795060816512:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:0.0:1782222368.763459:0:20002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222368.763477:0:20002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e68129fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755892f expref: -99 pid: 20002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.763548:0:20002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812a03 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.763562:0:20002:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812a03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.763571:0:20002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812a03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.763581:0:20002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812a0a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.763586:0:20002:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812a0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.763593:0:20002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812a0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.763694:0:20002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8000/0xe2b7cc26e6812a11 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.763713:0:20002:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8000/0xe2b7cc26e6812a11 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.763720:0:20002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8000/0xe2b7cc26e6812a11 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782222368.763755:0:20002:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782222368.763758:0:20002:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782222368.763791:0:20002:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8000/0xe2b7cc26e6812a11 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.763803:0:20002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812a03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.763810:0:20002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812a03 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.763816:0:20002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812a03 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.763823:0:20002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb8400 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222368.763827:0:20002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812a03 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.763834:0:20002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812a03 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.763846:0:20002:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0859454800) 00010000:00010000:0.0:1782222368.763854:0:20002:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782222368.763973:0:20002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812a03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.763982:0:20002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812a03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.763998:0:20002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812a0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.764003:0:20002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812a0a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.764009:0:20002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812a0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.764014:0:20002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb9800 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222368.764017:0:20002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812a0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.764022:0:20002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812a0a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.764029:0:20002:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f07465b1100) 00010000:00010000:0.0:1782222368.764032:0:20002:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782222368.764035:0:20002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812a0a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.764040:0:20002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812a0a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.764063:0:20002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e68129fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755892f expref: 13 pid: 20002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.764088:0:20002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8000/0xe2b7cc26e6812a11 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755892f expref: 12 pid: 20002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.764095:0:20002:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f07465b1200) 00010000:00010000:0.0:1782222368.764098:0:20002:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782222368.764100:0:20002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fcb8000, rc 0) 00000100:00100000:0.0:1782222368.764449:0:20002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d3282c7-c1ac-4cf8-a606-482b3aabf172+12:15622:x1868795060816512:12345-192.168.203.27@tcp:101:bash.0 Request processed in 1011us (1363us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222368.764457:0:20002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 36 00000100:00100000:3.0:1782222368.787036:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222368.787182:0:17220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060816640 00000100:00100000:2.0:1782222368.787198:0:17220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060816640 00000100:00100000:2.0:1782222368.787268:0:17220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 7 00000100:00100000:2.0:1782222368.787277:0:17220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849b17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+5:15622:x1868795060816640:12345-192.168.203.27@tcp:900:bash.0 00000100:00100000:2.0:1782222368.787362:0:17220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849b17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+5:15622:x1868795060816640:12345-192.168.203.27@tcp:900:bash.0 Request processed in 85us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222368.787369:0:17220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 7 00000100:00100000:1.0:1782222368.795332:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222368.795422:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060816896 00000100:00100000:0.0:1782222368.795432:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060816896 00000100:00100000:0.0:1782222368.795495:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 37 00000100:00100000:0.0:1782222368.795505:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d3282c7-c1ac-4cf8-a606-482b3aabf172+12:15622:x1868795060816896:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:0.0:1782222368.795536:0:17208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222368.795556:0:17208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e6812a18 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558936 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.795681:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812a1f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.795695:0:17208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e68129f5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558928 expref: 12 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.795704:0:17208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812a1f lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.795735:0:17208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e68129f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558928 expref: 12 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.795765:0:17208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e68129f5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558928 expref: 12 pid: 17209 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222368.795777:0:17208:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747782d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17208:1868795081880832:192.168.203.27@tcp:104: 00000100:00100000:0.0:1782222368.795859:0:17208:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f087fb65e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782222368.801924:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222368.801994:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060817024 00000100:00100000:2.0:1782222368.802003:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060817024 00010000:00010000:2.0:1782222368.802042:0:17193:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e68129f5 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558928 expref: 13 pid: 17209 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222368.802090:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 16 00000100:00100000:2.0:1782222368.802100:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c320fdbb-74fa-4205-b5df-42980d45bb62+13:2390:x1868795060817024:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782222368.802117:0:17193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782222368.802124:0:17193:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e68129f5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558928 expref: 13 pid: 17209 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222368.802128:0:17208:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747782d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17208:1868795081880832:192.168.203.27@tcp:104: 00010000:00010000:2.0:1782222368.802142:0:17193:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e68129f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558928 expref: 13 pid: 17209 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.802355:0:17208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812a1f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.802368:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e68129f5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558928 expref: 13 pid: 17209 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.808083:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f07465b1200) 00010000:00010000:2.0:1782222368.808098:0:17193:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812a1f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.808112:0:17193:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812a1f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.808120:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812a1f lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.808156:0:17193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782222368.808270:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c320fdbb-74fa-4205-b5df-42980d45bb62+12:2390:x1868795060817024:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 6167us (6350us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222368.808281:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 16 00010000:00010000:0.0:1782222368.808308:0:17208:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812a1f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.808318:0:17208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812a1f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.808343:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812a26 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.808353:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812a26 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.808362:0:17208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812a26 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.809092:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6812a2d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.809102:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6812a2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.809117:0:17208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6812a2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782222368.809129:0:17208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1782222368.809155:0:17208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812a1f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.809172:0:17208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812a1f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.809180:0:17208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812a1f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.809186:0:17208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb9800 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222368.809190:0:17208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812a1f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.809328:0:17208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812a1f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.809341:0:17208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f07465b1200) 00010000:00010000:0.0:1782222368.809345:0:17208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782222368.809349:0:17208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812a1f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.809355:0:17208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812a1f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782222368.809369:0:17208:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a0eec840 reply state 0000000010b90032 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812a26 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.809392:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812a26 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.809398:0:17208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8f07465b1500) 00010000:00010000:0.0:1782222368.809400:0:17208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782222368.809402:0:17208:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782222368.809437:0:17208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e6812a18 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558936 expref: 15 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.809452:0:17208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6812a2d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558936 expref: 14 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.809458:0:17208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f07465b1600) 00010000:00010000:0.0:1782222368.809460:0:17208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1782222368.809462:0:17208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fcb8200, rc 0) 00000100:00100000:0.0:1782222368.809499:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d3282c7-c1ac-4cf8-a606-482b3aabf172+15:15622:x1868795060816896:12345-192.168.203.27@tcp:101:bash.0 Request processed in 13997us (14177us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1782222368.809506:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 37 00000100:00100000:3.0:1782222368.827918:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222368.828014:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060817152 00000100:00100000:2.0:1782222368.828024:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060817152 00000100:00100000:2.0:1782222368.828088:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 38 00000100:00100000:2.0:1782222368.828098:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+15:15622:x1868795060817152:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:2.0:1782222368.828123:0:17209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222368.828143:0:17209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e6812a3b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755893d expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.828230:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3400/0xe2b7cc26e6812a42 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.828304:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3400/0xe2b7cc26e6812a42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.828316:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3400/0xe2b7cc26e6812a42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782222368.828369:0:17209:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1782222368.828374:0:17209:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782222368.828396:0:17209:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3400/0xe2b7cc26e6812a42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.828406:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3400/0xe2b7cc26e6812a42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.828431:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e6812a3b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755893d expref: 17 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.828450:0:17209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3400/0xe2b7cc26e6812a42 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755893d expref: 16 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222368.828458:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f07465b1600) 00010000:00010000:2.0:1782222368.828461:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782222368.828465:0:17209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f08413d3400, rc 0) 00000100:00100000:2.0:1782222368.828533:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+16:15622:x1868795060817152:12345-192.168.203.27@tcp:101:bash.0 Request processed in 437us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222368.828540:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 38 00000100:00100000:0.0:1782222368.835994:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222368.836129:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060817408 00000100:00100000:2.0:1782222368.836139:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060817408 00000100:00100000:2.0:1782222368.836207:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 5 00000100:00100000:2.0:1782222368.836231:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+16:15622:x1868795060817408:12345-192.168.203.27@tcp:35:bash.0 00000100:00100000:2.0:1782222368.836575:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+17:15622:x1868795060817408:12345-192.168.203.27@tcp:35:bash.0 Request processed in 345us (588us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1782222368.836583:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 5 00000100:00100000:1.0:1782222368.947506:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222368.947640:0:20002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060817664 00000100:00100000:0.0:1782222368.947996:0:20002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060817664 00000100:00100000:0.0:1782222368.948091:0:20002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 39 00000100:00100000:0.0:1782222368.948102:0:20002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d3282c7-c1ac-4cf8-a606-482b3aabf172+17:15632:x1868795060817664:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:0.0:1782222368.948129:0:20002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222368.948152:0:20002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e6812a49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558944 expref: -99 pid: 20002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782222368.948297:0:20002:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1782222368.948569:0:20002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e6812a49 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558944 expref: 19 pid: 20002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.948583:0:20002:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f0859454800) 00010000:00010000:0.0:1782222368.948586:0:20002:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782222368.948591:0:20002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e6812a49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558944 expref: 19 pid: 20002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222368.948605:0:20002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fcb9000, rc 0) 00000100:00100000:0.0:1782222368.948913:0:20002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d3282c7-c1ac-4cf8-a606-482b3aabf172+18:15632:x1868795060817664:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 811us (1681us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1782222368.948922:0:20002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 39 00000100:00100000:3.0:1782222368.953469:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222368.953612:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060817920 00000100:00100000:2.0:1782222368.953623:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060817920 00000100:00100000:2.0:1782222368.953694:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 6 00000100:00100000:2.0:1782222368.953705:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+18:15632:x1868795060817920:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:2.0:1782222368.953922:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+19:15632:x1868795060817920:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 219us (461us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1782222368.953930:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 6 00000100:00100000:1.0:1782222369.005061:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222369.005557:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060818176 00000100:00100000:0.0:1782222369.005567:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060818176 00000100:00100000:0.0:1782222369.005628:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 40 00000100:00100000:0.0:1782222369.005638:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d3282c7-c1ac-4cf8-a606-482b3aabf172+19:15635:x1868795060818176:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:0.0:1782222369.005660:0:17208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222369.005691:0:17208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e6812a57 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755894b expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222369.005797:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812a5e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222369.005810:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812a5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222369.005839:0:17208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812a5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782222369.005851:0:17208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1782222369.005955:0:17208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e6812a57 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755894b expref: 22 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222369.005974:0:17208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812a5e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755894b expref: 21 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222369.005984:0:17208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f07465b1600) 00010000:00010000:0.0:1782222369.005987:0:17208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782222369.005990:0:17208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fcb9800, rc 0) 00000100:00100000:0.0:1782222369.006049:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d3282c7-c1ac-4cf8-a606-482b3aabf172+21:15635:x1868795060818176:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 413us (997us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1782222369.006056:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 40 00000100:00100000:1.0:1782222369.013658:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222369.013757:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222369.013954:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060818432 00000100:00100000:3.0:1782222369.013964:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060818432 00000100:00100000:3.0:1782222369.014027:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 41 00000100:00100000:3.0:1782222369.014038:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849bac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+21:15635:x1868795060818432:12345-192.168.203.27@tcp:54:lfs.0 00000100:00100000:2.0:1782222369.014101:0:19545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060818304 00010000:00010000:3.0:1782222369.014102:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483eda00/0xe2b7cc26e6812a6c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222369.014105:0:19545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060818304 00010000:00010000:3.0:1782222369.014118:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483eda00/0xe2b7cc26e6812a6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222369.014129:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483eda00/0xe2b7cc26e6812a6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222369.014168:0:17210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483eda00/0xe2b7cc26e6812a6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222369.014175:0:17210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483eda00/0xe2b7cc26e6812a6c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222369.014180:0:19545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 0 00010000:00010000:3.0:1782222369.014182:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483eda00/0xe2b7cc26e6812a6c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222369.014189:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08483eda00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222369.014193:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483eda00/0xe2b7cc26e6812a6c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222369.014202:0:19545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849baf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+22:2389:x1868795060818304:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782222369.014212:0:19545:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222369.014217:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483eda00/0xe2b7cc26e6812a6c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222369.014228:0:19545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812a5e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755894b expref: 22 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222369.014247:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f07465b1600) 00010000:00010000:3.0:1782222369.014251:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782222369.014255:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483eda00/0xe2b7cc26e6812a6c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222369.014259:0:19545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f07465b1600) 00010000:00010000:3.0:1782222369.014261:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483eda00/0xe2b7cc26e6812a6c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222369.014262:0:19545:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782222369.014346:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849bac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+21:15635:x1868795060818432:12345-192.168.203.27@tcp:54:lfs.0 Request processed in 310us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222369.014346:0:19545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849baf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+21:2389:x1868795060818304:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 150us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222369.014356:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 41 00000100:00100000:2.0:1782222369.014356:0:19545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 0 00000100:00100000:3.0:1782222369.017678:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222369.017822:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060818688 00000100:00100000:2.0:1782222369.017845:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060818688 00000100:00100000:2.0:1782222369.017900:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 7 00000100:00100000:2.0:1782222369.017920:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+20:15635:x1868795060818688:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:2.0:1782222369.018140:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+21:15635:x1868795060818688:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 230us (469us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1782222369.018148:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 7 00000040:00080000:0.0:1782222369.194870:0:17242:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1782222369.224535:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222369.224641:0:20002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060818944 00000100:00100000:0.0:1782222369.224650:0:20002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060818944 00000100:00100000:0.0:1782222369.224943:0:20002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 42 00000100:00100000:0.0:1782222369.224954:0:20002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849baea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d3282c7-c1ac-4cf8-a606-482b3aabf172+21:15666:x1868795060818944:12345-192.168.203.27@tcp:101:cat.0 00010000:00010000:0.0:1782222369.224978:0:20002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222369.224997:0:20002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e6812a73 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558952 expref: -99 pid: 20002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222369.225099:0:20002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812a7a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222369.225131:0:20002:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812a7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222369.225142:0:20002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812a7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782222369.225155:0:20002:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1782222369.225471:0:20002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e6812a73 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558952 expref: 24 pid: 20002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222369.225488:0:20002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812a7a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558952 expref: 23 pid: 20002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222369.225496:0:20002:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f07465b1600) 00010000:00010000:1.0:1782222369.225499:0:20002:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782222369.225502:0:20002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fcb9800, rc 0) 00000100:00100000:1.0:1782222369.225595:0:20002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849baea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d3282c7-c1ac-4cf8-a606-482b3aabf172+23:15666:x1868795060818944:12345-192.168.203.27@tcp:101:cat.0 Request processed in 644us (1079us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1782222369.225602:0:20002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 42 00000100:00100000:1.0:1782222369.229778:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222369.229858:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222369.229938:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060819328 00000100:00100000:0.0:1782222369.229948:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060819328 00000100:00100000:0.0:1782222369.230018:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 1 00000100:00100000:0.0:1782222369.230029:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849bace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+23:2390:x1868795060819328:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782222369.230045:0:17195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222369.230068:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812a7a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558952 expref: 23 pid: 20002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222369.230087:0:17195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f07465b1600) 00010000:00010000:0.0:1782222369.230091:0:17195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782222369.230149:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849bace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+22:2390:x1868795060819328:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 121us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222369.230157:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 1 00000100:00100000:2.0:1782222369.230394:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060819200 00000100:00100000:2.0:1782222369.230399:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060819200 00000100:00100000:2.0:1782222369.230439:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 8 00000100:00100000:2.0:1782222369.230446:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+22:15666:x1868795060819200:12345-192.168.203.27@tcp:35:cat.0 00000100:00100000:2.0:1782222369.230779:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+23:15666:x1868795060819200:12345-192.168.203.27@tcp:35:cat.0 Request processed in 333us (1010us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1782222369.230787:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 8 00000100:00100000:1.0:1782222369.280941:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222369.281399:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060819584 00000100:00100000:2.0:1782222369.281409:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060819584 00000100:00100000:2.0:1782222369.281483:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 43 00000100:00100000:2.0:1782222369.281493:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849bad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+23:15672:x1868795060819584:12345-192.168.203.27@tcp:101:dd.0 00010000:00010000:2.0:1782222369.281525:0:17209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222369.281545:0:17209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e6812a88 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558959 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222369.281648:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e6812a8f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222369.281663:0:17209:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6812a2d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558936 expref: 24 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222369.281700:0:17209:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3400/0xe2b7cc26e6812a42 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755893d expref: 24 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222369.281708:0:17209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e6812a8f lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222369.281747:0:17209:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3400/0xe2b7cc26e6812a42 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755893d expref: 24 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222369.281761:0:17209:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3400/0xe2b7cc26e6812a42 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755893d expref: 24 pid: 17209 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222369.281775:0:17209:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cfe300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17209:1868795081880960:192.168.203.27@tcp:104: 00010000:00010000:2.0:1782222369.281893:0:17209:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6812a2d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558936 expref: 24 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222369.281902:0:17209:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6812a2d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558936 expref: 24 pid: 17208 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222369.281912:0:17209:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747cfd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17209:1868795081881088:192.168.203.27@tcp:104: 00000100:00100000:2.0:1782222369.281933:0:17209:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08490fa840 going to sleep for 11 seconds 00000100:00100000:2.0:1782222369.292197:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222369.292281:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222369.292615:0:17209:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cfe300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17209:1868795081880960:192.168.203.27@tcp:104: 00000100:00100000:0.0:1782222369.292627:0:17209:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747cfd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17209:1868795081881088:192.168.203.27@tcp:104: 00010000:00010000:0.0:1782222369.292653:0:17209:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e6812a8f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222369.293179:0:19545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060819712 00000100:00100000:1.0:1782222369.293186:0:19545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060819712 00010000:00010000:1.0:1782222369.293223:0:19545:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3400/0xe2b7cc26e6812a42 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755893d expref: 25 pid: 17209 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222369.297361:0:19545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060819840 00000100:00100000:1.0:1782222369.297368:0:19545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060819840 00010000:00010000:1.0:1782222369.297403:0:19545:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6812a2d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558936 expref: 26 pid: 17208 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222369.297434:0:19545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 17 00000100:00100000:1.0:1782222369.297442:0:19545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+26:2390:x1868795060819712:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782222369.297458:0:19545:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222369.297464:0:19545:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3400/0xe2b7cc26e6812a42 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755893d expref: 26 pid: 17209 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222369.297477:0:19545:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3400/0xe2b7cc26e6812a42 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755893d expref: 26 pid: 17209 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222369.297496:0:19545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3400/0xe2b7cc26e6812a42 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755893d expref: 26 pid: 17209 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222369.297523:0:19545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f07465b1600) 00010000:00010000:1.0:1782222369.297528:0:19545:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e6812a8f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222369.297536:0:19545:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e6812a8f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222369.297543:0:19545:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782222369.297600:0:19545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+25:2390:x1868795060819712:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 158us (5412us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222369.297617:0:19545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 17 00000100:00100000:1.0:1782222369.297635:0:19545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 18 00000100:00100000:1.0:1782222369.297641:0:19545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0876236c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+24:2389:x1868795060819840:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782222369.297648:0:19545:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222369.297654:0:19545:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6812a2d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558936 expref: 24 pid: 17208 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222369.297663:0:19545:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6812a2d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558936 expref: 24 pid: 17208 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222369.297686:0:19545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6812a2d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558936 expref: 24 pid: 17208 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222369.297696:0:19545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f07465b1600) 00010000:00010000:1.0:1782222369.297700:0:19545:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e6812a8f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222369.297707:0:19545:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e6812a8f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222369.297713:0:19545:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e6812a8f lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222369.297733:0:19545:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782222369.297859:0:17209:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e6812a8f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222369.297882:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e6812a8f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782222369.297901:0:17209:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1782222369.298038:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2c00/0xe2b7cc26e6812a88 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558959 expref: 25 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222369.298054:0:17209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d2800/0xe2b7cc26e6812a8f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558959 expref: 24 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222369.298061:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f07465b1600) 00010000:00010000:0.0:1782222369.298064:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782222369.298067:0:17209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f08413d2800, rc 0) 00000100:00100000:1.0:1782222369.298601:0:19545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0876236c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+24:2389:x1868795060819840:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 957us (6318us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222369.298609:0:19545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 18 00000100:00100000:0.0:1782222369.304661:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849bad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+23:15672:x1868795060819584:12345-192.168.203.27@tcp:101:dd.0 Request processed in 23158us (23718us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1782222369.304685:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 43 00000100:00100000:2.0:1782222369.308608:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222369.308695:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060819968 00000100:00100000:3.0:1782222369.308705:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060819968 00000100:00100000:3.0:1782222369.308776:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 44 00000100:00100000:3.0:1782222369.308785:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+23:15672:x1868795060819968:12345-192.168.203.27@tcp:101:dd.0 00010000:00010000:3.0:1782222369.308818:0:17210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222369.308841:0:17210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec800/0xe2b7cc26e6812a9d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558960 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222369.309086:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483eda00/0xe2b7cc26e6812aa4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222369.309108:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483eda00/0xe2b7cc26e6812aa4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222369.309136:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483eda00/0xe2b7cc26e6812aa4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222369.309297:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec800/0xe2b7cc26e6812a9d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558960 expref: 25 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222369.309315:0:17210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483eda00/0xe2b7cc26e6812aa4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558960 expref: 24 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222369.309324:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f07465b1600) 00010000:00010000:3.0:1782222369.309327:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782222369.309330:0:17210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f08483eda00, rc 0) 00000100:00100000:3.0:1782222369.309387:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+24:15672:x1868795060819968:12345-192.168.203.27@tcp:101:dd.0 Request processed in 603us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222369.309393:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 44 00000100:00100000:3.0:1782222369.315121:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222369.315228:0:20002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060820224 00000100:00100000:1.0:1782222369.315281:0:20002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060820224 00000100:00100000:1.0:1782222369.315338:0:20002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 45 00000100:00100000:1.0:1782222369.315347:0:20002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d3282c7-c1ac-4cf8-a606-482b3aabf172+24:15672:x1868795060820224:12345-192.168.203.27@tcp:36:dd.0 00010000:00010000:1.0:1782222369.315576:0:20002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458a00/0xe2b7cc26e6812aab lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222369.315592:0:20002:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458a00/0xe2b7cc26e6812aab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222369.315603:0:20002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458a00/0xe2b7cc26e6812aab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782222369.315645:0:20002:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1782222369.315670:0:20002:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000de08f0fb reply state 000000006e37469b transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458a00/0xe2b7cc26e6812aab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222369.315688:0:20002:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458a00/0xe2b7cc26e6812aab lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222369.315695:0:20002:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f07465b1600) 00010000:00010000:1.0:1782222369.315698:0:20002:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782222369.315702:0:20002:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782222369.315781:0:20002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d3282c7-c1ac-4cf8-a606-482b3aabf172+27:15672:x1868795060820224:12345-192.168.203.27@tcp:36:dd.0 Request processed in 436us (671us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1782222369.315788:0:20002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 45 00000020:00080000:1.0:1782222369.315793:0:20002:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1782222369.319598:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222369.319686:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060820352 00000100:00100000:0.0:1782222369.319696:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060820352 00000100:00100000:0.0:1782222369.319759:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 46 00000100:00100000:0.0:1782222369.319769:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+27:15672:x1868795060820352:12345-192.168.203.27@tcp:101:dd.0 00010000:00010000:0.0:1782222369.319793:0:17209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222369.319820:0:17209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6812ab2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558967 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222369.319884:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6812ab2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558967 expref: 28 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222369.319920:0:17209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6812ab2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558967 expref: 28 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222369.319940:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f07465b1600) 00010000:00010000:0.0:1782222369.319943:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782222369.319946:0:17209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fcb8200, rc 0) 00000100:00100000:0.0:1782222369.320012:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+28:15672:x1868795060820352:12345-192.168.203.27@tcp:101:dd.0 Request processed in 244us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222369.320020:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 46 00000100:00100000:2.0:1782222369.341341:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222369.341751:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060820608 00000100:00100000:0.0:1782222369.341761:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060820608 00000100:00100000:0.0:1782222369.341829:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 2 00000100:00100000:0.0:1782222369.341840:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+28:15672:x1868795060820608:12345-192.168.203.27@tcp:103:dd.0 00010000:00010000:0.0:1782222369.341856:0:17195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222369.341889:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6812ab2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558967 expref: 28 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222369.341907:0:17195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f07465b1600) 00010000:00010000:0.0:1782222369.341913:0:17195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782222369.341964:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+27:15672:x1868795060820608:12345-192.168.203.27@tcp:103:dd.0 Request processed in 126us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222369.341973:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 2 00000100:00100000:3.0:1782222369.350322:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222369.350551:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060820736 00000100:00100000:0.0:1782222369.350560:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060820736 00000100:00100000:0.0:1782222369.350623:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 47 00000100:00100000:0.0:1782222369.350633:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+27:15672:x1868795060820736:12345-192.168.203.27@tcp:58:dd.0 00010000:00010000:0.0:1782222369.350764:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6812ab9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222369.350782:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6812ab9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222369.350792:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6812ab9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782222369.363489:0:17210:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782222369.365498:0:17210:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1782222369.365689:0:17210:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1782222369.365800:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+27:15672:x1868795060820736:12345-192.168.203.27@tcp:58:dd.0 Request processed in 15163us (15480us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222369.365813:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 47 00000100:00100000:2.0:1782222369.371677:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222369.371910:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060820864 00000100:00100000:3.0:1782222369.371920:0:19481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060820864 00000100:00100000:3.0:1782222369.371978:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 48 00000100:00100000:3.0:1782222369.371988:0:19481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747cfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+27:15672:x1868795060820864:12345-192.168.203.27@tcp:101:dd.0 00010000:00010000:3.0:1782222369.372007:0:19481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222369.372036:0:19481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec800/0xe2b7cc26e6812ac0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755896e expref: -99 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222369.372086:0:19481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6812ab9 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222369.372113:0:19481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec800/0xe2b7cc26e6812ac0 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755896e expref: 28 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222369.372132:0:19481:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6812ab9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222369.372144:0:19481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec800/0xe2b7cc26e6812ac0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755896e expref: 28 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222369.372157:0:19481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f07465b1600) 00010000:00010000:3.0:1782222369.372161:0:19481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782222369.372164:0:19481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec800/0xe2b7cc26e6812ac0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755896e expref: 28 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222369.372172:0:19481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f08483ec800, rc 0) 00000100:00100000:3.0:1782222369.372272:0:19481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747cfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+28:15672:x1868795060820864:12345-192.168.203.27@tcp:101:dd.0 Request processed in 285us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222369.372279:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 48 00010000:00010000:2.0:1782222369.578482:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782222370.219552:0:17242:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1782222370.219564:0:17242:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782222370.219627:0:17242:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1782222370.219640:0:17242:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1782222370.220820:0:17242:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747780e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17242:1868795081881216:192.168.203.27@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782222370.220941:0:17242:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0881e9bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1782222370.227932:0:17242:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747780e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17242:1868795081881216:192.168.203.27@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1782222370.228407:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222370.228528:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060820992 00000100:00100000:2.0:1782222370.228536:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060820992 00000100:00100000:2.0:1782222370.228606:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 49 00000100:00100000:2.0:1782222370.228617:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849baf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d3282c7-c1ac-4cf8-a606-482b3aabf172+28:15674:x1868795060820992:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1782222370.228648:0:17208:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1782222370.228776:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849baf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d3282c7-c1ac-4cf8-a606-482b3aabf172+28:15674:x1868795060820992:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 Request processed in 161us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222370.228784:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 49 00000100:00080000:0.0:1782222370.228983:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782222370.231605:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222370.231766:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060821120 00000100:00100000:3.0:1782222370.231774:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060821120 00000100:00100000:3.0:1782222370.231827:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 50 00000100:00100000:3.0:1782222370.231836:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+28:15674:x1868795060821120:12345-192.168.203.27@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1782222370.231895:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec600/0xe2b7cc26e6812ac7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.231911:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec600/0xe2b7cc26e6812ac7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.231940:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec600/0xe2b7cc26e6812ac7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.231979:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed600/0xe2b7cc26e6812ace lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.231987:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed600/0xe2b7cc26e6812ace lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.231993:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed600/0xe2b7cc26e6812ace lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.232015:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed400/0xe2b7cc26e6812ad5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.232024:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed400/0xe2b7cc26e6812ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.232030:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed400/0xe2b7cc26e6812ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782222370.232068:0:17210:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1782222370.232072:0:17210:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782222370.232087:0:17210:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed400/0xe2b7cc26e6812ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.232098:0:17210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec600/0xe2b7cc26e6812ac7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.232104:0:17210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec600/0xe2b7cc26e6812ac7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.232122:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec600/0xe2b7cc26e6812ac7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.232129:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08483ec600 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222370.232133:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec600/0xe2b7cc26e6812ac7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.232141:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec600/0xe2b7cc26e6812ac7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.232152:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f0859454600) 00010000:00010000:3.0:1782222370.232155:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222370.232159:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec600/0xe2b7cc26e6812ac7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.232164:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec600/0xe2b7cc26e6812ac7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.232178:0:17210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed600/0xe2b7cc26e6812ace lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.232184:0:17210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed600/0xe2b7cc26e6812ace lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.232190:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed600/0xe2b7cc26e6812ace lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.232194:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08483ed600 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222370.232196:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed600/0xe2b7cc26e6812ace lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.232212:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed600/0xe2b7cc26e6812ace lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.232221:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8f087f8f1800) 00010000:00010000:3.0:1782222370.232224:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222370.232227:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed600/0xe2b7cc26e6812ace lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.232285:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed600/0xe2b7cc26e6812ace lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.232301:0:17210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed400/0xe2b7cc26e6812ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.232307:0:17210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed400/0xe2b7cc26e6812ad5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.232313:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed400/0xe2b7cc26e6812ad5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.232318:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08483ed400 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222370.232320:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed400/0xe2b7cc26e6812ad5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.232326:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed400/0xe2b7cc26e6812ad5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.232333:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f07465b1600) 00010000:00010000:3.0:1782222370.232336:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222370.232339:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed400/0xe2b7cc26e6812ad5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.232354:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed400/0xe2b7cc26e6812ad5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222370.232806:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+28:15674:x1868795060821120:12345-192.168.203.27@tcp:34:lhsmtool_posix.0 Request processed in 969us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222370.232815:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 50 00000100:00100000:2.0:1782222370.236063:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222370.236158:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060821376 00000100:00100000:0.0:1782222370.236167:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060821376 00000100:00100000:0.0:1782222370.236277:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 51 00000100:00100000:0.0:1782222370.236287:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+28:15674:x1868795060821376:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782222370.236307:0:17209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222370.236324:0:17209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e6812adc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558975 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.236616:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812ae3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.236631:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812ae3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.236654:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812ae3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782222370.236678:0:17209:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1782222370.236764:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812ae3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.236773:0:17209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812ae3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.236780:0:17209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812ae3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.236785:0:17209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb9800 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222370.236789:0:17209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812ae3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.236796:0:17209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812ae3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.236808:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f07465b1600) 00010000:00010000:0.0:1782222370.236810:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782222370.236814:0:17209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812ae3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.236820:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812ae3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.236861:0:17209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e6812adc lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558975 expref: 30 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.236884:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f0859454600) 00010000:00010000:0.0:1782222370.236886:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782222370.236891:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9000/0xe2b7cc26e6812adc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558975 expref: 30 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.236900:0:17209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fcb9000, rc 0) 00000100:00100000:0.0:1782222370.237081:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+29:15674:x1868795060821376:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 795us (1025us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1782222370.237089:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 51 00000100:00100000:1.0:1782222370.239793:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222370.239855:0:20002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060821504 00000100:00100000:2.0:1782222370.239862:0:20002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060821504 00000100:00100000:2.0:1782222370.239904:0:20002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 52 00000100:00100000:2.0:1782222370.239913:0:20002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849bace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d3282c7-c1ac-4cf8-a606-482b3aabf172+29:15674:x1868795060821504:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1782222370.239943:0:20002:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1782222370.240033:0:20002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849bace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d3282c7-c1ac-4cf8-a606-482b3aabf172+29:15674:x1868795060821504:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 Request processed in 121us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222370.240040:0:20002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 52 00000100:00100000:1.0:1782222370.242951:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222370.243474:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060821760 00000100:00100000:3.0:1782222370.243484:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060821760 00000100:00100000:3.0:1782222370.243582:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 53 00000100:00100000:3.0:1782222370.243592:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+29:15674:x1868795060821760:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782222370.243610:0:17210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222370.243629:0:17210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec600/0xe2b7cc26e6812af1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755897c expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782222370.244065:0:17210:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:3.0:1782222370.244073:0:17210:0:(osp_object.c:1656:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:3.0:1782222370.244097:0:17210:0:(osp_object.c:1673:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:3.0:1782222370.244301:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483eca00/0xe2b7cc26e6812af8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.244315:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483eca00/0xe2b7cc26e6812af8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.244325:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483eca00/0xe2b7cc26e6812af8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.244381:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec600/0xe2b7cc26e6812af1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755897c expref: 32 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.245099:0:17210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483eca00/0xe2b7cc26e6812af8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755897c expref: 31 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.245109:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f087f8f1f00) 00010000:00010000:3.0:1782222370.245112:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782222370.245115:0:17210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f08483eca00, rc 0) 00000100:00100000:3.0:1782222370.245231:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+31:15674:x1868795060821760:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 1639us (2285us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1782222370.245265:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 53 00000100:00100000:3.0:1782222370.251721:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222370.253359:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060822016 00000100:00100000:0.0:1782222370.253371:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060822016 00000100:00100000:1.0:1782222370.259685:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 54 00000100:00100000:1.0:1782222370.259714:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+31:15674:x1868795060822016:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782222370.259775:0:17209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222370.259802:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483eca00/0xe2b7cc26e6812af8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755897c expref: 31 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.259821:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f087f8f1f00) 00010000:00010000:1.0:1782222370.259831:0:17209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782222370.259855:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458600/0xe2b7cc26e6812b06 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.259868:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458600/0xe2b7cc26e6812b06 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.259876:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458600/0xe2b7cc26e6812b06 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.259889:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458c00/0xe2b7cc26e6812b0d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd3977601 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.259895:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458c00/0xe2b7cc26e6812b0d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd3977601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.259901:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458c00/0xe2b7cc26e6812b0d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd3977601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.259946:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458600/0xe2b7cc26e6812b06 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.259953:0:17209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458600/0xe2b7cc26e6812b06 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.259972:0:17209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458600/0xe2b7cc26e6812b06 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.259978:0:17209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0841458600 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222370.259983:0:17209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458600/0xe2b7cc26e6812b06 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.259990:0:17209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458600/0xe2b7cc26e6812b06 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.259999:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f07465b1200) 00010000:00010000:1.0:1782222370.260003:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222370.260007:0:17209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458600/0xe2b7cc26e6812b06 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.260014:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458600/0xe2b7cc26e6812b06 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.260027:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458c00/0xe2b7cc26e6812b0d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd3977601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.260033:0:17209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458c00/0xe2b7cc26e6812b0d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd3977601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.260038:0:17209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458c00/0xe2b7cc26e6812b0d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd3977601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.260043:0:17209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0841458c00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222370.260045:0:17209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458c00/0xe2b7cc26e6812b0d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd3977601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.260062:0:17209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458c00/0xe2b7cc26e6812b0d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd3977601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.260071:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd3977601 (ffff8f0859454c00) 00010000:00010000:1.0:1782222370.260073:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222370.260077:0:17209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458c00/0xe2b7cc26e6812b0d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd3977601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.260083:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458c00/0xe2b7cc26e6812b0d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd3977601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222370.260483:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+30:15674:x1868795060822016:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 Request processed in 772us (8770us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782222370.260491:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 54 00000100:00100000:1.0:1782222370.268695:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222370.268825:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060822144 00000100:00100000:3.0:1782222370.268835:0:19481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060822144 00000100:00100000:3.0:1782222370.268891:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 55 00000100:00100000:3.0:1782222370.268900:0:19481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+30:15674:x1868795060822144:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782222370.268920:0:19481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222370.268940:0:19481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed400/0xe2b7cc26e6812b14 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558983 expref: -99 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.268972:0:19481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed600/0xe2b7cc26e6812b1b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.268985:0:19481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed600/0xe2b7cc26e6812b1b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.268997:0:19481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed600/0xe2b7cc26e6812b1b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.269114:0:19481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed400/0xe2b7cc26e6812b14 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558983 expref: 32 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.269131:0:19481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed600/0xe2b7cc26e6812b1b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558983 expref: 31 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.269140:0:19481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:3.0:1782222370.269144:0:19481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782222370.269147:0:19481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f08483ed600, rc 0) 00000100:00100000:3.0:1782222370.269209:0:19481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+31:15674:x1868795060822144:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 310us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222370.269217:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 55 00000100:00100000:2.0:1782222370.271465:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222370.271908:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060822400 00000100:00100000:3.0:1782222370.271917:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060822400 00000100:00100000:3.0:1782222370.271964:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 56 00000100:00100000:3.0:1782222370.271973:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+31:15674:x1868795060822400:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782222370.272040:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec600/0xe2b7cc26e6812b22 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.272054:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec600/0xe2b7cc26e6812b22 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.272065:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec600/0xe2b7cc26e6812b22 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782222370.272215:0:17210:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1782222370.272225:0:17210:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 569300989984ns, next at 570300987749ns, rc = 0 00000004:00010000:3.0:1782222370.272334:0:17210:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000005be0546 reply state 0000000063f303cf transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec600/0xe2b7cc26e6812b22 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.272347:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec600/0xe2b7cc26e6812b22 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.272355:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:3.0:1782222370.272357:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1782222370.272361:0:17210:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782222370.272439:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+33:15674:x1868795060822400:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 Request processed in 466us (978us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1782222370.272447:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 56 00000100:00100000:0.0:1782222370.275046:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222370.277200:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060822528 00000100:00100000:1.0:1782222370.277216:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060822528 00000100:00100000:1.0:1782222370.277308:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 57 00000100:00100000:1.0:1782222370.277318:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+33:15674:x1868795060822528:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782222370.277343:0:17209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782222370.277362:0:17209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458c00/0xe2b7cc26e6812b29 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755898a expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.277428:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458c00/0xe2b7cc26e6812b29 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755898a expref: 34 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.277444:0:17209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458c00/0xe2b7cc26e6812b29 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755898a expref: 34 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.277478:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:1.0:1782222370.277481:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782222370.277484:0:17209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f0841458c00, rc 0) 00000100:00100000:1.0:1782222370.277561:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+34:15674:x1868795060822528:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 244us (2526us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222370.277568:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 57 00000100:00100000:1.0:1782222370.279911:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222370.280163:0:19827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060822656 00000100:00100000:2.0:1782222370.280172:0:19827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060822656 00000100:00100000:2.0:1782222370.280268:0:19827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 23 00000100:00100000:2.0:1782222370.280279:0:19827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849baed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+5:2390:x1868795060822656:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1782222370.280496:0:19827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849baed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+6:2390:x1868795060822656:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 Request processed in 219us (590us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1782222370.280503:0:19827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 23 00000100:00080000:0.0:1782222370.280715:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782222370.282815:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222370.282898:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060822912 00000100:00100000:3.0:1782222370.282907:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060822912 00000100:00100000:3.0:1782222370.282966:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 9 00000100:00100000:3.0:1782222370.282976:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+34:15674:x1868795060822912:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1782222370.283208:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+35:15674:x1868795060822912:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 Request processed in 233us (399us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1782222370.283217:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 9 00000100:00100000:1.0:1782222370.286022:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222370.286098:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060823168 00000100:00100000:2.0:1782222370.286108:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060823168 00000100:00100000:2.0:1782222370.286162:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 58 00000100:00100000:2.0:1782222370.286172:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d3282c7-c1ac-4cf8-a606-482b3aabf172+35:15674:x1868795060823168:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1782222370.286310:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d3282c7-c1ac-4cf8-a606-482b3aabf172+35:15674:x1868795060823168:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 Request processed in 139us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222370.286318:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 58 00000100:00100000:2.0:1782222370.288617:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222370.288752:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060823296 00000100:00100000:3.0:1782222370.288760:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060823296 00000100:00100000:3.0:1782222370.288858:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 59 00000100:00100000:3.0:1782222370.288868:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+35:15674:x1868795060823296:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782222370.288886:0:17210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782222370.288916:0:17210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed400/0xe2b7cc26e6812b30 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558991 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.289007:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ede00/0xe2b7cc26e6812b37 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.289039:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ede00/0xe2b7cc26e6812b37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.289051:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ede00/0xe2b7cc26e6812b37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782222370.289095:0:17210:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782222370.289113:0:17210:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ede00/0xe2b7cc26e6812b37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.289139:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ed400/0xe2b7cc26e6812b30 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558991 expref: 37 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.289158:0:17210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ede00/0xe2b7cc26e6812b37 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558991 expref: 36 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.289167:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:3.0:1782222370.289170:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1782222370.289173:0:17210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f08483ede00, rc 0) 00000100:00100000:3.0:1782222370.289231:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+36:15674:x1868795060823296:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 365us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222370.289274:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 59 00000100:00100000:0.0:1782222370.293317:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222370.293640:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060823424 00000100:00100000:3.0:1782222370.293650:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060823424 00000100:00100000:2.0:1782222370.294004:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 24 00000100:00100000:2.0:1782222370.294016:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+6:2387:x1868795060823424:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782222370.294034:0:18715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782222370.294055:0:18715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4a9d095/0xe2b7cc26e6812b3e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f7558998 expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782222370.294079:0:18715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3a8e21, blocks: 0x0 00010000:00010000:2.0:1782222370.294099:0:18715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=569s v=(0 0) 00010000:00010000:2.0:1782222370.294103:0:18715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782222370.294126:0:18715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4a9d095/0xe2b7cc26e6812b3e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558998 expref: 7 pid: 18715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222370.294146:0:18715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a4a9d095/0xe2b7cc26e6812b3e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558998 expref: 7 pid: 18715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222370.294159:0:18715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f08413d3c00, rc 0) 00000100:00100000:2.0:1782222370.294220:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+7:2387:x1868795060823424:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 207us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222370.294227:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 24 00000100:00100000:1.0:1782222370.297059:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222370.297137:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060823680 00000100:00100000:3.0:1782222370.297148:0:19481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060823680 00000100:00100000:3.0:1782222370.297205:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 60 00000100:00100000:3.0:1782222370.297215:0:19481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+36:15674:x1868795060823680:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1782222370.297359:0:19481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+36:15674:x1868795060823680:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 Request processed in 145us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222370.297368:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 60 00000100:00100000:1.0:1782222370.300007:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222370.300084:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060823808 00000100:00100000:0.0:1782222370.300093:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060823808 00000100:00100000:0.0:1782222370.300145:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 61 00000100:00100000:0.0:1782222370.300154:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+36:15674:x1868795060823808:12345-192.168.203.27@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1782222370.312930:0:17188:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1782222370.312948:0:17188:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1782222370.313010:0:17188:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:0.0:1782222370.313172:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e68129cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.313186:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e68129cb lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.313194:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e68129cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.313217:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb9600 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222370.313222:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e68129cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.313230:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e68129cb lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.313264:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f07465b1200) 00010000:00010000:0.0:1782222370.313267:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1782222370.313272:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e68129cb lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.313279:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e68129cb lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222370.313445:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+19:15674:x1868795060823808:12345-192.168.203.27@tcp:44:lhsmtool_posix.0 Request processed in 13279us (13434us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222370.313457:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 61 00000100:00100000:0.0:1782222370.314719:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081881344:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1782222370.314785:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222370.315589:0:19827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081881344 00000100:00100000:2.0:1782222370.315597:0:19827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081881344 00000100:00100000:2.0:1782222370.315670:0:19827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782222370.315681:0:19827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1868795081881344:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1782222370.315906:0:19827:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1782222370.315909:0:19827:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1782222370.315911:0:19827:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1782222370.315913:0:19827:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1782222369 -> 1782222369 00002000:00010000:2.0:1782222370.315916:0:19827:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1782222370.315966:0:19827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3654:x1868795081881344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 287us (1180us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1782222370.315973:0:19827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000004:00080000:2.0:1782222370.316565:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f0849bad180/2, rc 0, transno 8589934596 00000100:00100000:2.0:1782222370.316572:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1868795081881344:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1782222370.319424:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782222370.322592:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6812977 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.322609:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6812977 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.322617:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6812977 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.322624:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb9a00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222370.322628:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6812977 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.322636:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6812977 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.322651:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f07465b1100) 00010000:00010000:3.0:1782222370.322654:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222370.322658:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6812977 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.322663:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9a00/0xe2b7cc26e6812977 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.322684:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8a00/0xe2b7cc26e681297e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.322691:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8a00/0xe2b7cc26e681297e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.322709:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8a00/0xe2b7cc26e681297e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.322714:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb8a00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222370.322717:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8a00/0xe2b7cc26e681297e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.322723:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8a00/0xe2b7cc26e681297e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.322732:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f07465b1200) 00010000:00010000:3.0:1782222370.322734:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222370.322737:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8a00/0xe2b7cc26e681297e lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.322743:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8a00/0xe2b7cc26e681297e lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.322757:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812a26 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.322763:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812a26 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.322769:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812a26 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.322773:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb8400 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222370.322776:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812a26 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.322791:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812a26 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.322799:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8f07465b1500) 00010000:00010000:3.0:1782222370.322801:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222370.322804:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812a26 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.322809:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8400/0xe2b7cc26e6812a26 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.322824:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458a00/0xe2b7cc26e6812aab lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.322831:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458a00/0xe2b7cc26e6812aab lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.322836:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458a00/0xe2b7cc26e6812aab lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.322841:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0841458a00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222370.322844:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458a00/0xe2b7cc26e6812aab lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.322849:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458a00/0xe2b7cc26e6812aab lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.322857:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f07465b1600) 00010000:00010000:3.0:1782222370.322859:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782222370.322862:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458a00/0xe2b7cc26e6812aab lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.322873:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458a00/0xe2b7cc26e6812aab lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.322885:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec600/0xe2b7cc26e6812b22 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.322891:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec600/0xe2b7cc26e6812b22 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.322897:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec600/0xe2b7cc26e6812b22 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.322902:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08483ec600 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:3.0:1782222370.322905:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec600/0xe2b7cc26e6812b22 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.322911:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec600/0xe2b7cc26e6812b22 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.322919:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:3.0:1782222370.322921:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782222370.322923:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec600/0xe2b7cc26e6812b22 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.322929:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec600/0xe2b7cc26e6812b22 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222370.329588:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222370.329666:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060823936 00000100:00100000:3.0:1782222370.329678:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060823936 00000100:00100000:3.0:1782222370.329741:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 26 00000100:00100000:3.0:1782222370.329752:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8d3282c7-c1ac-4cf8-a606-482b3aabf172+7:2390:x1868795060823936:12345-192.168.203.27@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1782222370.329883:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8d3282c7-c1ac-4cf8-a606-482b3aabf172+7:2390:x1868795060823936:12345-192.168.203.27@tcp:16:lhsmtool_posix.0 Request processed in 122us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222370.329891:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 26 00000100:00100000:2.0:1782222370.339864:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222370.341129:0:20002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060824192 00000100:00100000:1.0:1782222370.341140:0:20002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060824192 00000100:00100000:1.0:1782222370.341266:0:20002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 62 00000100:00100000:1.0:1782222370.341276:0:20002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d3282c7-c1ac-4cf8-a606-482b3aabf172+15:15674:x1868795060824192:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782222370.341327:0:20002:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782222370.341351:0:20002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ede00/0xe2b7cc26e6812b37 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558991 expref: 15 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.341368:0:20002:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:1.0:1782222370.341373:0:20002:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782222370.341413:0:20002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458800/0xe2b7cc26e6812b45 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.341427:0:20002:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458800/0xe2b7cc26e6812b45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.341442:0:20002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458800/0xe2b7cc26e6812b45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782222370.341577:0:20002:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000790910df reply state 00000000f81db854 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458800/0xe2b7cc26e6812b45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.341589:0:20002:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458800/0xe2b7cc26e6812b45 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.341596:0:20002:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:1.0:1782222370.341599:0:20002:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782222370.341601:0:20002:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782222370.341701:0:20002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d3282c7-c1ac-4cf8-a606-482b3aabf172+16:15674:x1868795060824192:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 Request processed in 426us (1845us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1782222370.341708:0:20002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 62 00000100:00100000:2.0:1782222370.350690:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222370.350873:0:19827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060824320 00000100:00100000:0.0:1782222370.350884:0:19827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060824320 00000100:00100000:0.0:1782222370.350939:0:19827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 27 00000100:00100000:0.0:1782222370.350948:0:19827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+7:15674:x1868795060824320:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782222370.350966:0:19827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222370.351002:0:19827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb9f395d/0xe2b7cc26e6812b4c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f755899f expref: -99 pid: 19827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.351033:0:19827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a4a9d095/0xe2b7cc26e6812b3e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558998 expref: 8 pid: 18715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.351042:0:19827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782222370.351047:0:19827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782222370.351052:0:19827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb9f395d/0xe2b7cc26e6812b4c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755899f expref: 8 pid: 19827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.351082:0:19827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a4a9d095/0xe2b7cc26e6812b3e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558998 expref: 8 pid: 18715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.351095:0:19827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a4a9d095/0xe2b7cc26e6812b3e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558998 expref: 8 pid: 18715 timeout: 669 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222370.351109:0:19827:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19827:1868795081881472:192.168.203.27@tcp:104: 00000100:00100000:0.0:1782222370.351184:0:19827:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0881e9b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782222370.354302:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222370.354498:0:19827:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19827:1868795081881472:192.168.203.27@tcp:104: 00010000:00010000:2.0:1782222370.354543:0:19827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eb9f395d/0xe2b7cc26e6812b4c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755899f expref: 8 pid: 19827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222370.354565:0:19827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fcb9800, rc 0) 00000100:00100000:2.0:1782222370.354623:0:19827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+8:15674:x1868795060824320:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 3676us (3943us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222370.354632:0:19827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 27 00000100:00100000:3.0:1782222370.357678:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060824448 00000100:00100000:3.0:1782222370.357693:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060824448 00010000:00010000:2.0:1782222370.357867:0:17193:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a4a9d095/0xe2b7cc26e6812b3e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558998 expref: 8 pid: 18715 timeout: 669 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222370.357942:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 19 00000100:00100000:2.0:1782222370.357953:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8d3282c7-c1ac-4cf8-a606-482b3aabf172+8:2390:x1868795060824448:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782222370.357968:0:17193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782222370.357986:0:17193:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a4a9d095/0xe2b7cc26e6812b3e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558998 expref: 8 pid: 18715 timeout: 669 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222370.358009:0:17193:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a4a9d095/0xe2b7cc26e6812b3e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558998 expref: 8 pid: 18715 timeout: 669 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222370.358030:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4a9d095/0xe2b7cc26e6812b3e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558998 expref: 8 pid: 18715 timeout: 669 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222370.358066:0:17193:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782222370.358071:0:17193:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782222370.358078:0:17193:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb9f395d/0xe2b7cc26e6812b4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755899f expref: 7 pid: 19827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222370.358088:0:17193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb9f395d/0xe2b7cc26e6812b4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755899f expref: 7 pid: 19827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222370.358123:0:17193:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000eb9f395d/0xe2b7cc26e6812b4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755899f expref: 7 pid: 19827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222370.358136:0:17193:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:17193:1868795081881600:192.168.203.27@tcp:105: 00000100:00100000:2.0:1782222370.358217:0:17193:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08490fae40 going to sleep for 11 seconds 00000100:00100000:0.0:1782222370.362492:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222370.362648:0:17193:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:17193:1868795081881600:192.168.203.27@tcp:105: 00010000:00010000:2.0:1782222370.362681:0:17193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782222370.362749:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8d3282c7-c1ac-4cf8-a606-482b3aabf172+7:2390:x1868795060824448:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 4797us (8453us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222370.362760:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 19 00000100:00100000:3.0:1782222370.363983:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060824576 00000100:00100000:3.0:1782222370.364002:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060824576 00000100:00100000:3.0:1782222370.364050:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 28 00000100:00100000:3.0:1782222370.364058:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8d3282c7-c1ac-4cf8-a606-482b3aabf172+7:2389:x1868795060824576:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1782222370.364198:0:18714:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1782222370.364202:0:18714:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1782222368 00002000:00010000:3.0:1782222370.364205:0:18714:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1782222367 00002000:00010000:3.0:1782222370.364208:0:18714:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1782222369 -> 1782222368 00002000:00010000:3.0:1782222370.364210:0:18714:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1782222370.364294:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8d3282c7-c1ac-4cf8-a606-482b3aabf172+8:2389:x1868795060824576:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 Request processed in 236us (1810us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1782222370.364302:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 28 00000100:00100000:0.0:1782222370.367895:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222370.368124:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060824704 00000100:00100000:1.0:1782222370.368133:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060824704 00000100:00100000:1.0:1782222370.368185:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 29 00000100:00100000:1.0:1782222370.368193:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+8:2388:x1868795060824704:12345-192.168.203.27@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1782222370.368268:0:18716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b5a8e8e2/0xe2b7cc26e6812b53 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.368288:0:18716:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb9f395d/0xe2b7cc26e6812b4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755899f expref: 8 pid: 19827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.368297:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222370.368301:0:18716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782222370.368306:0:18716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5a8e8e2/0xe2b7cc26e6812b53 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.368366:0:18716:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eb9f395d/0xe2b7cc26e6812b4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755899f expref: 8 pid: 19827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.368381:0:18716:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eb9f395d/0xe2b7cc26e6812b4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755899f expref: 8 pid: 19827 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222370.368404:0:18716:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0849bac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:18716:1868795081881728:192.168.203.27@tcp:104: 00000100:00100000:1.0:1782222370.368488:0:18716:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0842d51480 going to sleep for 11 seconds 00000100:00100000:1.0:1782222370.371717:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222370.371821:0:18716:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0849bac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:18716:1868795081881728:192.168.203.27@tcp:104: 00010000:00010000:3.0:1782222370.371843:0:18716:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b5a8e8e2/0xe2b7cc26e6812b53 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222370.372828:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060824832 00000100:00100000:0.0:1782222370.372836:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060824832 00010000:00010000:0.0:1782222370.372872:0:17195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eb9f395d/0xe2b7cc26e6812b4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755899f expref: 9 pid: 19827 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222370.372967:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 20 00000100:00100000:0.0:1782222370.372976:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849baca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+9:2389:x1868795060824832:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782222370.372998:0:17195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782222370.373018:0:17195:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eb9f395d/0xe2b7cc26e6812b4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755899f expref: 9 pid: 19827 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.373031:0:17195:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eb9f395d/0xe2b7cc26e6812b4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755899f expref: 9 pid: 19827 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.373052:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb9f395d/0xe2b7cc26e6812b4c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755899f expref: 9 pid: 19827 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.373067:0:17195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782222370.373071:0:17195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782222370.373077:0:17195:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b5a8e8e2/0xe2b7cc26e6812b53 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.373085:0:17195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5a8e8e2/0xe2b7cc26e6812b53 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.373116:0:17195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782222370.373166:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849baca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+8:2389:x1868795060824832:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 191us (1456us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222370.373173:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 20 00010000:00010000:1.0:1782222370.373224:0:18716:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b5a8e8e2/0xe2b7cc26e6812b53 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.373246:0:18716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5a8e8e2/0xe2b7cc26e6812b53 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.373266:0:18716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b5a8e8e2/0xe2b7cc26e6812b53 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.373275:0:18716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5a8e8e2/0xe2b7cc26e6812b53 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.373282:0:18716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5a8e8e2/0xe2b7cc26e6812b53 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.373300:0:18716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0841459600 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:1.0:1782222370.373304:0:18716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5a8e8e2/0xe2b7cc26e6812b53 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.373313:0:18716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5a8e8e2/0xe2b7cc26e6812b53 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.373325:0:18716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5a8e8e2/0xe2b7cc26e6812b53 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.373333:0:18716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5a8e8e2/0xe2b7cc26e6812b53 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222370.373376:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+7:2388:x1868795060824704:12345-192.168.203.27@tcp:1:lhsmtool_posix.0 Request processed in 5184us (5489us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222370.373394:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 29 00000100:00100000:1.0:1782222370.376213:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222370.376293:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060825088 00000100:00100000:2.0:1782222370.376302:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060825088 00000100:00100000:2.0:1782222370.376354:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 63 00000100:00100000:2.0:1782222370.376363:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849badf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d3282c7-c1ac-4cf8-a606-482b3aabf172+16:15674:x1868795060825088:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1782222370.376460:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3c00/0xe2b7cc26e6812b5a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222370.376487:0:17208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483eda00/0xe2b7cc26e6812aa4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558960 expref: 16 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222370.376497:0:17208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3c00/0xe2b7cc26e6812b5a lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222370.376538:0:17208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483eda00/0xe2b7cc26e6812aa4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558960 expref: 16 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222370.376552:0:17208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483eda00/0xe2b7cc26e6812aa4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558960 expref: 16 pid: 17210 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222370.376566:0:17208:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07474d0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17208:1868795081881856:192.168.203.27@tcp:104: 00000100:00100000:2.0:1782222370.376640:0:17208:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f08490fae40 going to sleep for 11 seconds 00000100:00100000:2.0:1782222370.379477:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222370.379504:0:19545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060825216 00000100:00100000:2.0:1782222370.379522:0:19545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060825216 00010000:00010000:2.0:1782222370.379555:0:19545:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483eda00/0xe2b7cc26e6812aa4 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558960 expref: 17 pid: 17210 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222370.379586:0:19545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 21 00000100:00100000:2.0:1782222370.379593:0:19545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+17:2389:x1868795060825216:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782222370.379624:0:19545:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782222370.379631:0:19545:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483eda00/0xe2b7cc26e6812aa4 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558960 expref: 17 pid: 17210 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222370.379653:0:19545:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483eda00/0xe2b7cc26e6812aa4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558960 expref: 17 pid: 17210 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222370.379681:0:19545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f07465b1600) 00010000:00010000:2.0:1782222370.379686:0:19545:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec800/0xe2b7cc26e6812ac0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755896e expref: 17 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222370.379704:0:19545:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3c00/0xe2b7cc26e6812b5a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222370.379713:0:19545:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3c00/0xe2b7cc26e6812b5a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222370.379720:0:19545:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3c00/0xe2b7cc26e6812b5a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222370.379744:0:19545:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782222370.379785:0:19545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8d3282c7-c1ac-4cf8-a606-482b3aabf172+17:2389:x1868795060825216:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 192us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222370.379792:0:19545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 21 00010000:00010000:1.0:1782222370.381194:0:17208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483eda00/0xe2b7cc26e6812aa4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f7558960 expref: 16 pid: 17210 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222370.381212:0:17208:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07474d0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17208:1868795081881856:192.168.203.27@tcp:104: 00010000:00010000:1.0:1782222370.381288:0:17208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3c00/0xe2b7cc26e6812b5a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222370.381359:0:17208:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3c00/0xe2b7cc26e6812b5a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222370.381367:0:17208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3c00/0xe2b7cc26e6812b5a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222370.381608:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3400/0xe2b7cc26e6812b61 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222370.381629:0:17208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458c00/0xe2b7cc26e6812b29 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755898a expref: 16 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222370.381637:0:17208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3400/0xe2b7cc26e6812b61 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222370.381815:0:17208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458c00/0xe2b7cc26e6812b29 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755898a expref: 16 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222370.381831:0:17208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458c00/0xe2b7cc26e6812b29 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755898a expref: 16 pid: 17209 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782222370.381845:0:17208:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17208:1868795081881984:192.168.203.27@tcp:104: 00000100:00100000:2.0:1782222370.381947:0:17208:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0850939240 going to sleep for 11 seconds 00000100:00100000:2.0:1782222370.384928:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222370.384998:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060825344 00000100:00100000:3.0:1782222370.385008:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060825344 00010000:00010000:3.0:1782222370.385043:0:17194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458c00/0xe2b7cc26e6812b29 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755898a expref: 17 pid: 17209 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222370.385103:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 22 00000100:00100000:3.0:1782222370.385112:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+17:2390:x1868795060825344:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782222370.385127:0:17194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782222370.385133:0:17194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458c00/0xe2b7cc26e6812b29 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755898a expref: 17 pid: 17209 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.385145:0:17194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458c00/0xe2b7cc26e6812b29 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755898a expref: 17 pid: 17209 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.385166:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:3.0:1782222370.385172:0:17194:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3400/0xe2b7cc26e6812b61 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.385181:0:17194:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3400/0xe2b7cc26e6812b61 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.385189:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3400/0xe2b7cc26e6812b61 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.385205:0:17194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782222370.385272:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+17:2390:x1868795060825344:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 161us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222370.385280:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 22 00010000:00010000:0.0:1782222370.386478:0:17208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458c00/0xe2b7cc26e6812b29 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0x558f77f2f755898a expref: 16 pid: 17209 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222370.386498:0:17208:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17208:1868795081881984:192.168.203.27@tcp:104: 00010000:00010000:0.0:1782222370.386528:0:17208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3400/0xe2b7cc26e6812b61 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.386538:0:17208:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3400/0xe2b7cc26e6812b61 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.386544:0:17208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3400/0xe2b7cc26e6812b61 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782222370.386642:0:17208:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1782222370.386913:0:17208:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1782222370.386944:0:17208:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1782222370.387073:0:17208:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17208:1868795081882112:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1782222370.387125:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222370.387205:0:17208:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0881e9bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1782222370.387319:0:18230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081882112 00000100:00100000:3.0:1782222370.387325:0:18230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081882112 00000100:00100000:3.0:1782222370.387482:0:18230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782222370.387491:0:18230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17208:x1868795081882112:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1782222370.387588:0:18230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17208:x1868795081882112:12345-0@lo:1000:mdt00_000.0 Request processed in 98us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222370.387596:0:18230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1782222370.387647:0:17208:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17208:1868795081882112:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1782222370.387813:0:17208:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1782222370.387853:0:17208:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17208:1868795081882240:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1782222370.387879:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222370.388627:0:17208:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0881e9b540 going to sleep for 11 seconds 00000100:00100000:2.0:1782222370.388934:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081882240 00000100:00100000:2.0:1782222370.388940:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081882240 00000100:00100000:2.0:1782222370.388974:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1782222370.388980:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17208:x1868795081882240:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782222370.389111:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17208:x1868795081882240:12345-0@lo:1000:mdt00_000.0 Request processed in 130us (1230us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1782222370.389118:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782222370.389259:0:17208:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17208:1868795081882240:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1782222370.389298:0:17208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3400/0xe2b7cc26e6812b61 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.389308:0:17208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3400/0xe2b7cc26e6812b61 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.389325:0:17208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3400/0xe2b7cc26e6812b61 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.389332:0:17208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08413d3400 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222370.389336:0:17208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3400/0xe2b7cc26e6812b61 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.389345:0:17208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3400/0xe2b7cc26e6812b61 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.389360:0:17208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:0.0:1782222370.389364:0:17208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782222370.389367:0:17208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3400/0xe2b7cc26e6812b61 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.389374:0:17208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3400/0xe2b7cc26e6812b61 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.389408:0:17208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6812ab9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.389415:0:17208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6812ab9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.389421:0:17208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6812ab9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.389426:0:17208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f087fcb8200 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:0.0:1782222370.389429:0:17208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6812ab9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.389443:0:17208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6812ab9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.389451:0:17208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f07465b1600) 00010000:00010000:0.0:1782222370.389453:0:17208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782222370.389460:0:17208:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec800/0xe2b7cc26e6812ac0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755896e expref: 19 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.389472:0:17208:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec800/0xe2b7cc26e6812ac0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755896e expref: 19 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.389481:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec800/0xe2b7cc26e6812ac0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755896e expref: 19 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.389544:0:17208:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f08483ec800/0xe2b7cc26e6812ac0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f755896e expref: 19 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782222370.389558:0:17208:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17208:1868795081882368:192.168.203.27@tcp:105: 00000100:00100000:0.0:1782222370.389613:0:17208:0:(client.c:2701:ptlrpc_set_wait()) set ffff8f0881e9ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1782222370.393020:0:17208:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17208:1868795081882368:192.168.203.27@tcp:105: 00010000:00010000:1.0:1782222370.393059:0:17208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6812ab9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.393069:0:17208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb8200/0xe2b7cc26e6812ab9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.393098:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459800/0xe2b7cc26e6812b68 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.393112:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459800/0xe2b7cc26e6812b68 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.393123:0:17208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459800/0xe2b7cc26e6812b68 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.393133:0:17208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459800/0xe2b7cc26e6812b68 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.393139:0:17208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459800/0xe2b7cc26e6812b68 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.393147:0:17208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459800/0xe2b7cc26e6812b68 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.393152:0:17208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0841459800 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222370.393156:0:17208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459800/0xe2b7cc26e6812b68 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.393163:0:17208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459800/0xe2b7cc26e6812b68 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.393175:0:17208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f07465b1600) 00010000:00010000:1.0:1782222370.393184:0:17208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782222370.393188:0:17208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459800/0xe2b7cc26e6812b68 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.393194:0:17208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841459800/0xe2b7cc26e6812b68 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.393204:0:17208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3c00/0xe2b7cc26e6812b5a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.393210:0:17208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3c00/0xe2b7cc26e6812b5a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.393216:0:17208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3c00/0xe2b7cc26e6812b5a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.393220:0:17208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08413d3c00 already unused, calling callback (ffffffffc199b4f0) 00010000:00010000:1.0:1782222370.393223:0:17208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3c00/0xe2b7cc26e6812b5a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.393230:0:17208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3c00/0xe2b7cc26e6812b5a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.393257:0:17208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f07465b1600) 00010000:00010000:1.0:1782222370.393259:0:17208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782222370.393262:0:17208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3c00/0xe2b7cc26e6812b5a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.393269:0:17208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f08413d3c00/0xe2b7cc26e6812b5a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222370.393418:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849badf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d3282c7-c1ac-4cf8-a606-482b3aabf172+19:15674:x1868795060825088:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 Request processed in 17055us (17213us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1782222370.393437:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 63 00000020:00080000:1.0:1782222370.393443:0:17208:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1782222370.393597:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222370.393624:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060825472 00000100:00100000:0.0:1782222370.393630:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060825472 00000100:00100000:0.0:1782222370.393674:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 10 00000100:00100000:0.0:1782222370.393683:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087fd67050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+19:15672:x1868795060825472:12345-192.168.203.27@tcp:49:dd.0 00000100:00100000:0.0:1782222370.393931:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087fd67050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+19:15672:x1868795060825472:12345-192.168.203.27@tcp:49:dd.0 Request processed in 249us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222370.393945:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 10 00000040:00080000:3.0:1782222370.394199:0:17242:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1782222370.394204:0:17242:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782222370.394220:0:17242:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1782222370.394225:0:17242:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1782222370.397204:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222370.397417:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1782222370.397499:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060825600 00000100:00100000:0.0:1782222370.397519:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060825600 00000100:00100000:0.0:1782222370.397574:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 64 00000100:00100000:0.0:1782222370.397584:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+19:15672:x1868795060825600:12345-192.168.203.27@tcp:101:dd.0 00010000:00010000:0.0:1782222370.397604:0:17209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782222370.397623:0:17209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812b6f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x558f77f2f75589a6 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.397657:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e6812b76 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.397675:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e6812b76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.397687:0:17209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e6812b76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17209 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.397820:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9800/0xe2b7cc26e6812b6f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75589a6 expref: 21 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.397838:0:17209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f087fcb9600/0xe2b7cc26e6812b76 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x558f77f2f75589a6 expref: 20 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782222370.397847:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f07465b1600) 00010000:00010000:0.0:1782222370.397850:0:17209:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782222370.397852:0:17209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f087fcb9600, rc 0) 00000100:00100000:0.0:1782222370.397904:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+20:15672:x1868795060825600:12345-192.168.203.27@tcp:101:dd.0 Request processed in 322us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222370.397918:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 64 00000100:00100000:1.0:1782222370.400812:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060825856 00000100:00100000:1.0:1782222370.400824:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060825856 00000100:00100000:1.0:1782222370.401268:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 11 00000100:00100000:1.0:1782222370.401278:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+20:15674:x1868795060825856:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1782222370.401535:0:17212:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1782222370.401569:0:17212:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1782222370.401611:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458600/0xe2b7cc26e6812b7d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.401629:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458600/0xe2b7cc26e6812b7d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.401650:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458600/0xe2b7cc26e6812b7d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.401659:0:17212:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458600/0xe2b7cc26e6812b7d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.401667:0:17212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458600/0xe2b7cc26e6812b7d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.401674:0:17212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458600/0xe2b7cc26e6812b7d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.401696:0:17212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782222370.401776:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8d3282c7-c1ac-4cf8-a606-482b3aabf172+22:15674:x1868795060825856:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 Request processed in 498us (4358us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1782222370.401798:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 11 00000020:00080000:1.0:1782222370.401803:0:17212:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1782222370.401854:0:17196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782222370.401861:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458600/0xe2b7cc26e6812b7d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222370.401876:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0841458600 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:2.0:1782222370.401881:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458600/0xe2b7cc26e6812b7d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222370.401888:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458600/0xe2b7cc26e6812b7d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222370.401899:0:17196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f087f8f1800) 00010000:00010000:2.0:1782222370.401902:0:17196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782222370.401905:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458600/0xe2b7cc26e6812b7d lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222370.401911:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f0841458600/0xe2b7cc26e6812b7d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222370.401922:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222370.401924:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222370.401925:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782222370.570339:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1782222370.570401:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222370.570503:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060825984 00000100:00100000:3.0:1782222370.570524:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060825984 00000100:00100000:3.0:1782222370.570590:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060826112 00000100:00100000:3.0:1782222370.570597:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060826112 00000100:00100000:3.0:1782222370.570618:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 0 00000100:00100000:3.0:1782222370.570628:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8d3282c7-c1ac-4cf8-a606-482b3aabf172+8:2388:x1868795060825984:12345-192.168.203.27@tcp:4:dd.0 00002000:00010000:3.0:1782222370.570691:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a3a8e20, atime: 0x6a3a8e1f, ctime: 0x6a3a8e20, blocks: 0x0 00010000:00010000:3.0:1782222370.570701:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fcfd83b/0xe2b7cc26e6812b84 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.570717:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=569s v=(0 0) 00010000:00010000:3.0:1782222370.570721:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782222370.570727:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fcfd83b/0xe2b7cc26e6812b84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782222370.570752:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fcfd83b/0xe2b7cc26e6812b84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782222370.602813:0:19828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782222370.781801:0:19527:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:3.0:1782222370.781866:0:19527:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:1.0:1782222370.783477:0:18719:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1782222370.783548:0:18719:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1782222368 -> 1782222369 00002000:00010000:1.0:1782222370.783553:0:18719:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1782222368 -> 1782222369 00002000:00010000:1.0:1782222370.783556:0:18719:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:1.0:1782222370.783591:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fcfd83b/0xe2b7cc26e6812b84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.783627:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fcfd83b/0xe2b7cc26e6812b84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.783641:0:18719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fcfd83b/0xe2b7cc26e6812b84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.783651:0:18719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f08483ec600 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:1.0:1782222370.783913:0:18719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fcfd83b/0xe2b7cc26e6812b84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.783925:0:18719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fcfd83b/0xe2b7cc26e6812b84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.783951:0:18719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fcfd83b/0xe2b7cc26e6812b84 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.783960:0:18719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fcfd83b/0xe2b7cc26e6812b84 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222370.784143:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8d3282c7-c1ac-4cf8-a606-482b3aabf172+6:2388:x1868795060825984:12345-192.168.203.27@tcp:4:dd.0 Request processed in 213508us (213806us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1782222370.784161:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 0 00000100:00100000:1.0:1782222370.784209:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 1 00000100:00100000:1.0:1782222370.784223:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8d3282c7-c1ac-4cf8-a606-482b3aabf172+5:2388:x1868795060826112:12345-192.168.203.27@tcp:4:dd.0 00002000:00010000:1.0:1782222370.784365:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 4194304, mtime: 0x6a3a8e21, atime: 0x6a3a8e1f, ctime: 0x6a3a8e21, blocks: 0x2000 00010000:00010000:1.0:1782222370.784376:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002038aac4/0xe2b7cc26e6812b8b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.784392:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=569s v=(0 0) 00010000:00010000:1.0:1782222370.784398:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782222370.784410:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002038aac4/0xe2b7cc26e6812b8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222370.784427:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002038aac4/0xe2b7cc26e6812b8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782222370.796865:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074561ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081882496:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782222370.796972:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222370.797051:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782222370.797062:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07475aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081882624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782222370.797091:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222370.799392:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081882752:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782222370.799518:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222370.799636:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081882496 00000100:00100000:0.0:1782222370.799672:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081882496 00000100:00100000:0.0:1782222370.800001:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081882752 00000100:00100000:0.0:1782222370.800008:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081882752 00000100:00100000:0.0:1782222370.800044:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782222370.800058:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07475aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081882496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782222370.800108:0:17214:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1782222370.800182:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07475aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1868795081882496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (3209us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222370.800190:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782222370.800211:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782222370.800217:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074778e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081882752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782222370.800280:0:17214:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1782222370.800316:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074778e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081882752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222370.800322:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782222370.800375:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081882752:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782222370.800433:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074561ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1868795081882496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782222370.801217:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081882624 00000100:00100000:2.0:1782222370.801228:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081882624 00000100:00100000:2.0:1782222370.801326:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782222370.801340:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081882624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782222370.801375:0:18718:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1782222370.801472:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081882624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (4379us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222370.801480:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1782222370.806301:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782222370.806437:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07475aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081882624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782222370.807164:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747c6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081882880:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782222370.807295:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782222370.809999:0:20351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081882880 00000100:00100000:2.0:1782222370.810024:0:20351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081882880 00000100:00100000:2.0:1782222370.810146:0:20351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782222370.810158:0:20351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081882880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782222370.810197:0:20351:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1782222370.810350:0:20351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1868795081882880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 194us (3057us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222370.810359:0:20351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1782222370.810917:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782222370.810986:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747c6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1868795081882880:0@lo:13:osp-pre-0-1.0 00000001:00080000:2.0:1782222371.012466:0:19527:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:1.0:1782222371.014612:0:18719:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:1.0:1782222371.014625:0:18719:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:1.0:1782222371.014647:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002038aac4/0xe2b7cc26e6812b8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222371.014663:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002038aac4/0xe2b7cc26e6812b8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222371.014702:0:18719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002038aac4/0xe2b7cc26e6812b8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222371.014711:0:18719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f0841459800 already unused, calling callback (ffffffffc0da4ce0) 00010000:00010000:1.0:1782222371.014717:0:18719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002038aac4/0xe2b7cc26e6812b8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222371.014726:0:18719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002038aac4/0xe2b7cc26e6812b8b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222371.014752:0:18719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002038aac4/0xe2b7cc26e6812b8b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782222371.014759:0:18719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002038aac4/0xe2b7cc26e6812b8b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782222371.016106:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8d3282c7-c1ac-4cf8-a606-482b3aabf172+5:2388:x1868795060826112:12345-192.168.203.27@tcp:4:dd.0 Request processed in 231869us (445685us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1782222371.016123:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 1 00010000:00010000:2.0:1782222371.628794:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782222371.760925:0:17966:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1782222371.818994:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f07475aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081883264:0@lo:400:kworker.0 00000100:00100000:3.0:1782222371.819114:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222371.819182:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081883776:0@lo:400:kworker.0 00000100:00100000:3.0:1782222371.819221:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222371.819314:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1868795081884288:0@lo:400:kworker.0 00000100:00100000:3.0:1782222371.819376:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222371.819420:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1782222371.819430:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081883392:0@lo:400:kworker.0 00000100:00100000:3.0:1782222371.819466:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222371.819493:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081883904:0@lo:400:kworker.0 00000100:00100000:3.0:1782222371.819537:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222371.819564:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1868795081884416:0@lo:400:kworker.0 00000100:00100000:3.0:1782222371.819597:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782222371.819684:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081883264 00000100:00100000:3.0:1782222371.819696:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081883264 00000100:00100000:3.0:1782222371.819788:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081883776 00000100:00100000:3.0:1782222371.819794:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081883776 00000100:00100000:3.0:1782222371.819809:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081883392 00000100:00100000:3.0:1782222371.819813:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081883392 00000100:00100000:3.0:1782222371.819838:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081883904 00000100:00100000:3.0:1782222371.819843:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081883904 00000100:00100000:3.0:1782222371.819887:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782222371.819897:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081883264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222371.819987:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081883264:12345-0@lo:400:kworker.0 Request processed in 89us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222371.819997:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782222371.820023:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782222371.820033:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081883776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222371.820071:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081883776:12345-0@lo:400:kworker.0 Request processed in 41us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222371.820080:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782222371.820095:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782222371.820105:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081883392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222371.820145:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1868795081883392:12345-0@lo:400:kworker.0 Request processed in 41us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222371.820152:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782222371.820172:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782222371.820182:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081883904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222371.820222:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081883904:12345-0@lo:400:kworker.0 Request processed in 42us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222371.820229:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782222371.820304:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081884288 00000100:00100000:3.0:1782222371.820321:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081884288 00000100:00100000:3.0:1782222371.820365:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081884416 00000100:00100000:3.0:1782222371.820370:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081884416 00000100:00100000:3.0:1782222371.820400:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782222371.820408:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1868795081884288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222371.820458:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1868795081884288:12345-0@lo:400:kworker.0 Request processed in 50us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222371.820466:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782222371.820480:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1782222371.820486:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1868795081884416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782222371.820526:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1868795081884416:12345-0@lo:400:kworker.0 Request processed in 40us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222371.820531:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1782222371.820549:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782222371.820553:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782222371.820556:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782222371.820589:0:3653:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:3.0:1782222371.820595:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f0849bad180, transno 8589934596 00000004:00080000:3.0:1782222371.820606:0:3653:0:(osp_trans.c:1042:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:3.0:1782222371.820640:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081883392:0@lo:400:kworker.0 00000100:00100000:3.0:1782222371.820657:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081883904:0@lo:400:kworker.0 00000100:00100000:3.0:1782222371.820666:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1868795081884416:0@lo:400:kworker.0 00000100:00100000:3.0:1782222371.820677:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f07475aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1868795081883264:0@lo:400:kworker.0 00000100:00100000:3.0:1782222371.820688:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081883776:0@lo:400:kworker.0 00010000:00080000:3.0:1782222371.820701:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0881599f80 x1868795081884288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222371.820722:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1868795081884288:0@lo:400:kworker.0 00000100:00100000:1.0:1782222371.831394:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081883136:0@lo:400:kworker.0 00000100:00100000:1.0:1782222371.831525:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222371.831578:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f088159bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081883648:0@lo:400:kworker.0 00000100:00100000:1.0:1782222371.831606:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222371.831632:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1868795081884160:0@lo:400:kworker.0 00000100:00100000:1.0:1782222371.831684:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222371.831714:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1782222371.831722:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f074778c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0873f67-836f-4221-9522-aadc54ad715e:3656:1868795081883008:0@lo:400:kworker.0 00000100:00100000:1.0:1782222371.831754:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222371.831793:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1868795081883520:0@lo:400:kworker.0 00000100:00100000:1.0:1782222371.831816:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222371.831833:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0881598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1868795081884032:0@lo:400:kworker.0 00000100:00100000:1.0:1782222371.831857:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222371.831869:0:3656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1868795081884544:0@lo:400:kworker.0 00000100:00100000:1.0:1782222371.831896:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222371.831926:0:20002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081884160 00000100:00100000:1.0:1782222371.831934:0:20002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081884160 00000100:00100000:1.0:1782222371.832001:0:20002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081883520 00000100:00100000:1.0:1782222371.832006:0:20002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081883520 00000100:00100000:1.0:1782222371.832029:0:20002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081884032 00000100:00100000:1.0:1782222371.832034:0:20002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081884032 00000100:00100000:1.0:1782222371.832053:0:20002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081884544 00000100:00100000:1.0:1782222371.832316:0:20002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081884544 00000100:00100000:1.0:1782222371.832361:0:20002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1782222371.832375:0:20002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1868795081884160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222371.832472:0:20002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1868795081884160:12345-0@lo:400:kworker.0 Request processed in 101us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222371.832675:0:20002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1782222371.832703:0:20002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1782222371.832709:0:20002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1868795081883520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222371.832743:0:20002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1868795081883520:12345-0@lo:400:kworker.0 Request processed in 34us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222371.832766:0:20002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1782222371.832780:0:20002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1782222371.832786:0:20002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1868795081884032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222371.832840:0:20002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1868795081884032:12345-0@lo:400:kworker.0 Request processed in 52us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222371.832848:0:20002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1782222371.832868:0:20002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782222371.832879:0:20002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f086b786300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1868795081884544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222371.832909:0:20002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f086b786300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1868795081884544:12345-0@lo:400:kworker.0 Request processed in 34us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222371.832915:0:20002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782222371.833157:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081883136 00000100:00100000:1.0:1782222371.833165:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081883136 00000100:00100000:1.0:1782222371.833208:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081883648 00000100:00100000:1.0:1782222371.833214:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081883648 00000100:00100000:1.0:1782222371.833264:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782222371.833272:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081883136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222371.833324:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1868795081883136:12345-0@lo:400:kworker.0 Request processed in 54us (1799us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222371.833330:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782222371.833344:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782222371.833350:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081883648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782222371.833378:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1868795081883648:12345-0@lo:400:kworker.0 Request processed in 27us (1770us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222371.833383:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782222371.833413:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081883008 00000100:00100000:1.0:1782222371.833417:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081883008 00000100:00100000:1.0:1782222371.833443:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1782222371.833449:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f4f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+24:3656:x1868795081883008:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1782222371.833994:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782222371.834002:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782222371.834095:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0873f67-836f-4221-9522-aadc54ad715e:3656:1868795081883008:0@lo:400:kworker.0 00000100:00100000:3.0:1782222371.834118:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1868795081883520:0@lo:400:kworker.0 00000100:00100000:3.0:1782222371.834131:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1868795081884032:0@lo:400:kworker.0 00010000:00080000:3.0:1782222371.834147:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f0747ef4e00 x1868795081884544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782222387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782222371.834157:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1868795081884544:0@lo:400:kworker.0 00000100:00100000:3.0:1782222371.834169:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f074778c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1868795081883136:0@lo:400:kworker.0 00000100:00100000:3.0:1782222371.834181:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f088159bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1868795081883648:0@lo:400:kworker.0 00000100:00100000:3.0:1782222371.834194:0:3656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0881598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1868795081884160:0@lo:400:kworker.0 00000100:00100000:0.0:1782222371.834532:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782222371.834561:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747ef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081884672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782222371.834633:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782222371.834680:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081884672 00000100:00100000:0.0:1782222371.834686:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081884672 00000100:00100000:0.0:1782222371.834732:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782222371.834740:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081884672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782222371.834762:0:18717:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923513344 avail 3684286464 00000100:00100000:0.0:1782222371.834802:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1868795081884672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222371.834809:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782222371.834850:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747ef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1868795081884672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782222371.835743:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8f0747c6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081884800:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782222371.835800:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782222371.835909:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f4f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0873f67-836f-4221-9522-aadc54ad715e+24:3656:x1868795081883008:12345-0@lo:400:kworker.0 Request processed in 33us (1727us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222371.835920:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1782222371.836432:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795081884800 00000100:00100000:3.0:1782222371.836441:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795081884800 00000100:00100000:3.0:1782222371.836567:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782222371.836579:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f074561dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081884800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782222371.836606:0:18718:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923513344 avail 3684286464 00000100:00100000:3.0:1782222371.836665:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f074561dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1868795081884800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222371.836672:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782222371.836798:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8f0747c6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1868795081884800:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1782222372.650722:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782222373.296171:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222373.296212:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222373.296271:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1782222373.296304:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060826240 00000100:00100000:3.0:1782222373.296316:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060826240 00000100:00100000:3.0:1782222373.296379:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 169 00000100:00100000:3.0:1782222373.296390:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f4f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+13:2388:x1868795060826240:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222373.296476:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f4f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0274066-4ed8-4dcc-b7c7-6f5c024ab825+13:2388:x1868795060826240:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 88us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222373.296500:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 169 00000100:00100000:3.0:1782222373.296543:0:20002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060826496 00000100:00100000:3.0:1782222373.296547:0:20002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060826496 00000100:00100000:3.0:1782222373.296590:0:20002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060826368 00000100:00100000:3.0:1782222373.296593:0:20002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060826368 00000100:00100000:3.0:1782222373.296622:0:20002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 73 00000100:00100000:3.0:1782222373.296630:0:20002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d3282c7-c1ac-4cf8-a606-482b3aabf172+5:2388:x1868795060826496:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222373.296680:0:20002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d3282c7-c1ac-4cf8-a606-482b3aabf172+5:2388:x1868795060826496:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 51us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222373.296687:0:20002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 73 00000100:00100000:3.0:1782222373.296699:0:20002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 74 00000100:00100000:3.0:1782222373.296706:0:20002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0747c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d3282c7-c1ac-4cf8-a606-482b3aabf172+22:2388:x1868795060826368:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1782222373.296739:0:20002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0747c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d3282c7-c1ac-4cf8-a606-482b3aabf172+22:2388:x1868795060826368:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 34us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1782222373.296746:0:20002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 74 00000100:00080000:3.0:1782222373.296773:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782222373.296778:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782222373.305937:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222373.305980:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222373.306017:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222373.306040:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222373.306060:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222373.306105:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1782222373.306152:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060826624 00000100:00100000:1.0:1782222373.306166:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060826624 00000100:00100000:1.0:1782222373.306231:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060827136 00000100:00100000:1.0:1782222373.306257:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060827136 00000100:00100000:1.0:1782222373.306274:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060826752 00000100:00100000:1.0:1782222373.306276:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060826752 00000100:00100000:1.0:1782222373.306291:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060827264 00000100:00100000:1.0:1782222373.306293:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060827264 00000100:00100000:1.0:1782222373.306312:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 35 00000100:00100000:1.0:1782222373.306323:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f917480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+5:2388:x1868795060826752:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1782222373.306418:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f917480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+5:2388:x1868795060826752:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 96us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222373.306426:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 35 00000100:00100000:1.0:1782222373.306449:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 30 00000100:00100000:1.0:1782222373.306455:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f0849bad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+5:2386:x1868795060826624:12345-192.168.203.27@tcp:9:kworker.0 00000020:00000080:1.0:1782222373.306501:0:18716:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e6812874 00000100:00080000:1.0:1782222373.306518:0:18716:0:(import.c:65:import_set_state_nolock()) ffff8f07470fe000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782222373.306574:0:18716:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1782222373.307084:0:19827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 31 00000100:00100000:2.0:1782222373.307161:0:19827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f07474bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c320fdbb-74fa-4205-b5df-42980d45bb62+5:2386:x1868795060827136:12345-192.168.203.27@tcp:9:kworker.0 00000020:00000080:2.0:1782222373.307188:0:19827:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e68128b3 00000100:00080000:2.0:1782222373.307195:0:19827:0:(import.c:65:import_set_state_nolock()) ffff8f084fd18800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782222373.307246:0:19827:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1782222373.307371:0:19827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f07474bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c320fdbb-74fa-4205-b5df-42980d45bb62+2:2386:x1868795060827136:12345-192.168.203.27@tcp:9:kworker.0 Request processed in 277us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222373.307380:0:19827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 31 00000100:00100000:2.0:1782222373.307399:0:19827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 32 00000100:00100000:2.0:1782222373.307408:0:19827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f916d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c320fdbb-74fa-4205-b5df-42980d45bb62+5:2386:x1868795060827264:12345-192.168.203.27@tcp:9:kworker.0 00000020:00000080:2.0:1782222373.307421:0:19827:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2b7cc26e68128ba 00000100:00080000:2.0:1782222373.307440:0:19827:0:(import.c:65:import_set_state_nolock()) ffff8f084fd1b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782222373.307480:0:19827:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1782222373.307538:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060826880 00000100:00100000:0.0:1782222373.307547:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060826880 00000100:00100000:0.0:1782222373.307596:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868795060827008 00000100:00100000:0.0:1782222373.307600:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868795060827008 00000100:00100000:0.0:1782222373.307626:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 75 00000100:00100000:2.0:1782222373.307695:0:19827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f916d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c320fdbb-74fa-4205-b5df-42980d45bb62+2:2386:x1868795060827264:12345-192.168.203.27@tcp:9:kworker.0 Request processed in 288us (1588us total) trans 0 rc 0/0 00000100:00100000:2.0:1782222373.307703:0:19827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 32 00010000:00010000:2.0:1782222373.307723:0:19828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222373.307806:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222373.307813:0:17196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782222373.307983:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c320fdbb-74fa-4205-b5df-42980d45bb62+6:2388:x1868795060826880:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222373.308027:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c320fdbb-74fa-4205-b5df-42980d45bb62+6:2388:x1868795060826880:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 49us (2009us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222373.308034:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 75 00000100:00100000:0.0:1782222373.308049:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 76 00000100:00100000:0.0:1782222373.308056:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f087f916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c320fdbb-74fa-4205-b5df-42980d45bb62+5:2388:x1868795060827008:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1782222373.308079:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f087f916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c320fdbb-74fa-4205-b5df-42980d45bb62+5:2388:x1868795060827008:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 24us (2018us total) trans 0 rc 0/0 00000100:00100000:0.0:1782222373.308084:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 76 00000100:00080000:3.0:1782222373.310089:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782222373.310101:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782222373.310105:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782222373.310116:0:17204:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782222373.313534:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f0849bad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8d3282c7-c1ac-4cf8-a606-482b3aabf172+2:2386:x1868795060826624:12345-192.168.203.27@tcp:9:kworker.0 Request processed in 7061us (7596us total) trans 0 rc 0/0 00000100:00100000:1.0:1782222373.313553:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 30 00000001:02000400:1.0:1782222373.456916:0:20390:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1782222373.683089:0:19828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782222374.700221:0:17197:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 44041 lines, 44041 kept, 0 dropped, 0 bad.